Definitive Bots/Crawlers List?

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Suggested Hosts
AndyAero95
Registered User
Posts: 31
Joined: Sat Jan 26, 2019 11:56 pm

Definitive Bots/Crawlers List?

Post by AndyAero95 »

Does anyone have a definitive list of Bots/Crawlers, including their "String" that needs to be added to the Bots list in ACP? We currently have 50 listed, but still seem to be inundated with Bot activity which we believe is causing issues with the board. Our host recorded 12 cores of their server running at 100% today, so upped the core allocation to 18, and it's still maxing out?
User avatar
Mick
Support Team Member
Support Team Member
Posts: 26882
Joined: Fri Aug 29, 2008 9:49 am

Re: Definitive Bots/Crawlers List?

Post by Mick »

I don’t think there’s a definitive list here as it’s constantly changing. There are a lot listed in the topics linked below as well as possible cures.

viewtopic.php?t=2550501
viewtopic.php?t=2652265
  • "The more connected we get the more alone we become” - Kyle Broflovski© 🇬🇧
User avatar
Talk19Zehn
Registered User
Posts: 917
Joined: Tue Aug 09, 2011 1:10 pm

Re: Definitive Bots/Crawlers List?

Post by Talk19Zehn »

Just as an aside: AFAIK
It can also help to empty the session table via ACP. It is worth a try following Mick's suggestions. (My experience .... ) among others ...

Regards
User avatar
Prosk8er
Registered User
Posts: 1783
Joined: Sun Mar 12, 2006 3:30 am
Location: Rochester, NY
Name: Tyler

Re: Definitive Bots/Crawlers List?

Post by Prosk8er »

Cloudflare can help too if your not using it already

Return to “phpBB Discussion”