Claudebot attack

[deninho32]

Since today my board has 150 bots online, almost all are claudebot. I can't find anything about it on this forum yet.

I've tried to add the following line to my .htaccess file, but without success. Anyone who can help?

Code: Select all

BrowserMatchNoCase "claudebot" bad_bot

[Mick]

You can try robots.txt to stop any AI bots, whether or not they respect it is a different thing. You could also ask your host as they may have something in place for this kind of bot.

[HiFiKabin]

The Block Bad Bots HTACCESS I have on my extensions board might block it as it is, and/or you can add Claudebot to the list of blocked bots

[P_I]

This definitely seems like a new one and I'm seeing many instances on my boards.

What does your .htaccess do with bad_bot?

Here's the tail end of mine that denies anything defined as bad_bot

Code: Select all

# 28-Mar-24, P_I, another one to banish
BrowserMatchNoCase "claudebot" bad_bot
Order Deny,Allow
Deny from env=bad_bot

[HiFiKabin]

What does your .htaccess do with bad_bot?

Its a HTACCESS script by Jeff Star

The 8G Firewall is a carefully crafted set of security rules for Apache and Nginx servers. It can be applied via your site’s public root .htaccess file, or added via server configuration. Once added, 8G provides powerful server-level protection against a wide range of malicious requests, bad bots, automated attacks, spam, and many other types of threats and nonsense. It’s a lightweight (only 17KB) strong firewall that improves site security and peace of mind.

[P_I]

What does your .htaccess do with bad_bot?

Its a HTACCESS script by Jeff Star

Our posts crossed. I was asking the OP.

I have posted this a number of times that I've been using Blocking aggressive Chinese crawlers/scrapers/bots - John Large .co.uk, particularly this version.

[deninho32]

This is in my .htaccess

Code: Select all

BrowserMatchNoCase "libwww-perl" bad_bot
BrowserMatchNoCase "wget" bad_bot
BrowserMatchNoCase "LieBaoFast" bad_bot
BrowserMatchNoCase "Mb2345Browser" bad_bot
BrowserMatchNoCase "zh-CN" bad_bot
BrowserMatchNoCase "MicroMessenger" bad_bot
BrowserMatchNoCase "zh_CN" bad_bot
BrowserMatchNoCase "Kinza" bad_bot
BrowserMatchNoCase "Bytespider" bad_bot
BrowserMatchNoCase "Baiduspider" bad_bot
BrowserMatchNoCase "Sogou" bad_bot
BrowserMatchNoCase "Datanyze" bad_bot
BrowserMatchNoCase "AspiegelBot" bad_bot
BrowserMatchNoCase "adscanner" bad_bot
BrowserMatchNoCase "serpstatbot" bad_bot
BrowserMatchNoCase "spaziodat" bad_bot
BrowserMatchNoCase "undefined" bad_bot
BrowserMatchNoCase "claudebot" bad_bot
Order Deny,Allow
Deny from env=bad_bot

[cabot]

Here's the tail end of mine that denies anything defined as bad_bot

Code: Select all

# 28-Mar-24, P_I, another one to banish
BrowserMatchNoCase "claudebot" bad_bot
Order Deny,Allow
Deny from env=bad_bot

Thx!

I had the same problem today, and this solved it.

[P_I]

This is in my .htaccess

That looks correct. Are you still seeing claudebot instances active on your board?

[deninho32]

Yes, even more now.

Edit: I've added them to the following lines and that solved it.

Code: Select all

##spammers
Options +FollowSymLinks
RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} AhrefsBot/6.1|Ahrefs|Baiduspider|BLEXBot|SemrushBot|claudebot|YandexBot/3.0|Bytespider|YandexBot|Mb2345Browser|LieBaoFast|zh-CN|MicroMessenger|zh_CN|Kinza|Datanyze|serpstatbot|spaziodati|OPPO\sA33|AspiegelBot|PetalBot [NC]
RewriteRule ^ - [F,L]

Thanks for helping out.

[Lady_G]

Yes, thank you!

I block bad bots from my HAProxy load balancer. It's configured to read a "bad bot" text file.

I added claudebot to the file and phpBB went from over 100 bots to zero.

[ssl]

Here's the tail end of mine that denies anything defined as bad_bot

Code: Select all

# 28-Mar-24, P_I, another one to banish
BrowserMatchNoCase "claudebot" bad_bot
Order Deny,Allow
Deny from env=bad_bot

Thx!

I had the same problem today, and this solved it.

Glad for you

[german-german]

Solution for nginx: https://gist.github.com/dangovorenefekt ... bc833bc1bf

[Mirrabeau]

This definitely seems like a new one and I'm seeing many instances on my boards.

What does your .htaccess do with bad_bot?

Here's the tail end of mine that denies anything defined as bad_bot

Code: Select all

# 28-Mar-24, P_I, another one to banish
BrowserMatchNoCase "claudebot" bad_bot
Order Deny,Allow
Deny from env=bad_bot

This works perfectly. After restarting Apache of course.

[lurttinen]

They train their AI and rape your website while dong it.

"helpful, honest, and harmless AI system" as they say it is.

We can skew their training by blocking access to the data.