I just came to a realization. When I put these ip blocks in via cpanel, it's basically just appending those blocks to my .htaccess file.
Here is the end of my .htaccess file that has essentially blocked all these bots, I hope it can be helpful for some:
Code: Select all
# bot blocking script below this line
BrowserMatchNoCase "libwww-perl" bad_bot
BrowserMatchNoCase "wget" bad_bot
BrowserMatchNoCase "LieBaoFast" bad_bot
BrowserMatchNoCase "Mb2345Browser" bad_bot
BrowserMatchNoCase "zh-CN" bad_bot
BrowserMatchNoCase "MicroMessenger" bad_bot
BrowserMatchNoCase "zh_CN" bad_bot
BrowserMatchNoCase "Kinza" bad_bot
BrowserMatchNoCase "Bytespider" bad_bot
BrowserMatchNoCase "Baiduspider" bad_bot
BrowserMatchNoCase "Sogou" bad_bot
BrowserMatchNoCase "Datanyze" bad_bot
BrowserMatchNoCase "AspiegelBot" bad_bot
BrowserMatchNoCase "adscanner" bad_bot
BrowserMatchNoCase "serpstatbot" bad_bot
BrowserMatchNoCase "spaziodat" bad_bot
BrowserMatchNoCase "undefined" bad_bot
BrowserMatchNoCase "claudebot" bad_bot
BrowserMatchNoCase "facebookexternalhit/1.1" bad_bot
BrowserMatchNoCase "meta-externalagent/1.1" bad_bot
BrowserMatchNoCase "webmaster.petalsearch.co" bad_bot
Order Deny,Allow
Deny from env=bad_bot
<Files 403.shtml>
order allow,deny
allow from all
</Files>
deny from 47.82.0.0/16
deny from 47.49.0.0/16
deny from 47.79.0.0/16
deny from 47.74.0.0/15
deny from 47.76.0.0/14
deny from 47.80.0.0/13
deny from 47.235.0.0/16
deny from 47.236.0.0/14
deny from 47.240.0.0/14
deny from 47.244.0.0/15
deny from 47.246.0.0/16
deny from 47.250.0.0/15
deny from 47.252.0.0/15
deny from 47.254.0.0/16
deny from 47.88.0.0/14
deny from 47.56.0.0/15
deny from 155.102.0.0/16
deny from 163.181.0.0/16
deny from 47.52.0.0/16
deny from 147.139.0.0/16
deny from 139.95.0.0/16
deny from 72.254.0.0/16
deny from 61.200.84.0/24
deny from 47.89.91.0/24
deny from 47.89.112.0/24
deny from 111.108.151.176/28