Bots eating up all the bandwidth

Discussion of non-phpBB related topics with other phpBB.com users.
Forum rules
General Discussion is a bonus forum for discussion of non-phpBB related topics with other phpBB.com users. All site rules apply.
fuolo
Registered User
Posts: 4
Joined: Sun Aug 04, 2024 6:51 pm

Re: Bots eating up all the bandwidth

Post by fuolo »

There is Baidu and Yandex in the list, which are also search engines and competitors of Google, relying on Google too much can backfire, but if someone doesn't want russian speaking and chinese speaking traffic then I guess it is fine ;) also not sure about Facebook and Apple, if there can be some drawback but probably not.
User avatar
[Dimetrodon]
Registered User
Posts: 482
Joined: Tue Aug 30, 2022 3:29 am
Location: Paleozoic Era

Re: Bots eating up all the bandwidth

Post by [Dimetrodon] »

Yeah, I am not sure if foreign search engines need to be blocked.

SEO companies, sure, but not actual search engines.
User avatar
JLA
Registered User
Posts: 618
Joined: Tue Nov 16, 2004 5:23 pm
Location: USA
Name: JLA FORUMS

Re: Bots eating up all the bandwidth

Post by JLA »

supanet wrote: Mon Jul 01, 2024 3:16 pm
No need to pay Cloudfare or another third party. Just implement a set of logical checks in your board's code. Our phpbb2 board uses a multilayered security approach to stop most non-desireable traffic including the more recent deluge of AI harvesters. The same approach should be easy to implement on any phpbb3 board as well.
User avatar
JLA
Registered User
Posts: 618
Joined: Tue Nov 16, 2004 5:23 pm
Location: USA
Name: JLA FORUMS

Re: Bots eating up all the bandwidth

Post by JLA »

JLA wrote: Wed Sep 18, 2024 9:05 pm
Another note, the facebookexternalhit and other similar meta useragents coming from Facebook IPs in the USA and Europe are bots from META stealing your content to feed there new AI engine. Best to block them or at the least only serve them the bare necessary data that is needed for Facebook shares as blocking will also prevent Facebook sharing. There are all tied into the same bots.
User avatar
thecoalman
Community Team Member
Community Team Member
Posts: 6334
Joined: Wed Dec 22, 2004 3:52 am
Location: Pennsylvania, U.S.A.

Re: Bots eating up all the bandwidth

Post by thecoalman »

JLA wrote: Wed Sep 18, 2024 9:05 pm No need to pay Cloudfare or another third party.
The free Cloudflare plan is actually quite good. They give you most of the main features but they will limit them, e.g. I think you only get 5 custom firewall rules with the free plan but that's all I'm using with the paid plan.There is lot more they offer than just improved security, it's also provide performance.

If you wanted to take the time you can actually integrate a lot of things into phpBB, e.g. there is custom header for country of origin. You could add column for that anywhere the IP is recorded.
“Results! Why, man, I have gotten a lot of results! I have found several thousand things that won’t work.”

Attributed - Thomas Edison
User avatar
nou nou
Registered User
Posts: 701
Joined: Sat Oct 29, 2016 8:08 pm

Re: Bots eating up all the bandwidth

Post by nou nou »

JLA wrote: Wed Sep 18, 2024 9:05 pm
supanet wrote: Mon Jul 01, 2024 3:16 pm
No need to pay Cloudfare or another third party. Just implement a set of logical checks in your board's code. Our phpbb2 board uses a multilayered security approach to stop most non-desireable traffic including the more recent deluge of AI harvesters. The same approach should be easy to implement on any phpbb3 board as well.
Care to share what you built? If that doesn't compromise anything.

Return to “General Discussion”