also not sure about Facebook and Apple, if there can be some drawback but probably not.Bots eating up all the bandwidth
Forum rules
General Discussion is a bonus forum for discussion of non-phpBB related topics with other phpBB.com users. All site rules apply.
General Discussion is a bonus forum for discussion of non-phpBB related topics with other phpBB.com users. All site rules apply.
-
fuolo
- Registered User
- Posts: 4
- Joined: Sun Aug 04, 2024 6:51 pm
Re: Bots eating up all the bandwidth
There is Baidu and Yandex in the list, which are also search engines and competitors of Google, relying on Google too much can backfire, but if someone doesn't want russian speaking and chinese speaking traffic then I guess it is fine also not sure about Facebook and Apple, if there can be some drawback but probably not.
also not sure about Facebook and Apple, if there can be some drawback but probably not.-
[Dimetrodon]
- Registered User
- Posts: 462
- Joined: Tue Aug 30, 2022 3:29 am
- Location: Paleozoic Era
Re: Bots eating up all the bandwidth
Yeah, I am not sure if foreign search engines need to be blocked.
SEO companies, sure, but not actual search engines.
SEO companies, sure, but not actual search engines.
-
JLA
- Registered User
- Posts: 618
- Joined: Tue Nov 16, 2004 5:23 pm
- Location: USA
- Name: JLA FORUMS
Re: Bots eating up all the bandwidth
No need to pay Cloudfare or another third party. Just implement a set of logical checks in your board's code. Our phpbb2 board uses a multilayered security approach to stop most non-desireable traffic including the more recent deluge of AI harvesters. The same approach should be easy to implement on any phpbb3 board as well.
-
JLA
- Registered User
- Posts: 618
- Joined: Tue Nov 16, 2004 5:23 pm
- Location: USA
- Name: JLA FORUMS
Re: Bots eating up all the bandwidth
Another note, the facebookexternalhit and other similar meta useragents coming from Facebook IPs in the USA and Europe are bots from META stealing your content to feed there new AI engine. Best to block them or at the least only serve them the bare necessary data that is needed for Facebook shares as blocking will also prevent Facebook sharing. There are all tied into the same bots.
-
thecoalman
- Community Team Member
- Posts: 6291
- Joined: Wed Dec 22, 2004 3:52 am
- Location: Pennsylvania, U.S.A.
Re: Bots eating up all the bandwidth
The free Cloudflare plan is actually quite good. They give you most of the main features but they will limit them, e.g. I think you only get 5 custom firewall rules with the free plan but that's all I'm using with the paid plan.There is lot more they offer than just improved security, it's also provide performance.
If you wanted to take the time you can actually integrate a lot of things into phpBB, e.g. there is custom header for country of origin. You could add column for that anywhere the IP is recorded.
“Results! Why, man, I have gotten a lot of results! I have found several thousand things that won’t work.”
Attributed - Thomas Edison
Attributed - Thomas Edison
-
nou nou
- Registered User
- Posts: 676
- Joined: Sat Oct 29, 2016 8:08 pm
Re: Bots eating up all the bandwidth
Care to share what you built? If that doesn't compromise anything.JLA wrote: ↑Wed Sep 18, 2024 9:05 pmNo need to pay Cloudfare or another third party. Just implement a set of logical checks in your board's code. Our phpbb2 board uses a multilayered security approach to stop most non-desireable traffic including the more recent deluge of AI harvesters. The same approach should be easy to implement on any phpbb3 board as well.