Spiders & bots to add to phpBB

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Suggested Hosts
User avatar
KhurramMunawar
Registered User
Posts: 534
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar »

HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
Get Free Traffic To Your Website
Trafficonic.com - Free Traffic To Your Website
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

KhurramMunawar wrote:
HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
This one is
vectra-mods wrote:This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha
manage_bots.zip
The previous one by Pony99CA is not compatible with 3.1.x
User avatar
KhurramMunawar
Registered User
Posts: 534
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar »

HiFiKabin wrote:
KhurramMunawar wrote:
HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
This one is
vectra-mods wrote:This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha
manage_bots.zip
The previous one by Pony99CA is not compatible with 3.1.x


i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Get Free Traffic To Your Website
Trafficonic.com - Free Traffic To Your Website
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

KhurramMunawar wrote: i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Those bots were already on the bot list, so it can't add them again.

Have a look at your bot list in the ACP. I have 342 bots on mine. If yours is near that number, then its run OK and you can delete the file.
User avatar
KhurramMunawar
Registered User
Posts: 534
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar »

HiFiKabin wrote:
KhurramMunawar wrote: i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Those bots were already on the bot list, so it can't add them again.

Have a look at your bot list in the ACP. I have 342 bots on mine. If yours is near that number, then its run OK and you can delete the file.
thanks for your help.
job done.
Get Free Traffic To Your Website
Trafficonic.com - Free Traffic To Your Website
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

No problem, glad to have helped.
User avatar
frax
Registered User
Posts: 45
Joined: Thu Dec 11, 2014 4:10 pm
Location: Cosenza
Name: Frax C.
Contact:

Re: Spiders & bots to add to phpBB

Post by frax »

This?

162.243.228.61 » Whois
Mozilla/5.0 (compatible; spbot/4.4.2; +http://OpenLinkProfiler.org/bot )

Bot name (in my forum): OLP [Bot]
Agent match: spbot
Information on the bot: http://OpenLinkProfiler.org/bot

Bye.
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA »

KhurramMunawar wrote:
HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
Read the original manage_bots post:
To install and use manage_bots, please read the comments at the top of the script.
(I presume that Vectra-mods didn't remove the help from the file.)

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.
User avatar
Steve
Registered User
Posts: 1480
Joined: Tue Apr 07, 2009 7:48 pm
Name: Steven Clark
Contact:

Re: Spiders & bots to add to phpBB

Post by Steve »

Pony99CA wrote:
KhurramMunawar wrote:
HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
Read the original manage_bots post:
To install and use manage_bots, please read the comments at the top of the script.
(I presume that Vectra-mods didn't remove the help from the file.)

Steve
Only thing i done was remove unwanted code to make it function again...
@ The Chief Medical Officers guideline for men is that: You are safest not to drink regularly more than 14 units per week.
- I drank that today++ :lol: 🍺
User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel »

Bot name: SEMrush [Bot]
Agent match: SemrushBot
User agent string: Mozilla/5.0 (compatible; SemrushBot/0.98~bl; +http://www.semrush.com/bot.html)
Website: http://www.semrush.com/bot.html
User avatar
umarizal
Registered User
Posts: 177
Joined: Mon Mar 17, 2008 2:03 am
Location: São Paulo - SP - Brasil
Name: Leandro dos Santos
Contact:

Re: Spiders & bots to add to phpBB

Post by umarizal »

There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
EN: Do to others what you would want them to do to you.
ES: Haz a los demás todo lo que quieras que te hagan a ti.
PT: Faça aos outros o que você gostaria que fizessem a você.
User avatar
advocatus
Registered User
Posts: 290
Joined: Tue Aug 12, 2014 11:58 am
Location: Ontario, Canada.
Contact:

Re: Spiders & bots to add to phpBB

Post by advocatus »

umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Hi, I'm advocatus and I own www.forumgames.in.
User avatar
umarizal
Registered User
Posts: 177
Joined: Mon Mar 17, 2008 2:03 am
Location: São Paulo - SP - Brasil
Name: Leandro dos Santos
Contact:

Re: Spiders & bots to add to phpBB

Post by umarizal »

advocatus wrote:
umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Thank you very much. It is safe?
EN: Do to others what you would want them to do to you.
ES: Haz a los demás todo lo que quieras que te hagan a ti.
PT: Faça aos outros o que você gostaria que fizessem a você.
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6671
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

umarizal wrote:
advocatus wrote:
umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Thank you very much. It is safe?
Perfectly safe
User avatar
Puchahawa
Registered User
Posts: 769
Joined: Sat Jan 01, 2011 10:33 pm
Name: Randy

Re: Spiders & bots to add to phpBB

Post by Puchahawa »

Has anyone seen this (bot?) wandering their boards? Microsoft URL Control - 6.00.8169

Googled it and found this bit and this on the bugger. looks like a spammer bot

Then there is this:
Around the mid 1990s, we (Microsoft) shipped an ActiveX control called the Internet Transfer Control, which allowed developers to write programs to transfer files with FTP or HTTP.
[msdn.microsoft.com...]

Although this isn't documented in MSDN, the control always set the user-agent to "Microsoft URL Control" plus a version number. It was possible to change that, but it was quite a pain, so few did.

This actually caused some problems when people upgraded to the .NET Framework because the replacement API actually required a user-agent string, and some customers coudln't figure out what to put there. (Apparently some opted for the space character. Has anyone seen that in the real world?)

Of course there are plenty of old machines (and old software) still around. It is perfectly possible that a legitimate program is somehow doing this, but most of the traffic I see on the web suggests that the typical program that does this is an e-mail-address-stealing crawler. I'd guess that someone wrote one of these once upon a time and that lots of other people have simply copied and tweaked it since then.

You cannot block this with robots.txt; the code is older than the robots.txt specification, so the programmer would actually have to write extra code to read, parse, and respect robots.txt. That seems very, very unlikely. :-)

On the other hand, if you do go to extra trouble to block the user-agent, it won't be completely trivial for them to update their programs to work around it. A real programmer can do it, of course, but a script kiddie might be stymied. Like I said, we didn't make it easy to do, and there is no support for this now.

Hope that helps. Sorry to hear that someone is doing this to you.
Can I add this to the bot list then ban the user?
Post Reply

Return to “phpBB Discussion”