Spiders & bots to add to phpBB

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Scam Warning
User avatar
KhurramMunawar
Registered User
Posts: 512
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar » Sat Jan 17, 2015 5:07 pm

HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
Image

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2156
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Sat Jan 17, 2015 5:15 pm

KhurramMunawar wrote:
HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
This one is
vectra-mods wrote:This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha
manage_bots.zip
The previous one by Pony99CA is not compatible with 3.1.x

User avatar
KhurramMunawar
Registered User
Posts: 512
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar » Sat Jan 17, 2015 5:28 pm

HiFiKabin wrote:
KhurramMunawar wrote:
HiFiKabin wrote:Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Thanks , Is it compatible with 3.1.2
This one is
vectra-mods wrote:This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha
manage_bots.zip
The previous one by Pony99CA is not compatible with 3.1.x


i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Image

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2156
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Sat Jan 17, 2015 5:49 pm

KhurramMunawar wrote: i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Those bots were already on the bot list, so it can't add them again.

Have a look at your bot list in the ACP. I have 342 bots on mine. If yours is near that number, then its run OK and you can delete the file.

User avatar
KhurramMunawar
Registered User
Posts: 512
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar » Sat Jan 17, 2015 5:51 pm

HiFiKabin wrote:
KhurramMunawar wrote: i have installed the bots. at the end i got the following report

Bot conflicts found: Ahrefs [Bot], Cuil [Bot], Ezooms [Bot], Seznam [Bot], Tweetmeme [Bot], Twitter [Bot], Yandex [Bot]

what to do now ??
Those bots were already on the bot list, so it can't add them again.

Have a look at your bot list in the ACP. I have 342 bots on mine. If yours is near that number, then its run OK and you can delete the file.
thanks for your help.
job done.
Image

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2156
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Sat Jan 17, 2015 5:51 pm

No problem, glad to have helped.

User avatar
frax
Registered User
Posts: 44
Joined: Thu Dec 11, 2014 4:10 pm
Location: Cosenza
Name: Frax C.
Contact:

Re: Spiders & bots to add to phpBB

Post by frax » Sun Jan 18, 2015 2:07 am

This?

162.243.228.61 » Whois
Mozilla/5.0 (compatible; spbot/4.4.2; +http://OpenLinkProfiler.org/bot )

Bot name (in my forum): OLP [Bot]
Agent match: spbot
Information on the bot: http://OpenLinkProfiler.org/bot

Bye.

User avatar
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA » Wed Jan 21, 2015 1:37 am

KhurramMunawar wrote:
HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
Read the original manage_bots post:
To install and use manage_bots, please read the comments at the top of the script.
(I presume that Vectra-mods didn't remove the help from the file.)

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.

User avatar
Steve
Registered User
Posts: 992
Joined: Tue Apr 07, 2009 7:48 pm
Location: UK ,up north!!
Name: Steven Clark
Contact:

Re: Spiders & bots to add to phpBB

Post by Steve » Wed Jan 21, 2015 9:29 am

Pony99CA wrote:
KhurramMunawar wrote:
HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
Read the original manage_bots post:
To install and use manage_bots, please read the comments at the top of the script.
(I presume that Vectra-mods didn't remove the help from the file.)

Steve
Only thing i done was remove unwanted code to make it function again...

User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel » Fri Jan 23, 2015 5:53 pm

Bot name: SEMrush [Bot]
Agent match: SemrushBot
User agent string: Mozilla/5.0 (compatible; SemrushBot/0.98~bl; +http://www.semrush.com/bot.html)
Website: http://www.semrush.com/bot.html

User avatar
umarizal
Registered User
Posts: 154
Joined: Mon Mar 17, 2008 2:03 am
Location: São Paulo - SP - Brasil
Name: Leandro dos Santos
Contact:

Re: Spiders & bots to add to phpBB

Post by umarizal » Fri Jan 30, 2015 8:17 pm

There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
EN: Do to others what you would want them to do to you.
ES: Haz a los demás todo lo que quieras que te hagan a ti.
PT: Faça aos outros o que você gostaria que fizessem a você.

User avatar
advocatus
Registered User
Posts: 290
Joined: Tue Aug 12, 2014 11:58 am
Location: Ontario, Canada.
Contact:

Re: Spiders & bots to add to phpBB

Post by advocatus » Fri Jan 30, 2015 8:38 pm

umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Hi, I'm advocatus and I own www.forumgames.in.

User avatar
umarizal
Registered User
Posts: 154
Joined: Mon Mar 17, 2008 2:03 am
Location: São Paulo - SP - Brasil
Name: Leandro dos Santos
Contact:

Re: Spiders & bots to add to phpBB

Post by umarizal » Fri Jan 30, 2015 8:48 pm

advocatus wrote:
umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Thank you very much. It is safe?
EN: Do to others what you would want them to do to you.
ES: Haz a los demás todo lo que quieras que te hagan a ti.
PT: Faça aos outros o que você gostaria que fizessem a você.

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2156
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Fri Jan 30, 2015 8:56 pm

umarizal wrote:
advocatus wrote:
umarizal wrote:There is a package with all the bots shared here to be added at once?

Oh, on the blog of first post, I can not see because I don´t have permission, it seems that I need an invitation.

Thank You!
Here is a script that you place into root that will add a significant number of Bots.
Thank you very much. It is safe?
Perfectly safe

User avatar
Puchahawa
Registered User
Posts: 764
Joined: Sat Jan 01, 2011 10:33 pm
Location: SW Oregon
Name: Randy
Contact:

Re: Spiders & bots to add to phpBB

Post by Puchahawa » Thu Feb 12, 2015 4:29 pm

Has anyone seen this (bot?) wandering their boards? Microsoft URL Control - 6.00.8169

Googled it and found this bit and this on the bugger. looks like a spammer bot

Then there is this:
Around the mid 1990s, we (Microsoft) shipped an ActiveX control called the Internet Transfer Control, which allowed developers to write programs to transfer files with FTP or HTTP.
[msdn.microsoft.com...]

Although this isn't documented in MSDN, the control always set the user-agent to "Microsoft URL Control" plus a version number. It was possible to change that, but it was quite a pain, so few did.

This actually caused some problems when people upgraded to the .NET Framework because the replacement API actually required a user-agent string, and some customers coudln't figure out what to put there. (Apparently some opted for the space character. Has anyone seen that in the real world?)

Of course there are plenty of old machines (and old software) still around. It is perfectly possible that a legitimate program is somehow doing this, but most of the traffic I see on the web suggests that the typical program that does this is an e-mail-address-stealing crawler. I'd guess that someone wrote one of these once upon a time and that lots of other people have simply copied and tweaked it since then.

You cannot block this with robots.txt; the code is older than the robots.txt specification, so the programmer would actually have to write extra code to read, parse, and respect robots.txt. That seems very, very unlikely. :-)

On the other hand, if you do go to extra trouble to block the user-agent, it won't be completely trivial for them to update their programs to work around it. A real programmer can do it, of course, but a script kiddie might be stymied. Like I said, we didn't make it easy to do, and there is no support for this now.

Hope that helps. Sorry to hear that someone is doing this to you.
Can I add this to the bot list then ban the user?

Post Reply

Return to “phpBB Discussion”

Who is online

Users browsing this forum: Elias, Yandex [Bot] and 15 guests