Spiders & bots to add to phpBB

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Scam Warning
User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel » Sat Jan 11, 2014 4:26 pm

Bot name: Searchmetrics [Bot]
Agent match: SearchmetricsBot
User agent string: Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
Website: http://www.searchmetrics.com/en/searchmetrics-bot/

Bot name: Falcons [Bot]
Agent match: Falconsbot
User agent string: Mozilla/5.0 (compatible; Falconsbot; +http://ws.nju.edu.cn/falcons/)
Website: http://ws.nju.edu.cn/falcons/

Bot name: Pinterest [Bot]
Agent match: Pinterest
User agent string: Pinterest/0.1 +http://pinterest.com/
Website: http://www.pinterest.com/

PHIDIAS
Registered User
Posts: 6
Joined: Thu Aug 21, 2014 2:19 pm

Re: Spiders & bots to add to phpBB

Post by PHIDIAS » Sat Sep 06, 2014 10:01 am

BOTS
THIS IS A LIST OF BOTS.

User avatar
AmigoJack
Registered User
Posts: 5659
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Spiders & bots to add to phpBB

Post by AmigoJack » Mon Sep 08, 2014 6:29 am

Scooter (Altavista) does not exist for ages anymore and the useragent is written in human-interpretable style (instead of i.e. PCRE). What are the reasons you're suggesting this?
The worst thing about censorship is ███████████
Affin wrote:
Tue Nov 20, 2018 9:51 am
The problem is probably not my English but you do not want to understand correctly.
...
We will not come anybody anyway, nevertheless, it's best to shit this.

Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA » Tue Sep 09, 2014 2:52 am

PHIDIAS wrote:Bots
This is a list of bots.
NOTE: Changed text case.

There are plenty of lists of bots. My manage_bots has more than that list does, but if you find any in that list that aren't in manage_bots, please post them in the "usual" format here.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.

peyman974
Registered User
Posts: 20
Joined: Tue Sep 18, 2012 11:58 pm

Re: Spiders & bots to add to phpBB

Post by peyman974 » Thu Oct 16, 2014 1:00 am

Bot name: hivaBot [Bot]
Agent match: Iranian Search Engine bot
User agent string: hivaBot/hivaBot-1.0 (Iranian Search Engine bot; http://gorgor.ir; info@gorgor.ir)
Website: http://gorgor.ir

ip : 2.187.253.17

User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel » Sat Nov 22, 2014 2:22 pm

Bot name: XoviBot [Bot]
Agent match: XoviBot
User agent string: Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
Website: http://www.xovibot.net/

/Marcus

User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel » Mon Dec 01, 2014 7:44 pm

Bot name: QuickiWiki [Bot]
Agent match: QuickiWiki
User agent string: QuickiWiki/1.0 (http://www.quickiwiki.com; admin@quickiwiki.com) BasedOnNodeJs/0.10.23
Website: http://www.quickiwiki.com

Bot name: Shareaholic [Bot]
Agent match: shareaholic
User agent string (1): Mozilla/5.0 (compatible; Shareaholicbot/1.0; +http://www.shareaholic.com/bot)
User agent string (2): shareaholic-bot
Website: http://www.shareaholic.com/bot

/Marcus

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4121
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Tue Jan 13, 2015 10:39 am

Hi Steve.

Following on from my PM, I have attached the error I am getting when I try to run manage_bots.php on my 3.1.2 test forum
screenshot_758.jpg
Any ideas?

User avatar
AmigoJack
Registered User
Posts: 5659
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Spiders & bots to add to phpBB

Post by AmigoJack » Tue Jan 13, 2015 5:04 pm

HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
The worst thing about censorship is ███████████
Affin wrote:
Tue Nov 20, 2018 9:51 am
The problem is probably not my English but you do not want to understand correctly.
...
We will not come anybody anyway, nevertheless, it's best to shit this.

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4121
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Tue Jan 13, 2015 5:56 pm

AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
I'd more of less assumed that, but hopefully there will be a way to make it 3.1.x compatible.

Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA » Wed Jan 14, 2015 3:35 am

AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
True, but I asked him to post the error here. Asking for a 3.1 version of manage_bots seems perfectly reasonable in this topic.

Anyway, from the screen capture, it looks like I need to replace a $_SERVER reference with request_vars. I'd have to look at the code, but I seem to recall that I had a reason why I didn't use request_vars (possibly because it returned a default value that I didn't want?).

However, as long as the User, Groups and Bots tables didn't change in an incompatible way, I could probably make the script support both 3.0 and 3.1.

Another issue is that they changed the default bot list somewhere (3.0.12?), so I'd have to update the script to handle that, too.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.

User avatar
Steve
Registered User
Posts: 1024
Joined: Tue Apr 07, 2009 7:48 pm
Location: UK ,up north!!
Name: Steven Clark
Contact:

Re: Spiders & bots to add to phpBB

Post by Steve » Wed Jan 14, 2015 9:35 am

This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha

[The extension zip has been deactivated and can no longer be displayed.]


User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4121
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Wed Jan 14, 2015 11:04 am

Thanks. That works perfectly

User avatar
KhurramMunawar
Registered User
Posts: 534
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar » Sat Jan 17, 2015 2:22 pm

HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
My forum:
DearHelper.org
Get Free Traffic To Your Website
Trafficonic.com - Free Traffic To Your Website

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 4121
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Sat Jan 17, 2015 3:58 pm

Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done

Post Reply

Return to “phpBB Discussion”