Page 57 of 61

Re: Spiders & bots to add to phpBB

Posted: Sat Jan 11, 2014 4:26 pm
by Marcus Wendel
Bot name: Searchmetrics [Bot]
Agent match: SearchmetricsBot
User agent string: Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
Website: http://www.searchmetrics.com/en/searchmetrics-bot/

Bot name: Falcons [Bot]
Agent match: Falconsbot
User agent string: Mozilla/5.0 (compatible; Falconsbot; +http://ws.nju.edu.cn/falcons/)
Website: http://ws.nju.edu.cn/falcons/

Bot name: Pinterest [Bot]
Agent match: Pinterest
User agent string: Pinterest/0.1 +http://pinterest.com/
Website: http://www.pinterest.com/

Re: Spiders & bots to add to phpBB

Posted: Sat Sep 06, 2014 10:01 am
by PHIDIAS
BOTS
THIS IS A LIST OF BOTS.

Re: Spiders & bots to add to phpBB

Posted: Mon Sep 08, 2014 6:29 am
by AmigoJack
Scooter (Altavista) does not exist for ages anymore and the useragent is written in human-interpretable style (instead of i.e. PCRE). What are the reasons you're suggesting this?

Re: Spiders & bots to add to phpBB

Posted: Tue Sep 09, 2014 2:52 am
by Pony99CA
PHIDIAS wrote:Bots
This is a list of bots.
NOTE: Changed text case.

There are plenty of lists of bots. My manage_bots has more than that list does, but if you find any in that list that aren't in manage_bots, please post them in the "usual" format here.

Steve

Re: Spiders & bots to add to phpBB

Posted: Thu Oct 16, 2014 1:00 am
by peyman974
Bot name: hivaBot [Bot]
Agent match: Iranian Search Engine bot
User agent string: hivaBot/hivaBot-1.0 (Iranian Search Engine bot; http://gorgor.ir; info@gorgor.ir)
Website: http://gorgor.ir

ip : 2.187.253.17

Re: Spiders & bots to add to phpBB

Posted: Sat Nov 22, 2014 2:22 pm
by Marcus Wendel
Bot name: XoviBot [Bot]
Agent match: XoviBot
User agent string: Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
Website: http://www.xovibot.net/

/Marcus

Re: Spiders & bots to add to phpBB

Posted: Mon Dec 01, 2014 7:44 pm
by Marcus Wendel
Bot name: QuickiWiki [Bot]
Agent match: QuickiWiki
User agent string: QuickiWiki/1.0 (http://www.quickiwiki.com; admin@quickiwiki.com) BasedOnNodeJs/0.10.23
Website: http://www.quickiwiki.com

Bot name: Shareaholic [Bot]
Agent match: shareaholic
User agent string (1): Mozilla/5.0 (compatible; Shareaholicbot/1.0; +http://www.shareaholic.com/bot)
User agent string (2): shareaholic-bot
Website: http://www.shareaholic.com/bot

/Marcus

Re: Spiders & bots to add to phpBB

Posted: Tue Jan 13, 2015 10:39 am
by HiFiKabin
Hi Steve.

Following on from my PM, I have attached the error I am getting when I try to run manage_bots.php on my 3.1.2 test forum
screenshot_758.jpg
Any ideas?

Re: Spiders & bots to add to phpBB

Posted: Tue Jan 13, 2015 5:04 pm
by AmigoJack
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.

Re: Spiders & bots to add to phpBB

Posted: Tue Jan 13, 2015 5:56 pm
by HiFiKabin
AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
I'd more of less assumed that, but hopefully there will be a way to make it 3.1.x compatible.

Re: Spiders & bots to add to phpBB

Posted: Wed Jan 14, 2015 3:35 am
by Pony99CA
AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
True, but I asked him to post the error here. Asking for a 3.1 version of manage_bots seems perfectly reasonable in this topic.

Anyway, from the screen capture, it looks like I need to replace a $_SERVER reference with request_vars. I'd have to look at the code, but I seem to recall that I had a reason why I didn't use request_vars (possibly because it returned a default value that I didn't want?).

However, as long as the User, Groups and Bots tables didn't change in an incompatible way, I could probably make the script support both 3.0 and 3.1.

Another issue is that they changed the default bot list somewhere (3.0.12?), so I'd have to update the script to handle that, too.

Steve

Re: Spiders & bots to add to phpBB

Posted: Wed Jan 14, 2015 9:35 am
by Steve
This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha

[The extension zip has been deactivated and can no longer be displayed.]


Re: Spiders & bots to add to phpBB

Posted: Wed Jan 14, 2015 11:04 am
by HiFiKabin
Thanks. That works perfectly

Re: Spiders & bots to add to phpBB

Posted: Sat Jan 17, 2015 2:22 pm
by KhurramMunawar
HiFiKabin wrote:Thanks. That works perfectly
how to use this file.

Re: Spiders & bots to add to phpBB

Posted: Sat Jan 17, 2015 3:58 pm
by HiFiKabin
Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done