Spiders & bots to add to phpBB

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Ideas Centre
User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel »

Bot name: Searchmetrics [Bot]
Agent match: SearchmetricsBot
User agent string: Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
Website: http://www.searchmetrics.com/en/searchmetrics-bot/

Bot name: Falcons [Bot]
Agent match: Falconsbot
User agent string: Mozilla/5.0 (compatible; Falconsbot; +http://ws.nju.edu.cn/falcons/)
Website: http://ws.nju.edu.cn/falcons/

Bot name: Pinterest [Bot]
Agent match: Pinterest
User agent string: Pinterest/0.1 +http://pinterest.com/
Website: http://www.pinterest.com/
PHIDIAS
Registered User
Posts: 6
Joined: Thu Aug 21, 2014 2:19 pm

Re: Spiders & bots to add to phpBB

Post by PHIDIAS »

BOTS
THIS IS A LIST OF BOTS.
User avatar
AmigoJack
Registered User
Posts: 6106
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Spiders & bots to add to phpBB

Post by AmigoJack »

Scooter (Altavista) does not exist for ages anymore and the useragent is written in human-interpretable style (instead of i.e. PCRE). What are the reasons you're suggesting this?
  • "The problem is probably not my English but you do not want to understand correctly. ... We will not come anybody anyway, nevertheless, it's best to shit this." Affin, 2018-11-20
  • "But this shit is not here for you. You can follow with your. Maybe the question, instead, was for you, who know, so you shoved us how you are." axe70, 2020-10-10
  • "My reaction is not to everyone, especially to you." Raptiye, 2021-02-28
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA »

PHIDIAS wrote:Bots
This is a list of bots.
NOTE: Changed text case.

There are plenty of lists of bots. My manage_bots has more than that list does, but if you find any in that list that aren't in manage_bots, please post them in the "usual" format here.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.
peyman974
Registered User
Posts: 54
Joined: Tue Sep 18, 2012 11:58 pm

Re: Spiders & bots to add to phpBB

Post by peyman974 »

Bot name: hivaBot [Bot]
Agent match: Iranian Search Engine bot
User agent string: hivaBot/hivaBot-1.0 (Iranian Search Engine bot; http://gorgor.ir; [email protected])
Website: http://gorgor.ir

ip : 2.187.253.17
User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel »

Bot name: XoviBot [Bot]
Agent match: XoviBot
User agent string: Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
Website: http://www.xovibot.net/

/Marcus
User avatar
Marcus Wendel
Registered User
Posts: 534
Joined: Sun Mar 10, 2002 5:58 pm
Location: Sweden
Contact:

Re: Spiders & bots to add to phpBB

Post by Marcus Wendel »

Bot name: QuickiWiki [Bot]
Agent match: QuickiWiki
User agent string: QuickiWiki/1.0 (http://www.quickiwiki.com; [email protected]) BasedOnNodeJs/0.10.23
Website: http://www.quickiwiki.com

Bot name: Shareaholic [Bot]
Agent match: shareaholic
User agent string (1): Mozilla/5.0 (compatible; Shareaholicbot/1.0; +http://www.shareaholic.com/bot)
User agent string (2): shareaholic-bot
Website: http://www.shareaholic.com/bot

/Marcus
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6669
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

Hi Steve.

Following on from my PM, I have attached the error I am getting when I try to run manage_bots.php on my 3.1.2 test forum
screenshot_758.jpg
Any ideas?
User avatar
AmigoJack
Registered User
Posts: 6106
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Spiders & bots to add to phpBB

Post by AmigoJack »

HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
  • "The problem is probably not my English but you do not want to understand correctly. ... We will not come anybody anyway, nevertheless, it's best to shit this." Affin, 2018-11-20
  • "But this shit is not here for you. You can follow with your. Maybe the question, instead, was for you, who know, so you shoved us how you are." axe70, 2020-10-10
  • "My reaction is not to everyone, especially to you." Raptiye, 2021-02-28
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6669
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
I'd more of less assumed that, but hopefully there will be a way to make it 3.1.x compatible.
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA »

AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
True, but I asked him to post the error here. Asking for a 3.1 version of manage_bots seems perfectly reasonable in this topic.

Anyway, from the screen capture, it looks like I need to replace a $_SERVER reference with request_vars. I'd have to look at the code, but I seem to recall that I had a reason why I didn't use request_vars (possibly because it returned a default value that I didn't want?).

However, as long as the User, Groups and Bots tables didn't change in an incompatible way, I could probably make the script support both 3.0 and 3.1.

Another issue is that they changed the default bot list somewhere (3.0.12?), so I'd have to update the script to handle that, too.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.
User avatar
Steve
Registered User
Posts: 1480
Joined: Tue Apr 07, 2009 7:48 pm
Name: Steven Clark
Contact:

Re: Spiders & bots to add to phpBB

Post by Steve »

This works removed user_webiste as no longer exist in the users table its now in profile fields table. Needs a lot of work this file its a bit messy, ive made it a little more messy haha
manage_bots.zip
@ The Chief Medical Officers guideline for men is that: You are safest not to drink regularly more than 14 units per week.
- I drank that today++ :lol: 🍺
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6669
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

Thanks. That works perfectly
User avatar
KhurramMunawar
Registered User
Posts: 534
Joined: Tue Mar 25, 2014 2:20 am
Location: Islamabad, Pakistan
Name: Khurram Munawar
Contact:

Re: Spiders & bots to add to phpBB

Post by KhurramMunawar »

HiFiKabin wrote:Thanks. That works perfectly
how to use this file.
Get Free Traffic To Your Website
Trafficonic.com - Free Traffic To Your Website
User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 6669
Joined: Wed May 14, 2014 9:10 am
Location: Swearing at the PC, UK
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin »

Unzip the file, upload it to the forum root (where config.php is) and go to www.yourforum.com/manage_bots.phpand let the file run.

Then delete manage_bots.php from the server as its work is done
Post Reply

Return to “phpBB Discussion”