Page 55 of 61

Re: Spiders & bots to add to phpBB

Posted: Mon Apr 08, 2013 11:49 pm
by Pony99CA
techman41973 wrote:I appreciate all of the work that went into these lists and script.
But can anyone explain the advantages of adding this long list of new bots to my phpbb site?
Have all or most of these bots been tested to be beneficial in some way?
I'm not sure how a bot (if perhaps it was a spam bot) could negatively effect my site.
The advantage is that Bots get put into the correct group (and therefore get the correct permissions). Bots not in the Bots list get treated as Guests, which means they see Register and Log-In links, etc.

Steve

Re: Spiders & bots to add to phpBB

Posted: Thu May 02, 2013 11:09 am
by @Marcin
IP: 65.52.0.135
NewsGatorOnline/2.0 - http://www.newsgator.com

Re: Spiders & bots to add to phpBB

Posted: Tue Jun 04, 2013 5:25 pm
by JRD
Bot name: uMBot-LN/1.0 [Bot]
Agent match: uMBot-LN
Information on the bot: www.ubermetrics-technologies.com

Bot name: ProCogSEOBot/1.0
Agent match: ProCogSEOBot
Information on the bot: www.procog.com

Re: Spiders & bots to add to phpBB

Posted: Sun Jul 28, 2013 2:42 pm
by Schwpz
Bot name: BLEXBot/1.0 [Bot]
Agent match: BLEXBot
Information on the bot: http://webmeup.com/crawler.html


Bot name: A6-Indexer/1.0 [Bot]
Agent match: A6-Indexer
Information on the bot: http://www.a6corp.com/a6-web-scraping-policy/

Re: Spiders & bots to add to phpBB

Posted: Mon Jul 29, 2013 12:53 am
by Danielx64
Q: Is Manage_Bots 5.5 the latest stable version?

Thank-you :)

Re: Spiders & bots to add to phpBB

Posted: Mon Jul 29, 2013 9:25 am
by Peter77sx
*Daniel wrote:Q: Is Manage_Bots 5.5 the latest stable version?

Thank-you :)
There is Manage_Bots 6.0 Beta Test I've not had any problems with it so far. ;)

Re: Spiders & bots to add to phpBB

Posted: Sun Aug 11, 2013 5:46 pm
by Marcus Wendel
Bot name: Easou [Bot]
Agent match: EasouSpider
User agent string: Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)
Website: http://www.easou.com

/Marcus

Re: Spiders & bots to add to phpBB

Posted: Fri Aug 16, 2013 3:02 pm
by Marcus Wendel
Bot name: Yunyun [Bot]
Agent match: YRSpider
User agent string: Mozilla/5.0 (compatible; YRSpider; +http://www.yunyun.com/SiteInfo.php?r=about)
Website: http://www.yunyun.com

Re: Spiders & bots to add to phpBB

Posted: Wed Aug 21, 2013 7:44 am
by Schwpz
Thanks Marcus!

Re: Spiders & bots to add to phpBB

Posted: Sat Aug 31, 2013 12:42 pm
by 5hocK
Bot name: BLEX [Bot]
Agent match: BLEXBot
User agent string: Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup.com/crawler.html)
Website: http://webmeup.com/crawler.html


Edit: Scrub that, searched for BLEX in this topic, found nothing; posted and then saw it a few posts up :P

Re: Spiders & bots to add to phpBB

Posted: Thu Sep 05, 2013 12:37 am
by Peter77sx
Bot Name: DuckDuckGo [Bot]
User Agent String:
DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)

website: https://duckduckgo.com/duckduckbot

Re: Spiders & bots to add to phpBB

Posted: Fri Sep 06, 2013 2:52 am
by Baraka
"Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)"

Not sure if this helps, only info i could see

Re: Spiders & bots to add to phpBB

Posted: Sun Sep 08, 2013 9:03 am
by Marcus Wendel
Bot name: ADmantX [Bot]
Agent match: ADmantX
User agent string: ADmantX Platform Semantic Analyzer - ADmantX Inc. - www.admantx.com - support@admantx.com
Website: http://www.admantx.com

/Marcus

Re: Spiders & bots to add to phpBB

Posted: Mon Sep 09, 2013 2:25 pm
by cangor
Thanks for this script and all people sharing their data!

Will there be an updated script to automatically insert all the bots from this thread or from http://phpbb-bots.blogspot.de/ into the phpbb-database? The last version I found seems to be older than a year:
viewtopic.php?f=64&t=935605&start=705#p13172802

Re: Spiders & bots to add to phpBB

Posted: Tue Sep 10, 2013 2:35 am
by Pony99CA
First, I'm glad you like the manage_bots script. Thanks. :)
cangor wrote: Will there be an updated script to automatically insert all the bots from this thread or from http://phpbb-bots.blogspot.de/ into the phpbb-database?
If you want the bots actually added to phpBB's official database, you'll have to take that up with the developers. I believe that Oleg made a post about that previously.

If you want them added to the script, why would I use that site? Nobody has ever mentioned it here before as far as I can recall and there are lots of lists of bots, so I'm not going to scan them all. If somebody wants a bot added to the script, they should post it here (in the format shown above, after ensuring that it's not already in the script).
cangor wrote: The last version I found seems to be older than a year
As I mentioned previously, I've been busy with other things. If I get some free time, I'll add the bots posted here since my last update to the script.

However, I've tried to make adding your own bots to the script fairly easy (if you can read PHP).

Steve