If two or more parallely access the board they'd always force a race condition for the session. Another downside is: you wouldn't get accurate "last visited" timestamps which should be inspected periodically to sort out deceased crawlers.Tomba wrote:one global feedfetcher bot
That makes no sense. manage_bots is a script, not a forum, and shouldn't affect what Google sees at all beyond the typical Bot vs. Guest permissions. If somebody is getting a 503, I doubt it's because of my script.kenax wrote:Jeepers, I'm really having problems getting your forum to run properly. It is giving a 503 server down error to googlbot and only seems to be allowing in magpie.
That also makes no sense. You shouldn't be doing anything with Anonymous. That's the Guest account that all guest users share, and you should never give that any Admin permissions. You're supposed to log in as an Admin and then add manage_bots,php to the end of the forum root. For example, if they ran the script here, it would bekenax wrote:I followed all the instructions but said that anonymous does not have permissions, even though I logged in correctly. Once logged in I simply add manage_bots.php to the address in the browser, right? I blocked access to the folder so that I can give full admin rights to user Anonymous, but now I'm receiving this message:
The user you are logged in as, Anonymous, is not an Administrator with Manage Bots permission
http://www.phpbb.com/manage_bots.php
.Why wouldn't it be. phpBB hasn't changed the layout of the Bot or User tables in any significant way that I'm aware of.kenax wrote:Also, this script seems to be from 2010. Is this bot script still applicable?
As mentioned above, manage_bots is just a script that runs along side your board. The changes that it makes to the database are basically the same as you would make through the ACP and it doesn't affect the phpBB code at all, so there's no reason to reinstall.kenax wrote:I wonder why bots can't access the forum.
If I were to reinstall the forum from scratch, which tables could I backup and restore in order to save all existing posts etc., usergroups and permissions?
Hi Steve, wonder if you can help regards the 5.5 script?Pony99CA wrote:manage_bots has been updated to version 5.5. manage_bots is basically version 4.0 of add_bots with the functions of delete_bots and list_bots merged in. This makes things simpler for me as I don't have to keep the bots tables in sync and simpler for you because there's only one script to worry about.
Steve
Most of the bots in the script are not meant to roam your site with bot forum privileges generally you want to ban or restrict these 'bad' bots from crawling your pages since they really contribute nothing other than take up bandwidth.Volksdevil wrote:...
EDIT: Just to add the below bot to your list which is absolutely hammering my forum.
Bot name:
BLEXBot [Crawler]
Agent match:
BLEXBot
User agent string:
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
Website:
http://webmeup-crawler.com
Code: Select all
Bot name: Trendictionbot [Bot]
Agent match: trendictionbot
User agent string: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search;
Website: http://www.trendiction.de/bot;
Have you tried using the Help command?Volksdevil wrote:Hi Steve, wonder if you can help regards the 5.5 script?Pony99CA wrote:manage_bots has been updated to version 5.5. manage_bots is basically version 4.0 of add_bots with the functions of delete_bots and list_bots merged in. This makes things simpler for me as I don't have to keep the bots tables in sync and simpler for you because there's only one script to worry about.
Obviously over time I've been manually adding/deleting bots. I recently deleted a few that I probably shouldn't have (All google bots for example) but I struggle to understand how toy use your script.
Can you explain in simple terms (For a simpleton) what I need to adjust in the php file to simply add/delete all the bots that are listed within it? I can upload the php file and call it with my browser no problem, just unsure on the setting to simply run it 'as is'.
http://www.example.com/phpbb/manage_bots.php??
That explains the syntax and meanings of the parameters.http://www.example.com/phpbb/manage_bots.php?operation=add&level=0
to add the phpBB default bots back or http://www.example.com/phpbb/manage_bots.php?operation=add&level=9999
to add all of the bots in the script back.manage_bots 6.0 (Beta) changes how the Level option works. Levels now represent the class of bots, not who reported the bots, so bad bots are classified with higher levels than good bots.Volksdevil wrote:Fair point, I just struggle to distinguish between good/bad bots. I did have many blocked via htaccess anyway, but the one above seems legit, but I may be wrong.
tweetmeme.com wrote:We're really proud of TweetMeme but all good things must come to an end. Thank you for your fantastic support over the past 3 years.
Thanks for the update, but it won't matter for my script because I keep the bots in the script for historical purposes. The Bots table will still show the last visit of the bot, obsolete or not, so they stay in the script.Ozo wrote:By the way, tweetmeme bot is obsolete and if you find it crawling your forum, it's probably a bad bot disguising as tweetmeme user agent.
tweetmeme.com wrote:We're really proud of TweetMeme but all good things must come to an end. Thank you for your fantastic support over the past 3 years.