Spiders & bots to add to phpBB

Do not post support requests, bug reports or feature requests. Discuss phpBB here. Non-phpBB related discussion goes in General Discussion!
Ideas Centre
User avatar
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA » Thu Feb 12, 2015 10:19 pm

Puchahawa wrote:Has anyone seen this (bot?) wandering their boards? Microsoft URL Control - 6.00.8169

Googled it and found this bit and this on the bugger. looks like a spammer bot

[...]

Can I add this to the bot list then ban the user?
It appears that you can ban bots individually, but I haven't tested that it works.

Instead of banning bots individually, though, you might consider creating a "Bad Bots" group and giving them Never permissions for everything. They would still be able to access your board, but they wouldn't see anything.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.

User avatar
Puchahawa
Registered User
Posts: 764
Joined: Sat Jan 01, 2011 10:33 pm
Location: SW Oregon
Name: Randy
Contact:

Re: Spiders & bots to add to phpBB

Post by Puchahawa » Thu Feb 12, 2015 10:28 pm

That would be a good Idea Steve thanks! Know of any other bad bots to add to the list?

Would it be the right choice to change their default group to the bad bot group after they are added, or would it make more sense to remove them from the bot group?

User avatar
Pony99CA
Registered User
Posts: 4783
Joined: Thu Sep 30, 2004 3:13 pm
Location: Hollister, CA
Name: Steve
Contact:

Re: Spiders & bots to add to phpBB

Post by Pony99CA » Fri Feb 13, 2015 3:14 am

Puchahawa wrote:That would be a good Idea Steve thanks! Know of any other bad bots to add to the list?
Check the manage_bots code.
Puchahawa wrote: Would it be the right choice to change their default group to the bad bot group after they are added, or would it make more sense to remove them from the bot group?
You could certainly make the default group "Bad Bots". I don't know about removing them from the Bots group, though. I presume that wouldn't break their bot status, but I don't see a good reason to do it -- they are still bots, after all.

Steve
Silicon Valley Pocket PC (http://www.svpocketpc.com)
Creator of manage_bots and spoof_user (ask me)
Need hosting for a small forum with full cPanel & MySQL access? Contact me or PM me.

User avatar
Puchahawa
Registered User
Posts: 764
Joined: Sat Jan 01, 2011 10:33 pm
Location: SW Oregon
Name: Randy
Contact:

Re: Spiders & bots to add to phpBB

Post by Puchahawa » Tue Mar 17, 2015 10:36 pm

Bot name: MAARJS
Agent match: ; MAARJS
Information on the bot: https://www.aqtronix.com/useragents/?Ac ... ame=MAARJS

Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; WOW64; Trident/6.0; MAARJS)

User avatar
AmigoJack
Registered User
Posts: 4888
Joined: Tue Jun 15, 2010 11:33 am
Location: グリーン ヒル ゾーン
Contact:

Re: Spiders & bots to add to phpBB

Post by AmigoJack » Wed Mar 18, 2015 7:05 am

Puchahawa wrote:MAARJS
That's no bot, of course. Why should it identify as Internet Explorer and only a component of it as "bot"? It's just an OEM ID for Acer devices.
The worst thing about censorship is ███████████

User avatar
Puchahawa
Registered User
Posts: 764
Joined: Sat Jan 01, 2011 10:33 pm
Location: SW Oregon
Name: Randy
Contact:

Re: Spiders & bots to add to phpBB

Post by Puchahawa » Wed Mar 18, 2015 4:57 pm

Ok sorry, Just looked at the link and it had the components for a bot. :shock:

messikecil
Registered User
Posts: 115
Joined: Fri Oct 24, 2014 11:42 pm

Re: Spiders & bots to add to phpBB

Post by messikecil » Sat Oct 17, 2015 4:34 pm

what is the fuction of bots and how to add it???

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2150
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Sat Oct 17, 2015 4:41 pm

Bots are the indexing engines that Google and others use so that your forums posts can be searched for on line.

There are default BOTs with the install of phpBB, but you can add more (if you so wish) by using the script I have on my site.

messikecil
Registered User
Posts: 115
Joined: Fri Oct 24, 2014 11:42 pm

Re: Spiders & bots to add to phpBB

Post by messikecil » Sat Oct 17, 2015 10:52 pm

HiFiKabin wrote:Bots are the indexing engines that Google and others use so that your forums posts can be searched for on line.

There are default BOTs with the install of phpBB, but you can add more (if you so wish) by using the script I have on my site.
ok, i want it. thanks

drumchannell
Registered User
Posts: 1
Joined: Thu Nov 20, 2014 6:30 am
Contact:

Re: Spiders & bots to add to phpBB

Post by drumchannell » Tue Nov 03, 2015 5:32 pm

I hope this helps since I didn't see this bot listed in this discussion.

Bot name: Digincore bot
Agent match: Digincore bot
Tribulation Today
Tribulation Today is your source for Prophecy News Updates, Discussion Forums, Blogs and End Time Bible Studies. Are you ready for Jesus Christ?

FishH2o
Registered User
Posts: 5
Joined: Tue Feb 23, 2016 3:40 am

Re: Spiders & bots to add to phpBB

Post by FishH2o » Tue Apr 19, 2016 3:48 pm

Does this script work correctly in 3.1.8?

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2150
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Tue Apr 19, 2016 4:31 pm

If you are referring to the script I posted, the answer is yes

FishH2o
Registered User
Posts: 5
Joined: Tue Feb 23, 2016 3:40 am

Re: Spiders & bots to add to phpBB

Post by FishH2o » Wed Apr 20, 2016 1:41 pm

I'm obviously doing something wrong :?

General Error
Illegal use of $_SERVER. You must use the request class or request_var() to access input data. Found in /home/XXXXXXX/public_html/manage_bots.php on line 455. This error message was generated by deactivated_super_global.

BACKTRACE

FILE: (not given by php)
LINE: (not given by php)
CALL: msg_handler()

FILE: [ROOT]/phpbb/request/deactivated_super_global.php
LINE: 67
CALL: trigger_error()

FILE: [ROOT]/phpbb/request/deactivated_super_global.php
LINE: 87
CALL: phpbb\request\deactivated_super_global->error()

FILE: [ROOT]/manage_bots.php
LINE: 455
CALL: phpbb\request\deactivated_super_global->offsetGet()

FishH2o
Registered User
Posts: 5
Joined: Tue Feb 23, 2016 3:40 am

Re: Spiders & bots to add to phpBB

Post by FishH2o » Wed Apr 20, 2016 5:09 pm

Pony99CA wrote:
AmigoJack wrote:
HiFiKabin wrote:Any ideas?
It is never stated anywhere, but that script was never intended to be run on 3.1.x, only on 3.0.x.
True, but I asked him to post the error here. Asking for a 3.1 version of manage_bots seems perfectly reasonable in this topic.

Anyway, from the screen capture, it looks like I need to replace a $_SERVER reference with request_vars. I'd have to look at the code, but I seem to recall that I had a reason why I didn't use request_vars (possibly because it returned a default value that I didn't want?).

However, as long as the User, Groups and Bots tables didn't change in an incompatible way, I could probably make the script support both 3.0 and 3.1.

Another issue is that they changed the default bot list somewhere (3.0.12?), so I'd have to update the script to handle that, too.

Steve

When I try this I get no out put at all just a blank screen.

User avatar
HiFiKabin
Community Team Member
Community Team Member
Posts: 2150
Joined: Wed May 14, 2014 9:10 am
Name: James
Contact:

Re: Spiders & bots to add to phpBB

Post by HiFiKabin » Wed Apr 20, 2016 5:13 pm

I have just tried it again on my test forum, and it works perfectly

Image

http://phpbb.hifikabin.me.uk/viewtopic.php?f=6&t=25

Post Reply

Return to “phpBB Discussion”

Who is online

Users browsing this forum: Bing [Bot], nhseacoast and 23 guests