[BETA] Display seachbot name

A place for MOD Authors to post and receive feedback on MODs still in development. No MODs within this forum should be used within a live environment! No new topics are allowed in this forum.
Forum rules
READ: phpBB.com Board-Wide Rules and Regulations

IMPORTANT: MOD Development Forum rules

On February 1, 2009 this forum will be set to read only as part of retiring of phpBB2.
Post Reply
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

[BETA] Display seachbot name

Post by ewelin »

MOD Title: Display Search Bot Name
MOD Description:This mod checks the IP address of your guest and if one of them is a Search Engine Bot it'll show which bot in the Users Online, Who is Online and the ACP.
MOD Version: 0.0.3

MOD Download: Download 0.0.3
MOD Last Update: Aug 03, 2006
Bot List Download: View this Topic to obtain the latest bots list.
Last Stable version: n/a

Demo Board: n/a
Demo Username: n/a
Demo Password: n/a

I've seen several bot mods but none that did exactly what I wanted. I just wanted a simple mod that would show the searchbot name when they were visiting the forum, so I created this mod. Whenever a guest visits your forum this mod checks a listing of IPs to see if it's a known Search Engine Bot. I used the Search Engine Spider IP Addresses site to compile the list of known bots. It'll then show the bot name in the who's online page, ACP and Who's Online section of the forum index. This mod should add only one additional SQL query.

Code: Select all

## MOD History: 
## 
##	 2006-08-03 - Version 0.0.3
##			- Removed SQL from install and put in a seperate file for easier updates 
##				to the SearchBots Table. Also 1500+ SQL commands were a bit too much for 
##				easyMOD to handle on some servers.
##			- added the class online_searchbots to each one for control of the text display
##			- moved the bots name into the language file.
##			- updated the ip comparision to allow for 2 wildcard fields ie - xxx.xxx.*.* 
##			- multiple bots now only appear in the Index page's Who's Online list once
##				with the number following displaying how many are actually online.
##			- Added a field to the DB to distinquish between user added bots and bots 
##				added via the install script. (mainly for future expansion & DB updates)
##
##   2005-09-26 - Version 0.0.2 
##      - optimized sql queries in viewonline.php & page_header.php
##
##   2005-09-26 - Version 0.0.1
##      - Initial Release
I have setup a reminder for me to released an updated yyyy-mm-dd_bots.php during the first week of each month. Down the line there may be an ACP interface which will download this file automatically and update your searchbots table. In the mean time it'll be a manual process.

If you wish to change the text formatting of the Search Bots name simply add the follow to your css file or overall header if you are not using a style sheet. Simply replace {your formatting} with your formatting.

Code: Select all

.online_searchbot {
  {your formatting}
}
Last edited by ewelin on Sat Dec 02, 2006 4:38 am, edited 10 times in total.
User avatar
3Di
Former Team Member
Posts: 15665
Joined: Mon Apr 04, 2005 11:09 pm
Location: Milan (IT) Frankfurt (DE)
Name: Marco
Contact:

Post by 3Di »

Interesting, i'll check that deepen tomorrow.

Thanks
Please PM me only to request paid works. Thx.
Want to compensate me for my interest? Donate
My development's activity º PhpStorm's proud user
Extensions, Scripts, MOD porting, Update/Upgrades
:studio_microphone: Looking for a specific feature or alternative option?
User avatar
*=Matt=*
Registered User
Posts: 389
Joined: Mon Dec 20, 2004 11:56 pm
Location: Oakdale, Wisconsin

Post by *=Matt=* »

ill test it
deny
Registered User
Posts: 565
Joined: Wed May 14, 2003 9:14 am
Location: Find-Ip-Address.org
Contact:

Post by deny »

It looks promising.Check this to compare of you have included all ip's:

http://www.iplists.com/nw/
http://www.ihategoogle.org/?sectionid=6
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

deny wrote: It looks promising.Check this to compare of you have included all ip's:

http://www.iplists.com/nw/
http://www.ihategoogle.org/?sectionid=6


actually those are the two sites i used to get the ip list. i haven't updated it since i created the mod, about 3 weeks ago.... but i do plan on trying to release updates about every month with the new search bots. Within the mod i have listed when each bot list was last updated.... i am copying that here

Code: Select all

##    All of the IPs have been collect from http://www.iplists.com/nw/. The last revision
##    dates are as follows:
##      MSN --------------- 08-Aug-2005 10:56:39 EDT
##      Alta Vista -------- 04-Aug-2004 09:56:36 EDT
##      Lycos ------------- 01-Mar-2004 11:42:23 EST
##      Inktomi ----------- 01-Sep-2005 11:09:22 EDT
##      WiseNut ----------- 08-Mar-2004 17:39:28 EST
##      Google ------------ 26-Jun-2005 14:27:45 EDT
##      Ask Jeeves/Teoma -- 01-Jul-2005 14:53:36 EDT
deny
Registered User
Posts: 565
Joined: Wed May 14, 2003 9:14 am
Location: Find-Ip-Address.org
Contact:

Post by deny »

Sorry i didn't noticed that you have already included these 2 sites.
Keep up good job :D
Geolocation of any IP address including detection of hostname,
browser, country and country code with ip address range web tool.

IP Address Locator | Email Tracking | IP Address | Check Email
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

sokay. that was the most complete listing of bots i could find so it's what i used. Just have to make sure to try and collect the updated bot ips once a month so the list stays up to date.
deny
Registered User
Posts: 565
Joined: Wed May 14, 2003 9:14 am
Location: Find-Ip-Address.org
Contact:

Post by deny »

There is needed to optimizing tables.Actually this mod added to any board
18 SQL queries extra. 8O
It is not good at all.If you have high traffic it could slow down your board a lot.
I've installed and again uninstalled until you optimize sql queries.18 sql queries to the index is a too much.\
Before installing of this mod 15 sql queries and after i did installed this mod 33 sql query.A lot!!
Geolocation of any IP address including detection of hostname,
browser, country and country code with ip address range web tool.

IP Address Locator | Email Tracking | IP Address | Check Email
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

how many users were online at the time of this. I have it running on a couple of sites and never noticed that high of a jump in queries. I believe it only added one additional db query on the site i admin. I'll definitly keep an eye on it though.

ETA - I believe it'll add a query for each guest online. As if there is a guest online it has to check to see if its a bot or not. No other real way of checking
da_badtz_one
Registered User
Posts: 376
Joined: Thu Jan 29, 2004 8:25 pm

Post by da_badtz_one »

Why don't you make the script query a txt file with all of these ips loaded into it? It would lose a few queries, but adding only a few wouldn't matter. The amount of server load or how well the website performs is normally analysed if the server is well tweaked or not. Only a site with over 400users online +- will need complete optimization. :roll:
deny
Registered User
Posts: 565
Joined: Wed May 14, 2003 9:14 am
Location: Find-Ip-Address.org
Contact:

Post by deny »

ewelin wrote: how many users were online at the time of this. I have it running on a couple of sites and never noticed that high of a jump in queries. I believe it only added one additional db query on the site i admin. I'll definitly keep an eye on it though.

ETA - I believe it'll add a query for each guest online. As if there is a guest online it has to check to see if its a bot or not. No other real way of checking


I didn't pay attention tp number of users of guest online.Usually i have all time between 5 and 25 guest or member online.If the queries raising with number of guest online then is again mod not recommended for higher traffic board.Imagine board that have al ltime around 50 to 100 guest or member then should queries rise to above 100 8O
The point is still that you need to make optimalization of this mod.
I did expected 1 or 2 extra queries but such a rapidly raising of queries is not acceptable.
I can remember right now when people got a lot problem with another mod "colur group mod"from Nivisec (old version).
It was not very well coded in point sql queries and with number of members online start to raise and number of query.
He did it good now with his mod but just note to you.
It is really good mod but we really need optimalization of this mod.

btw

I do not want to compare mod but for example this mod does not sql queries at all:
http://www.phpbb.com/phpBB/viewtopic.ph ... highlight=
I hope that you understand that this mod for high traffic board where somes you can have and 100 guest online is not recommended.
Geolocation of any IP address including detection of hostname,
browser, country and country code with ip address range web tool.

IP Address Locator | Email Tracking | IP Address | Check Email
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

Deny,

I get what you are saying and i'll have to do some figuring out on how to remove the query on every guest. Honestly it wasn't something i thought about when creating the mod. I was just hoping to create a mod that would use a complete list of bot ips.
deny wrote: I do not want to compare mod but for example this mod does not sql queries at all:
http://www.phpbb.com/phpBB/viewtopic.ph ... highlight=
I hope that you understand that this mod for high traffic board where somes you can have and 100 guest online is not recommended.

Actually this mod was the inspiration for mine. I noted that this mod only noticed a few of the search bots because it relied on an algorithm to see if it was a bot or not. And i think that algorithm would only catch maybe 10% of the bots out there.
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

mod updated see first post for download link which includes an upgrade shim

Code: Select all

## MOD History: 
## 
##   2005-09-26 - Version 0.0.2 
##      - optimized sql queries in viewonline.php & page_header.php
deny
Registered User
Posts: 565
Joined: Wed May 14, 2003 9:14 am
Location: Find-Ip-Address.org
Contact:

Post by deny »

I have problem with my pc and i'm not able at this moment to test it.Probably by end of this week i'll test it when i got again back my pc and let you know.
Geolocation of any IP address including detection of hostname,
browser, country and country code with ip address range web tool.

IP Address Locator | Email Tracking | IP Address | Check Email
User avatar
ewelin
Registered User
Posts: 262
Joined: Fri May 21, 2004 2:13 pm
Location: MA, USA
Contact:

Post by ewelin »

no problemo.... let me know how it works out. I don't get too many guest on my forum so it's hard to tell but as far as i could see there should only be the one additional sql query.
Post Reply

Return to “[2.0.x] MODs in Development”