Sadly I don't keep track of the full agent and when I've encountered them. All my contributions result from the simple fact I log every useragent and then analyze (and truncate) that log from time to time. I omit some of them, as they seem to occur very rarily. If I refer to re-encountering a bot please note that my most recent data is from 2012-05-20 only.
AmigoJack wrote:URL: http://swebot.net
This URL doesn't seem to work (at least not today). When did you see that bot?
Around 2012-03-29. Other mutations use the URL http://swebot-crawler.net
instead, which is by now also either parked or suspended. Haven't re-encountered that bot since then.
Pony99CA wrote:Why have spaces in the User Agents?
Primarily to avoid false positives - that's also the reason why I always use a trailing slash (proper product tokens have the format
as in RFC 2616
) as a word boundary. However, to also surely recognize those malformed useragents I used the blank/whitespace.
"Supybot " doesn't have a slash as name/version separator, but instead a blank.
Mozilla/5.0 (Compatible; Supybot 0.83.4.1)
" WASALive" does neither have a slash nor a version number, so my only word boundary is the leading blank. Didn't want to include
Bot as the owners might omit it in the future.
Mozilla/5.0 (compatible; WASALive Bot ; http://blog.wasalive.com/wasalive-bots/)
"Download Ninja " doesn't have a slash as name/version separator, but instead a blank.
Download Ninja 7.0
"Panopta " doesn't have a slash as name/version separator, but instead a blank - and the version precedes a
v as if it was meant for human reading. Didn't want to include
v to make it future-proof.
Pony99CA wrote:Supybot seems to be an IRC bot. Did you actually see this on a phpBB page
Definitly. And also re-encountered that bot at least 2012-05-14.
AmigoJack wrote:Name: Aitellu
This bot was already in the script, but with a different agent (Aitellu). When did you see it?
2012-01-17 and re-encountered it at least 2012-05-20. Didn't notice it was already in the list, sorry.
AmigoJack wrote:Name: URLDBCleaner
Do you have an IP address for this?
Sadly not anymore.
AmigoJack wrote:Name: SitesLikeIt
This domain seems to be parked. I've added it, but wonder if there's a better URL to list.
Encountered it 2011-10-08 and never again since then. We should both remove this entry.
AmigoJack wrote:Name: Plukkie
I'm going to call this Botje
Sure, why not.