Beware 80.237.140.233
80.237.140.233 gobbled up 60 megabytes from annelisabeth.com during December. He loaded specific pages over and over, then moved on to other pages. He shows up as proxy77.net in Awstats.
User agent:
Mozilla/5.0 (Windows; U; Windows NT 5.1; ru-RU; rv:1.7.5) Gecko/20041108 Firefox/1.0
The IP number itself is a proxy from Germany.
My conjecture is that the spidering is done by a referrer spammer who’s particularly hungry. So hungry he’s stopped doing GET requests the last day or so. He’s switched to HEAD!
He’s using proxies for the actual referrer spamming, but keeps using that exact same user agent. I’ve seen him here too.
Another to watch out for is
216.220.192.132
Who identifies itself as
NutchCVS/0.7 (Experimental Nutch)
It gobbled up 30 MB of spamhuntress.com so far in December. That software is used for running search engine spiders. Problem is, this particular one isn’t identifying itself. If any of you knows anything about this one, please let me know.