Dumb spiders
The whitebear address that’s redirecting to me after a spamrun - is banned by Google.
That doesn’t stop Googlebot from trying, and trying, the different URL’s on that domain that were spamvertized. They all meet a 404 on my site.
Both Yahoo’s and Google’s bots keep trying.
Blech…
March 20th, 2005 at 11:25 am
404 is a temporary failure. The Googlebot *should* try again if it encounters a 404.
410 means permanently gone. That’s the error code you presumably *meant* to return.
March 20th, 2005 at 12:05 pm
I don’t know of a way to return 410. I’ve never seen that in my logs.
Besides, it looks to me like the bots are following links. And since there are so many links (because of the spamrun), they’re following links over and over.