1 tivogirl Jul 06, 2009 17:01
3 tivogirl Jul 06, 2009 17:49
So far it's not enough to worry about, but figured someone here might have some details about it and whether it was worth blocking. Thanks for the info!
4 tblue Jul 06, 2009 19:00
You could also try to use "BLP_bbot" without the version number in your robots.txt.
if it's not in Google it doesn't exist :)
But if you're concerned this bot is consuming too much of your hard-earned bandwidth, first option is to block it via your /robots.txt:
OF course, if this is a truly bad-behaved bot, then it will ignore robots.txt. After that, you can try another solution.