1 tom_arush Sep 30, 2005 14:47
3 tom_arush Sep 30, 2005 16:46
Thanks for that - I'd already implmented a robots.txt, and have now blocked the specific IP's that gigabot uses in the htaccess file - that has at least allowed the server to remain online...
For now I've just removed the calendar from the template - and will probably take a look at the code myself over the weekend to see if I can stop it showing the "next month" link into the future. If I succeed I'll post here...
4 kwa Sep 30, 2005 16:52
tom_arush wrote:
For now I've just removed the calendar from the template - and will probably take a look at the code myself over the weekend to see if I can stop it showing the "next month" link into the future. If I succeed I'll post here...
That might solve your problem in a relatively easy way: why not adding a rel="nofollow" attribute to your calendar's a tags?
Try the hack described here:
[url=http://forums.b2evolution.net/viewtopic.php?t=4459]Search Engines Optimization (SEO)[/url][/list:u]It won't prevent search engines robots to crawl your calender until the fifthieth millenium, however, but it will prevent your useless blog's pages to be indexed. Usage of a robots.txt file at your root web directory should help you to reduce useless crawling, since a year can be considered as a folder. THat should help you a bit (this robots.txt file is based on mine):