[Xitami] Xitami has slowed to a crawl

[Jeff Hamblin]

>I think I'm finding the source of my slow downs. Crawlers and the worst
> right now is msn bot. But I'm also seeing Yahoo Slurp. Which normally I
> woudn't mind them indexing my websites but when it is affecting the server
> then it's a problem.


Try putting a "robots.txt" file in the root of your website with the 
following:

# robots.txt file to stop indexing of site
User-agent: *
Disallow: /