[Xitami] Avoiding Web Crawlers(?)

Marc Doigny xitami@lists.xitami.org
Tue, 02 Mar 2004 18:33:44 +0100


At 18:00 2/03/04, you wrote:
>Hello,
[text reduced]


Create a file in the root directory named: robots.txt and containing:

User-agent: *
Disallow: /



See http://www.robotstxt.org/wc/robots.html