[Xitami] Avoiding Web Crawlers(?)

[Thomas J. Hruska]

At 06:33 PM 3/2/2004 +0100, Marc Doigny writeth:
>At 18:00 2/03/04, you wrote:
>>Hello,
>[text reduced]
>
>
>Create a file in the root directory named: robots.txt and containing:
>
>User-agent: *
>Disallow: /

Or generate the site using JavaScript.  Spiders can't follow
JavaScript-only sites (neither can JavaScript-disabled browsers).

Hope this helps!


          Thomas J. Hruska -- shinelight@shininglightpro.com
Shining Light Productions -- "Meeting the needs of fellow programmers"
                     http://www.slproweb.com/

`'*-~.,_,.~-*'`'*-~.,_,.~-*'`'*-~.,_,.~-*'`'*-~.,_,.~-*'`'*-~.,_,.~-*'`'*-~
  Tired of programming languages that are expensive or difficult to use?
  Try Nuclear Vision today!

  http://www.slproweb.com/products/nvml.html

  Announcing Nuclear Vision v2.0, the 100% HTML-style scripting language.
  Easy to learn, easy to use.