[Xitami] Xitami has slowed to a crawl

[Bill Warren]

try keyfocus.  i've been using it for a few months and it is ROCK SOLID. 
save yourself the aggravation. it's free too.

----- Original Message ----- 
From: "Thomas J. Hruska" <shinelight@shininglightpro.com>
To: <xitami@lists.xitami.org>
Sent: Wednesday, January 12, 2005 11:17 AM
Subject: RE: [Xitami] Xitami has slowed to a crawl


> At 10:30 AM 1/12/2005 -0500, Ron Ackerman writeth:
>>Seems Googlebot is ignoring the robots.txt file, I can see other bots hit
>>the file and obey it but the Googlebot just keeps on hitting the server.
>
> Yeah, Google will ignore that since it never existed before, Google tracks
> whether or not you have ever had a robots.txt file and won't look for it
> for a while.  What you have to do in the interim period (Google will
> EVENTUALLY look for a robots.txt file) is to set up a
> "no-follow,no-cache,etc" META tag in those four global PHP pages to keep
> them from getting indexed (Google DOES pay immediate attention to METAs).
> Between METAs and your robots.txt file, you should be able to stop bots
> from accessing those pages.
>
>
> Thomas J. Hruska
> Shining Light Productions
> http://www.slproweb.com/
>
>
> --
> Xitami Users Mailing List -- For Xitami support
> To unsubscribe: http://lists.xitami.org/mailman/listinfo/xitami
>