[Xitami] Xitami has slowed to a crawl

[Johannes Prost]

sorry, but what is it and where to find ? any link ?

Johannes

Am 12 Jan 2005 um 13:08 hat Bill Warren geschrieben:

> try keyfocus.  i've been using it for a few months and it is ROCK SOLID. 
> save yourself the aggravation. it's free too.
> 
> ----- Original Message ----- 
> From: "Thomas J. Hruska" <shinelight@shininglightpro.com>
> To: <xitami@lists.xitami.org>
> Sent: Wednesday, January 12, 2005 11:17 AM
> Subject: RE: [Xitami] Xitami has slowed to a crawl
> 
> 
> > At 10:30 AM 1/12/2005 -0500, Ron Ackerman writeth:
> >>Seems Googlebot is ignoring the robots.txt file, I can see other bots hit
> >>the file and obey it but the Googlebot just keeps on hitting the server.
> >
> > Yeah, Google will ignore that since it never existed before, Google tracks
> > whether or not you have ever had a robots.txt file and won't look for it
> > for a while.  What you have to do in the interim period (Google will
> > EVENTUALLY look for a robots.txt file) is to set up a
> > "no-follow,no-cache,etc" META tag in those four global PHP pages to keep
> > them from getting indexed (Google DOES pay immediate attention to METAs).
> > Between METAs and your robots.txt file, you should be able to stop bots
> > from accessing those pages.
> >
> >
> > Thomas J. Hruska
> > Shining Light Productions
> > http://www.slproweb.com/
> >
> >
> > --
> > Xitami Users Mailing List -- For Xitami support
> > To unsubscribe: http://lists.xitami.org/mailman/listinfo/xitami
> > 
> 
> 
> --
> Xitami Users Mailing List -- For Xitami support
> To unsubscribe: http://lists.xitami.org/mailman/listinfo/xitami