[Python-Dev] Googlebot and the mail.python.org python-dev archive

[Antoine Pitrou]

Nick Coghlan <ncoghlan <at> gmail.com> writes:
> 
> >     <META NAME="robots" CONTENT="noindex,follow">
> > which explicitly instructs Web spiders *not* to index contents nor follow 
links.
> 
> That's not quite true - that meta tag says not to index the current
> page, but *do* follow the links to other pages. The archive page and the
> monthly summary pages say the same two things.

For some mysterious reason my brain had read "nofollow" in the above.
Well, nevermind.

cheers

Antoine.