[Mailman-Users] Google and other search engines

[Mark Sapiro]

Jack R. Madderra wrote:

>Other than setting the archives to private are the any other recommended
>methods of preventing these Bots from accessing the list archives?

1)You can use a robots.txt file. Google 'robots.txt' for info.

2)You can configure your web server to add a

Robots: noindex,nofollow

header when it delivers the pages.

3)You can edit the various arch*.html and article.html templates to add
a

<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">

tag. See
http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq04.048.htp
for editing instructions.

2) is better than 3), if you do 2) you don't need 3). 1) never hurts.

Reputable search engine robots will honor these. Spambots probably
won't.

-- 
Mark Sapiro <msapiro at value.net>       The highway is for gamblers,
San Francisco Bay Area, California    better use your sense - B. Dylan