"The Python Robot" is going mad ?

A.M. Kuchling amk at amk.ca
Tue Mar 23 13:32:32 EST 2004


On Tue, 23 Mar 2004 19:19:13 +0100, 
	Robert <k.robert at gmx.de> wrote:
> at http://www.robotstxt.org/wc/active/html/python.html I learned the robot
> "The Python Robot" is maintained by www.python.org.

I have no idea what they're talking about; no one at python.org is running a
robot that's crawling a large number of web pages.  Back in 1995 GvR posted
a web crawling script that used Python-robot as the user agent, but that
doesn't seem to match the one you describe.

I suggest you block the IP address doing all of the crawling; whoever it is
almost certainly isn't legitimate.

--amk



More information about the Python-list mailing list