Python robot web client?

[John Hunter]

>>>>> "Paul" == Paul Rubin <phr-n2002b at NOSPAMnightsong.com> writes:

    Paul> Are there any Python robot web clients around, sort of like
    Paul> Perl LWP?  I mean something fancier than urllib, that parses
    Paul> the HTTP headers and remembers any cookies.  It would also
    Paul> be great if it parsed the HTML enough to find the form
    Paul> fields, links, and so forth.  I guess I can implement what I
    Paul> need, but thought I'd ask first if something like it is
    Paul> already available.

You may want to take a look at 

Python-2.1.3/Tools/webchecker/websucker.py

in the python src tree -- it mirrors web sites.  I don't think it has
support for cookies orforms, but it would be a starting point if you
want to roll your own.

John Hunter