Spidering Hacks for Python, not Perl

John J. Lee jjl at pobox.com
Wed Mar 22 20:38:39 EST 2006


dananrg at yahoo.com writes:

> O'Reilly's Spidering Hacks books terrific. One problem. All the code
> samples are in Perl. Nothing Pythonic. Is there a book out there for
> Python which covers spidering / crawling in depth?

A fair number of the examples in that book use WWW::Mechanize.  I
ported that to Python (it has evolved a bit since then):

http://wwwsearch.sf.net/mechanize


The distribution includes an example from the book ported to Python,
in fact -- porting other examples should be fairly straightforward.

A stable release of mechanize is (finally!) coming soon(-ish).


John




More information about the Python-list mailing list