Web Scraping/Site Scraping

John J. Lee jjl at pobox.com
Mon Jul 12 15:21:09 EDT 2004


"David Jones" <djones at outrider.net> writes:

> Hi, I'm interested in learning about web scraping/site scraping using
> Python.  Does anybody know of some online resources or have any modules that
> are available to help out.  O'Reilly published an interesting book
> "Spidering Hacks" which covered some great scraping hacks but it is all
> written in Perl.  I don't know Perl and don't want to.  I'm new to
> programing and have been advised to start with Python.  So far so good ...
> but need some help with web programming.   Thanks for any help you may
> provide.  Dave.

http://wwwsearch.sourceforge.net/
http://wwwsearch.sourceforge.net/bits/GeneralFAQ.html

http://lists.sourceforge.net/lists/listinfo/wwwsearch-general  (rather quiet ATM)


I ported one of the examples from "Spidering Hacks" to my Python port
of mechanize.  It's in the tarball here:

http://wwwsearch.sourceforge.net/mechanize/


John



More information about the Python-list mailing list