Is Python good for web crawlers?

[gene tani]

Paul Rubin wrote:
> Xavier Morel <xavier.morel at masklinn.net> writes:
> > BeautifulSoup...
> > The API of the package is extremely simple, straightforward and... obvious.
>
> I did not find that.  I spent a few minutes looking at the
> documentation and it wasn't obvious at all how to use it.  Maybe I

1. read about Soup and mechanize
http://sig.levillage.org/?p=599

2. flip thru oreilly spidering hacks book (put on YAPH t-shirt)

3. go at your task

4. write Spidering Hacks in Python, 1st edition.  Cite me as
inspiration.