Is Python good for web crawlers?

[Paul Rubin]

Xavier Morel <xavier.morel at masklinn.net> writes:
> BeautifulSoup...
> The API of the package is extremely simple, straightforward and... obvious.

I did not find that.  I spent a few minutes looking at the
documentation and it wasn't obvious at all how to use it.  Maybe I
could have figured it out with more effort, but I got whatever the
immediate task was done without it instead.  It does look like a nice
package but the docs need improvement.