How's python's web scraping capabilities (vs LWP) ...

ArKane whatever at wherever.com
Sat Apr 8 16:37:06 EDT 2006


Hello all,

I've been hacking away at perl for a few months now, mainly using the
LWP module, used for web scraping. Amoung its capabilities include
support for HTTPS and proxies, authentication, cookies (including the
ability to automatically import Internet Explorer cookies), etc.

It seems to me, however, that trying to write more sophisticated apps
using GUIs with perl is somewhat akin to pulling teeth, so I've been
looking at python, but was wondering if there was an LWP equivalent
for python?



More information about the Python-list mailing list