When to use mechanize and Windmill library during WebScraping ?

Raji Seetharaman sraji.me at gmail.com
Fri Dec 11 12:56:23 EST 2009


Hi

For 'Webscraping with Python' mechanize or urllib2 and windmill or selenium
libraries are used  to download the webpages.

http://www.packtpub.com/article/web-scraping-with-python

The above link makes use of mechanize library to download the web pages.

The below link uses windmill library to download the web pages.

http://www.packtpub.com/article/web-scraping-with-python-part-2

I dont know when to use mechanize or windmill library

It has been said that Windmill library is used when the HTML file is auto
generated by the JavaScript code.

Also i dont know how to identify whether the HTML file is auto generated by
the JavaScript code or not ?

Suggest me

Thanks

Raji. S
http://sraji.wordpress.com/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20091211/f5a935a4/attachment-0001.html>


More information about the Python-list mailing list