A Question on URLLIB

[David Marek]

You are doing fine so far :-)

However, urllib is quite low level module. Do you know mechanize
http://wwwsearch.sourceforge.net/mechanize/ ? I have used it in my
crawler. If you want to crawl a specific site for known data then
Scrapy http://scrapy.org/ could be useful too.

David Marek
davidm at atrey.karlin.mff.cuni.cz
http://davidmarek.cz

On Tue, Mar 15, 2011 at 7:10 AM, joy99 <subhakolkata1234 at gmail.com> wrote:
> Dear Group,
> I am trying to construct a web based crawler with Python and for that
> I am using the URLLIB module, and  by doing
> import urllib and then trying with urllib.urlopen("url).
> Am I going fine?
> If some one can kindly highlight if I am doing any mistake.
> Best Regards,
> Subhabrata Banerjee.
> --
> http://mail.python.org/mailman/listinfo/python-list
>