A Question on URLLIB

joy99 subhakolkata1234 at gmail.com
Tue Mar 15 05:31:04 EDT 2011


On Mar 15, 1:49 pm, David Marek <dav... at atrey.karlin.mff.cuni.cz>
wrote:
> You are doing fine so far :-)
>
> However, urllib is quite low level module. Do you know mechanizehttp://wwwsearch.sourceforge.net/mechanize/? I have used it in my
> crawler. If you want to crawl a specific site for known data then
> Scrapyhttp://scrapy.org/could be useful too.
>
> David Marek
> dav... at atrey.karlin.mff.cuni.czhttp://davidmarek.cz
>
> On Tue, Mar 15, 2011 at 7:10 AM, joy99 <subhakolkata1... at gmail.com> wrote:
> > Dear Group,
> > I am trying to construct a web based crawler with Python and for that
> > I am using the URLLIB module, and  by doing
> > import urllib and then trying with urllib.urlopen("url).
> > Am I going fine?
> > If some one can kindly highlight if I am doing any mistake.
> > Best Regards,
> > Subhabrata Banerjee.
> > --
> >http://mail.python.org/mailman/listinfo/python-list
>
>

Thanks David,I'll surely try to have a check.



More information about the Python-list mailing list