web crawling.

John M. Gabriele john_sips_teaz at yahooz.com
Thu Jan 19 23:44:59 EST 2006


Alex Martelli wrote:
> S Borg <spwpreston at gmail.com> wrote:
> 
> 
>> Hello,
>>
>> I have been writing very simple Python programs that parse HTML and
>>such, mainly just to get
>>a better feel for the language. Here is my question: If I parsed an
>>HTML page into all of the image
>>files listed on that page, how could I request all of those images and
>>download them into some specified folder? I am sure this is quite easy,
>>but I am stuck.
> 
> 
> There's a good crawler in the Demo directory of the Python source
> distribution, so download and unpack said sources and look there.
> 
> 
> Alex

Hm. Looks like that's:

     Python-2.4.2/Tools/webchecker

See 'pydoc ./webchecker.py' for more info.

---J


-- 
(remove zeez if demunging email address)



More information about the Python-list mailing list