web searching scripts

julien.lord at gmail.com julien.lord at gmail.com
Fri Aug 4 11:40:05 EDT 2006


Does anyone know of a freely available script that can take a given URL
and follow every link within it?

Ideally, I would like to start with this to build a quick application
to grab all the content off a website to publish it to a CD.

Thanks,

jul




More information about the Python-list mailing list