Fetching websites with Python
Markus Franz
mf at orase.com
Wed Mar 31 12:33:45 EST 2004
Hi.
How can I grab websites with a command-line python script? I want to start
the script like this:
./script.py ---xxx--- http://www.address1.com http://www.address2.com
http://www.address3.com
The script should load these 3 websites (or more if specified) in parallel
(may be processes? threads?) and show their contents seperated by ---xxx---.
The whole output should be print on the command-line. Each website should
only have 15 seconds to return the contents (maximum) in order to avoid a
never-ending script.
How can I do this?
Thanks.
Yours sincerely
Markus Franz
More information about the Python-list
mailing list