urllib hangs

Jay Donnell jaydonnell at yahoo.com
Wed Aug 25 12:29:12 EDT 2004


Performance isn't an issue with this script. It runs in the background
from a cron  job. It just needs to finish before the day is over which
it easily does :)
It currently runs through ~20,000 urls which it does in about 3 hours.
It should be faster now that it times out.

If I had used threads at first I probably wouldn't have noticed that
it wasn't timing out on a few urls.

Benjamin Niemann <b.niemann at betternet.de> wrote in message news:<cghotg$v16$1 at online.de>...
> Bernd Kaiser wrote:
> 
> > I also would use a few Threads, they will speed up your script.
> He didn't mention any performance issues. Don't try to optimize for 
> speed before you have a valid complaint about the program being to slow 
> - especially if optimization involves threads!



More information about the Python-list mailing list