[Catalog-sig] Effect of HTTP 1.1

[Phillip J. Eby]

At 07:07 PM 7/13/2007 +0200, Martin v. Löwis wrote:
>I did some measurements, with the script below.
>For 30 requests, a single HTTP 1.1 connection
>needs 5.4s over my DSL connection; 30 individual
>connections need 11.7s. So if setuptools expects
>to request multiple pages from the index, it would
>definitely be useful to keep the connection
>(I don't know at all whether it currently does so
>already).

It doesn't.  I looked just now and found this, that looks like it 
might produce the desired effect for easy_install:

http://linux.duke.edu/projects/urlgrabber/contents/urlgrabber/keepalive.py

Perhaps someone (Jim?) would like to try activating it in a process 
using easy_install (i.e. doing the urllib2.install_opener dance), and 
see if it gives a performance boost.  If it works well, then perhaps 
a patch for setuptools.package_index to use a custom opener is in order.