[Catalog-sig] Effect of HTTP 1.1

[Jim Fulton]

On Jul 13, 2007, at 2:34 PM, Phillip J. Eby wrote:

> At 07:07 PM 7/13/2007 +0200, Martin v. Löwis wrote:
>> I did some measurements, with the script below.
>> For 30 requests, a single HTTP 1.1 connection
>> needs 5.4s over my DSL connection; 30 individual
>> connections need 11.7s. So if setuptools expects
>> to request multiple pages from the index, it would
>> definitely be useful to keep the connection
>> (I don't know at all whether it currently does so
>> already).
>
> It doesn't.  I looked just now and found this, that looks like it  
> might produce the desired effect for easy_install:
>
> http://linux.duke.edu/projects/urlgrabber/contents/urlgrabber/ 
> keepalive.py
>
> Perhaps someone (Jim?) would like to try activating it in a process  
> using easy_install (i.e. doing the urllib2.install_opener dance),  
> and see if it gives a performance boost.  If it works well, then  
> perhaps a patch for setuptools.package_index to use a custom opener  
> is in order.

I'd be happy to do this sometime in the next few weeks.

Jim

--
Jim Fulton			mailto:jim at zope.com		Python Powered!
CTO 				(540) 361-1714			http://www.python.org
Zope Corporation	http://www.zope.com		http://www.zope.org