[Distutils] short circuiting module lookups

[Marius Gedminas]

On Tue, Apr 07, 2009 at 02:23:50PM -0400, Jim Fulton wrote:
> On Apr 7, 2009, at 9:28 AM, P.J. Eby wrote:
>> At 11:54 PM 4/7/2009 +1200, Noah Gift wrote:
>>> 1.  In the case of entry points for setuptools, it actually recurses
>>> into EVERY egg directory in your path, not just the egg you
>>> requested, adds them to your sys.path and additionally looks for
>>> four files inside of every egg.  On a laptop on local storage, this
>>> doesn't matter, but when thousands of machines hit the same filer,
>>> with many python processes, bad things happen...
>>
>> Install your eggs with --multi-version, and then only the eggs that  
>> are required for the running script will be added to sys.path or have 
>> their contents opened.  (Installing them as zip files rather than 
>> directories may also speed this up.)
>
> My experience on Linux is that installing eggs as Zip files slows  
> imports.

Was that in the presence of NFS?

Marius Gedminas
-- 
We have an advanced scalable groupware communication environment (email)
	-- Alan Cox
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20090408/b6e15e97/attachment.pgp>