[Python-Dev] import too slow on NFS based systems

Antoine Pitrou solipsis at pitrou.net
Thu Jun 21 12:33:37 CEST 2012


On Thu, 21 Jun 2012 13:17:01 +0300
Daniel Braniss <danny at cs.huji.ac.il> wrote:
> Hi,
> when lib/python/site-packages/ is accessed via NFS, open/stat/access is very
> expensive/slow. 
> 
> A simple solution is to use an in memory directory search/hash, so I was
> wondering if this has been concidered in the past, if not, and I come
> with a working solution for Unix (at least Linux/Freebsd) will it be 
> concidered.

There is such a thing in Python 3.3, although some stat() calls are
still necessary to know whether the directory caches are fresh.
Can you give it a try and provide some feedback?

Regards

Antoine.




More information about the Python-Dev mailing list