Tons of stats/opens to non-existing files increases Python's startupon loaded NFS servers
Fredrik Lundh
fredrik at pythonware.com
Thu May 5 18:08:36 EDT 2005
Quentin Crain wrote:
> I am being told by my systems people that the load on
> the NFS servers is nasty. Our python installs are up
> on NFS. Also, on a bureaucratic note, I have very
> little input/control into the python builds (sigh).
>
> I have found the following (linux):
>
> strace -f -F python2.2.2 -c 'pass' |& fgrep '(No such
> file or directory)' | wc -l
> ===> 57
>
> strace -f -F python2.4 -c 'pass' |& fgrep '(No such
> file or directory)' | wc -l
> ===> 161
>
> Whoa!! After looking at what is being stat'd or
> open'd, it looks like 'encodings' is new in 2.4 and,
> even "worse", everything is looked for as a zip first.
so why not build that ZIP?
ask your administrators to do this:
$ su
# cd /usr/local/lib/python2.4
# zip -0 python24.zip *.pyc */*.pyc */*/*.pyc
# mv python24.zip ..
# ^D
and see if that helps (tweak the paths as necessary)
</F>
More information about the Python-list
mailing list