zipimport limited to 65536 files?

Tom Graves tgraves_cs at yahoo.com
Thu May 1 15:49:21 EDT 2014


Hello,

I am trying to use python (2.6.6) to read a jar file that contains python files.  I'm simply setting PYTHONPATH= spark-assembly-1.0.0-SNAPSHOT-hadoop2.4.0.jar.   Unfortunately it fails to read the python files from the jar file and if run in verbose mode just shows:

import zipimport # builtin
# installed zipimport hook
# zipimport: found 0 names in spark-assembly-1.0.0-SNAPSHOT-hadoop2.4.0.jar

I was messing around and noticed that if I reduce the number of files and directories in the jar to below 65536 then it works:

import zipimport # builtin
# installed zipimport hook
# zipimport: found 65452 names in pyspark.jar

Is this a known limitation or is this perhaps fixed in newer version or is there a work around?

Note, I'm not subscribed to the mailing list so please copy me in response if possible.

Thanks,
Tom
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20140501/c3939f80/attachment.html>


More information about the Python-list mailing list