parse tar file with python
Carel Fellinger
carel.fellinger at iae.nl
Wed Jun 12 07:26:12 EDT 2002
On Wed, Jun 12, 2002 at 11:29:30AM +0200, Shagshag13 wrote:
> hello,
>
> i 'm not sure this is the right place to ask, but maybe somebody had already do some kind of python code on this :
>
> i had hundred thousand of small files, my program is very slow. I'm thinking that i loose time waiting for opening/closing, and i
Some filesystems get very slow with lots of files in a single directory.
Maybe the simplest solution is to organize those thousands of files in
a few (hundreth) subdirectories. Might give you all the speed-up you need.
> But in this case i don't know how to check for the end of a file and how to get its name (both in a tar archive) ...
> (i don't want to tar/untar with python, just to be able to do a sequential reading of a tar file to get its content)
Parsing the tar file is aka untarring it in memory, so what not use
the tar module?
--
groetjes, carel
More information about the Python-list
mailing list