[issue10900] bz2 module fails to uncompress large files

[wrobell]

New submission from wrobell <wrobell at pld-linux.org>:

There is problem to uncompress large files with bz2 module.

For example, please download 13GB OpenStreetMap file using following torrent

http://osm-torrent.torres.voyager.hr/files/planet-latest.osm.bz2.torrent

Try to count lines in the compressed file with command...

   python3.2 bz2wc.py planet-110105.osm.bz2 
   3971

... but there is much more lines in that file

   bzip2 -dc < planet-110105.osm.bz2 | wc -l
   
The command

   bzip2 -t planet-110105.osm.bz2

validates the file successfully.

----------
components: Library (Lib)
files: bz2wc.py
messages: 126186
nosy: wrobell
priority: normal
severity: normal
status: open
title: bz2 module fails to uncompress large files
versions: Python 2.7, Python 3.2
Added file: http://bugs.python.org/file20390/bz2wc.py

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue10900>
_______________________________________