[issue1142] code sample showing errors reading large files with py 2.5/3.0

Guido van Rossum report at bugs.python.org
Tue Sep 11 19:36:47 CEST 2007


Guido van Rossum added the comment:

Folks, please focus on one issue at a time, and don't post such long
transcripts.

I know Py3k text I/O is very slow; it's written in Python and uses UTF-8
as the default encoding.  We've got a summer of code student working on
an accelerating this.  (And if he doesn't finish we have another year to
work on it before 3.0final is released.)

So the real problem is that on Windows in 2.x reading files > 4 GB loses
data.  Please try to see if opening the file in binary mode still loses
data.  I suspect a problem in the Windows C stdio library related to
line endings, but who knows.

----------
components:  -Interpreter Core
versions:  -Python 3.0

__________________________________
Tracker <report at bugs.python.org>
<http://bugs.python.org/issue1142>
__________________________________


More information about the Python-bugs-list mailing list