working with a large file

Stefan Behnel stefan_ml at behnel.de
Mon Sep 12 10:10:44 EDT 2011


Rita, 12.09.2011 12:34:
> I have a large file, 18gb uncompressed, and I would like to know what is the
> preferred method to read this file for random access. I have several
> processes reading the file which different calculate arguments. My server
> has 64gb of memory. Not sure what is the preferred way to do this?

It depends on the content (and likely also the operating system), but you 
might want to take a look at the mmap module.

Stefan




More information about the Python-list mailing list