python and very large data sets???

Mike Coleman mkc+dated+1022285475.ae3858 at mathdogs.com
Wed Apr 24 20:12:58 EDT 2002


holger krekel <pyth at devel.trillke.net> writes:
> - use module mmap to map source and destination files 
>   into addressspace.

At least for Python2.2 on Unix, I think mmap's are currently limited to
32-bits or so.  (Of course, if you're on a 32-bit box, this doesn't really
matter.)

So, for 80GB files, you must read.




More information about the Python-list mailing list