[Numpy-discussion] memmap on 64bit Linux for > 2 GB files

[Robert Kern]

Sebastian Haase wrote:
> Hi,
> I finally tried to do the test, to memmap a large file
> filesize: 2.8G
> 
> a memmap call gives this error:
> 
> {{{
>>>> N.memmap('20050622-1648-Y_DEMO-1')
> Traceback (most recent call last):
>   File "<input>", line 1, in ?
>   File "/jws30/haase/PrLinN64/numpy/core/memmap.py", line 67, in __new__
>     mm = mmap.mmap(fid.fileno(), bytes, access=acc)
> OverflowError: memory mapped size is too large (limited by C int)
> }}}
> 
> I'm using a recent numpy on a 64bit Linux (debian etch, kernel:
> 2.6.16-2-em64t-p4-smp)
> {{{
>>>> N.__version__
> '1.0.2.dev3509'
>>>> N.int0
> <type 'numpy.int64'>
> }}}
> 
> Is this supposed to work ?

You need Python 2.5 for it to work.

-- 
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless enigma
 that is made terrible by our own mad attempt to interpret it as though it had
 an underlying truth."
  -- Umberto Eco