[Numpy-discussion] fast numpy i/o

Robert Kern robert.kern at gmail.com
Tue Jun 21 14:00:46 EDT 2011


On Tue, Jun 21, 2011 at 12:49, Neal Becker <ndbecker2 at gmail.com> wrote:
> I'm wondering what are good choices for fast numpy array serialization?
>
> mmap: fast, but I guess not self-describing?
> hdf5: ?
> pickle: self-describing, but maybe not fast?
> others?

NPY:
http://docs.scipy.org/doc/numpy/reference/generated/numpy.save.html
http://docs.scipy.org/doc/numpy/reference/generated/numpy.load.html
(Note the mmap_mode argument)
https://raw.github.com/numpy/numpy/master/doc/neps/npy-format.txt

-- 
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
  -- Umberto Eco



More information about the NumPy-Discussion mailing list