[Numpy-discussion] checksum on numpy float array
Francesc Alted
faltet at pytables.org
Sat Dec 6 05:41:16 EST 2008
A Friday 05 December 2008, Andrew Collette escrigué:
> > Another possibility would be to use HDF5 as a data container. It
> > supports the fletcher32 filter [1] which basically computes a
> > chuksum for evey data chunk written to disk and then always check
> > that the data read satifies the checksum kept on-disk. So, if the
> > HDF5 layer doesn't complain, you are basically safe.
> >
> > There are at least two usable HDF5 interfaces for Python and NumPy:
> > PyTables[2] and h5py [3]. PyTables does have support for that
> > right out-of-the-box. Not sure about h5py though (a quick search
> > in docs doesn't reveal nothing).
> >
> > [1] http://rfc.sunsite.dk/rfc/rfc1071.html
> > [2] http://www.pytables.org
> > [3] http://h5py.alfven.org
> >
> > Hope it helps,
>
> Just to confirm that h5py does in fact have fletcher32; it's one of
> the options you can specify when creating a dataset, although it
> could use better documentation:
>
> http://h5py.alfven.org/docs/guide/hl.html#h5py.highlevel.Group.create
>_dataset
My bad. I've searched for 'fletcher' instead of 'fletcher32'. I
naively thought that the search tool in Sphinx allowed for partial name
finding. In fact, it is a pity it does not.
Cheers,
--
Francesc Alted
More information about the NumPy-Discussion
mailing list