[Numpy-discussion] checksum on numpy float array
Sat Dec 6 04:41:16 CST 2008
A Friday 05 December 2008, Andrew Collette escrigué:
> > Another possibility would be to use HDF5 as a data container. It
> > supports the fletcher32 filter  which basically computes a
> > chuksum for evey data chunk written to disk and then always check
> > that the data read satifies the checksum kept on-disk. So, if the
> > HDF5 layer doesn't complain, you are basically safe.
> > There are at least two usable HDF5 interfaces for Python and NumPy:
> > PyTables and h5py . PyTables does have support for that
> > right out-of-the-box. Not sure about h5py though (a quick search
> > in docs doesn't reveal nothing).
> >  http://rfc.sunsite.dk/rfc/rfc1071.html
> >  http://www.pytables.org
> >  http://h5py.alfven.org
> > Hope it helps,
> Just to confirm that h5py does in fact have fletcher32; it's one of
> the options you can specify when creating a dataset, although it
> could use better documentation:
My bad. I've searched for 'fletcher' instead of 'fletcher32'. I
naively thought that the search tool in Sphinx allowed for partial name
finding. In fact, it is a pity it does not.
More information about the Numpy-discussion