[Numpy-discussion] Accessing data in a large file
Simon Lyngby Kokkendorff
Thu Jun 17 13:59:45 CDT 2010
Thanks for the references to these libraries - they seem to fix my problem!
On Thu, Jun 17, 2010 at 2:58 PM, davide <firstname.lastname@example.org> wrote:
> You may have a look to the nice python-h5py module, which gives an OO
> interface to the underlying hdf5 file format. I'm using it for storing
> large amounts (~10Gb) of experimental data. Very fast, very convenient.
> On Thu, 2010-06-17 at 08:33 -0400, greg whittier wrote:
> > On Thu, Jun 17, 2010 at 4:21 AM, Simon Lyngby Kokkendorff
> > <email@example.com> wrote:
> > > memory errors. Is there a way to get numpy to do what I want, using an
> > > internal platform independent numpy-format like .npy, or do I have to
> wrap a
> > > custom file reader with something like ctypes?
> > You might give http://www.pytables.org/ a try.
> > _______________________________________________
> > NumPy-Discussion mailing list
> > NumPy-Discussion@scipy.org
> > http://mail.scipy.org/mailman/listinfo/numpy-discussion
> NumPy-Discussion mailing list
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the NumPy-Discussion