[SciPy-User] Maximum file size for .npz format?
Sun Mar 14 21:23:48 CDT 2010
On Sun, Mar 14, 2010 at 18:24, Christopher Barker <Chris.Barker@noaa.gov> wrote:
> Stéfan van der Walt wrote:
>>> Yes, the ZIP file format has a 4GB limit. Unfortunately, Python does
>>> not yet support the ZIP64 format.
>> I see Bruce dug up http://projects.scipy.org/numpy/ticket/991. Is
>> this the right route to go, or do we need a more sophisticated
> It might be nice to build something on libbzip2 -- It looks like the
> license is right, it's got good compression qualities, supports 64 bit,
> and it getting pretty widely used.
bzip2 does not support random access. It just compresses a single
file. It is not a replacement for zipfile.
"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
-- Umberto Eco
More information about the SciPy-User