[SciPy-User] Maximum file size for .npz format?

Robert Kern robert.kern@gmail....
Sun Mar 14 21:23:48 CDT 2010


On Sun, Mar 14, 2010 at 18:24, Christopher Barker <Chris.Barker@noaa.gov> wrote:
> Stéfan van der Walt wrote:
>>> Yes, the ZIP file format has a 4GB limit. Unfortunately, Python does
>>> not yet support the ZIP64 format.
>>
>> I see Bruce dug up  http://projects.scipy.org/numpy/ticket/991.  Is
>> this the right route to go, or do we need a more sophisticated
>> solution?
>
> It might be nice to build something on libbzip2 -- It looks like the
> license is right, it's got good compression qualities, supports 64 bit,
> and it getting pretty widely used.

bzip2 does not support random access. It just compresses a single
file. It is not a replacement for zipfile.

-- 
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
  -- Umberto Eco


More information about the SciPy-User mailing list