[SciPy-user] read/write compressed files

Francesc Altet faltet@carabos....
Thu Jun 21 05:30:02 CDT 2007


El dc 20 de 06 del 2007 a les 21:01 +0200, en/na Dominik Szczerba va
escriure:
> PyTables is great (and big) while I just need to read in a sequence of
> values.

Ok, that's fine. In any case, I'm interested in knowing the reasons on
why you are using bzip2 instead zlib.  Have you detected some data
pattern where you get significantly more compression than by using zlib
for example?.

I'm asking this because, in my experience with numerical data, I was
unable to detect important compression level differences between bzip2
and zlib. See:

http://www.pytables.org/docs/manual/ch05.html#compressionIssues

for some experiments in that regard.

I'd appreciate any input on this subject (bzip2 vs zlib).

-- 
Francesc Altet    |  Be careful about using the following code --
Carabos Coop. V.  |  I've only proven that it works, 
www.carabos.com   |  I haven't tested it. -- Donald Knuth



More information about the SciPy-user mailing list