[SciPy-User] [ANN] carray: an in-memory compressed data container

Francesc Alted faltet@pytables....
Fri Aug 20 10:29:11 CDT 2010


======================
 Announcing carray 0.1
======================

What it is
==========

carray is a container for numerical data that can be compressed
in-memory.  The compresion process is carried out internally by Blosc,
a high-performance compressor that is optimized for binary data.

Having data compressed in-memory can reduce the stress of the memory
subsystem.  The net result is that carray operations can be faster
than using a traditional ndarray object from NumPy.

What's new
==========

Everything ;-) This is the first public release of carray, and it is
more a proof of concept to see which possibilities opens efficient
compression for in-memory data containers.

Currently carray 0.1 implements the basic container creation and
enlargeability.  Multidimensional arrays are not supported yet, and
elements cannot be modified either (i.e. no `__setitem__()` support).

Resources
=========

Visit the main carray site repository at:
http://github.com/FrancescAlted/carray

You can download a source package from:
http://github.com/FrancescAlted/carray/downloads

Short tutorial:
http://github.com/FrancescAlted/carray/blob/master/USAGE.txt

Home of Blosc compressor:
http://blosc.pytables.org

Share your experience
=====================

Let us know of any bugs, suggestions, gripes, kudos, etc. you may
have.

----

   Enjoy!

-- 
Francesc Alted
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/scipy-user/attachments/20100820/dc50444c/attachment-0001.html 


More information about the SciPy-User mailing list