[Numpy-discussion] Possible roadmap addendum: building better text file readers

Benjamin Root ben.root@ou....
Thu Feb 23 15:38:22 CST 2012


On Thu, Feb 23, 2012 at 3:14 PM, Robert Kern <robert.kern@gmail.com> wrote:

> On Thu, Feb 23, 2012 at 21:09, Gael Varoquaux
> <gael.varoquaux@normalesup.org> wrote:
> > On Thu, Feb 23, 2012 at 04:07:04PM -0500, Wes McKinney wrote:
> >> In this last case for example, around 500 MB of RAM is taken up for an
> >> array that should only be about 80-90MB. If you're a data scientist
> >> working in Python, this is _not good_.
> >
> > But why, oh why, are people storing big data in CSV?
>
> Because everyone can read it. It's not so much "storage" as "transmission".
>
>
Because their labmate/officemate/advisor is using Excel...

Ben Root
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/numpy-discussion/attachments/20120223/7605e72a/attachment-0001.html 


More information about the NumPy-Discussion mailing list