[Numpy-discussion] loadtxt slow
Michael S. Gilbert
Mon Mar 2 14:45:28 CST 2009
On Sun, 1 Mar 2009 14:29:54 -0500, Michael Gilbert wrote:
> i will send the current version to the list tomorrow when i have access
> to the system that it is on.
attached is my current version of loadtxt. like i said, it's slower
for small data sets (because it reads through the whole data file
twice). the first loop is used to figure out how much memory to
allocate, and i can optimize this by intelligently seeking through the
file. but like i said, i haven't had the time to implement it.
all of the options should work, except for "converters" (i have never
used "converters" and i couldn't figure out exactly what it does based
on a quick read-through of the docs).
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 1658 bytes
Desc: not available
Url : http://projects.scipy.org/pipermail/numpy-discussion/attachments/20090302/a6aa61ed/attachment.obj
More information about the Numpy-discussion