[Numpy-discussion] loadtxt slow

Michael S. Gilbert michael.s.gilbert@gmail....
Mon Mar 2 14:45:28 CST 2009


On Sun, 1 Mar 2009 14:29:54 -0500, Michael Gilbert wrote:
> i will send the current version to the list tomorrow when i have access
> to the system that it is on.

attached is my current version of loadtxt.  like i said, it's slower
for small data sets (because it reads through the whole data file
twice).  the first loop is used to figure out how much memory to
allocate, and i can optimize this by intelligently seeking through the
file.  but like i said, i haven't had the time to implement it.

all of the options should work, except for "converters" (i have never
used "converters" and i couldn't figure out exactly what it does based
on a quick read-through of the docs).

best wishes,
mike
-------------- next part --------------
A non-text attachment was scrubbed...
Name: myloadtxt
Type: application/octet-stream
Size: 1658 bytes
Desc: not available
Url : http://projects.scipy.org/pipermail/numpy-discussion/attachments/20090302/a6aa61ed/attachment.obj 


More information about the Numpy-discussion mailing list