[SciPy-user] Reading laaaarge arrays
Jose Luis Gomez Dans
josegomez at gmx.net
Wed Sep 22 12:06:23 CDT 2004
I have a list of essentially (x,y) data (two columns,
in glorious ASCII), that I want to read into a scipy
array. The most obvious thing to do is to use
io.read_array(), but the files are quite large (up to
0.5Gb), and thus, read_array is very slow.
I remember someone mentioning this before, and
suggesting a little function written in C, and usable
from within scipy to do this efficiently, but I can't
find it in the archives or in my mailbox.
Can anyone suggest a way to do this? So far, I've
been trying to read in a 72Mb file for 17 minutes
with io.read_array(), and it's still going!!!
+++ GMX DSL Premiumtarife 3 Monate gratis* + WLAN-Router 0,- EUR* +++
Clevere DSL-Nutzer wechseln jetzt zu GMX: http://www.gmx.net/de/go/dsl
More information about the SciPy-user