[Numpy-discussion] Memory usage of numpy-arrays
Thu Jul 8 17:19:12 CDT 2010
Sebastian Haase wrote:
> This might be better done "by hand", i.e. in standard (non numpy) python:
> nums = 
> for line in file("myTextFile.txt"):
> fields = line.split()
> nums.extend (map(float, fields))
if you know how big your array needs to be, you can pre-allocate it with:
np.empty() or np.ones()
Then fill it in as you read the file -- that will be as memory efficient
as you can do it.
I wrote a expendable array class in Python a while back, which turns out
not to be faster than using a list, but it should be more memory
efficient -- you might try it (enclosed).
Christopher Barker, Ph.D.
Emergency Response Division
NOAA/NOS/OR&R (206) 526-6959 voice
7600 Sand Point Way NE (206) 526-6329 fax
Seattle, WA 98115 (206) 526-6317 main reception
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 4701 bytes
Desc: not available
Url : http://mail.scipy.org/pipermail/numpy-discussion/attachments/20100708/b3fe5558/attachment-0001.zip
More information about the NumPy-Discussion