[NumPy-Tickets] [NumPy] #2198: np.loadtxt leaks memory
NumPy Trac
numpy-tickets@scipy....
Sun Aug 12 10:23:58 CDT 2012
#2198: np.loadtxt leaks memory
---------------------------------+------------------------------------------
Reporter: tanriol | Owner: somebody
Type: defect | Status: new
Priority: normal | Milestone: Unscheduled
Component: numpy.lib | Version: 1.6.2
Keywords: loadtxt memory leak |
---------------------------------+------------------------------------------
Comment(by tanriol):
Yes, swapping is observed with the real data files (which are larger).
Pandas leaks less memory, but still too much. Probably I'll have to use
pandas with its lazy chunk-by-chunk method for loading as neither loadtxt
nor genfromtxt seem to be able to build the numpy arrays chunk-by-chunk.
--
Ticket URL: <http://projects.scipy.org/numpy/ticket/2198#comment:6>
NumPy <http://projects.scipy.org/numpy>
My example project
More information about the NumPy-Tickets
mailing list