[NumPy-Tickets] [NumPy] #2198: np.loadtxt leaks memory

NumPy Trac numpy-tickets@scipy....
Sun Aug 12 10:23:58 CDT 2012


#2198: np.loadtxt leaks memory
---------------------------------+------------------------------------------
 Reporter:  tanriol              |       Owner:  somebody   
     Type:  defect               |      Status:  new        
 Priority:  normal               |   Milestone:  Unscheduled
Component:  numpy.lib            |     Version:  1.6.2      
 Keywords:  loadtxt memory leak  |  
---------------------------------+------------------------------------------

Comment(by tanriol):

 Yes, swapping is observed with the real data files (which are larger).
 Pandas leaks less memory, but still too much. Probably I'll have to use
 pandas with its lazy chunk-by-chunk method for loading as neither loadtxt
 nor genfromtxt seem to be able to build the numpy arrays chunk-by-chunk.

-- 
Ticket URL: <http://projects.scipy.org/numpy/ticket/2198#comment:6>
NumPy <http://projects.scipy.org/numpy>
My example project


More information about the NumPy-Tickets mailing list