[Scipy-tickets] [SciPy] #1894: scipy.io.loadmat() --- File "/usr/lib/python2.7/dist-packages/scipy/io/matlab/mio5.py", line 224, in read_var_header stream = BytesIO(dcor.decompress(data)) SystemError: ../Objects/stringobject.c:3899: bad argument to internal

SciPy Trac scipy-tickets@scipy....
Sat Apr 20 10:21:21 CDT 2013


#1894: scipy.io.loadmat()  --- File "/usr/lib/python2.7/dist-
packages/scipy/io/matlab/mio5.py", line 224, in read_var_header     stream
= BytesIO(dcor.decompress(data)) SystemError:
../Objects/stringobject.c:3899: bad argument to internal
------------------------+---------------------------------------------------
 Reporter:  ncphillips  |       Owner:  MatthewBrett
     Type:  defect      |      Status:  new         
 Priority:  low         |   Milestone:  Unscheduled 
Component:  scipy.io    |     Version:  0.12.0      
 Keywords:              |  
------------------------+---------------------------------------------------
Changes (by pv):

  * owner:  somebody => MatthewBrett
  * priority:  high => low
  * component:  Other => scipy.io


Comment:

 The problem here is that the file contains compressed data which expands
 to ~ 1.1 GB in size.

 The Matlab file reader seems to make a number of intermediate copies of
 this data, so the amount
 of memory needed to load it is several gigabytes rather than just one. It
 might be possible to improve this situation.

-- 
Ticket URL: <http://projects.scipy.org/scipy/ticket/1894#comment:1>
SciPy <http://www.scipy.org>
SciPy is open-source software for mathematics, science, and engineering.


More information about the Scipy-tickets mailing list