[SciPy-user] Large matrix support

Alan McIntyre alan.mcintyre@gmail....
Fri Apr 25 18:16:04 CDT 2008


On Fri, Apr 25, 2008 at 5:01 PM, Dinesh B Vadhia
<dineshbvadhia@hotmail.com> wrote:
> My matrix sizes can be large ie. > minimum 20,000 rows x 1m columns.
>
> When just creating these data sets using Python/Numpy/Scipy, I get
> pythonw.exe errors and the program aborts.  I guess the Microsoft 32K limit
> has been reached somewhere.
>
> I haven't got any Python program to run with these data sets because of 'not
> enough memory' errors.  I'm waiting for the int8 support in the sparse
> library to hopefully resolve that issue.

Dinesh,

I apologize if this is too basic a question to ask, but are the
matrices sparse?  Could you post some sample code to show how you're
trying to construct these matrices?

Thanks,
Alan


More information about the SciPy-user mailing list