[SciPy-User] Correlation coefficient of large arrays

josef.pktd@gmai... josef.pktd@gmai...
Tue Mar 16 00:16:14 CDT 2010


On Tue, Mar 16, 2010 at 1:04 AM, Vincent Davis <vincent@vincentdavis.net>wrote:

> I have an array 10 observations of 230,000 variables and what to find the
> correlation coefficient between each variable.
> numpy.corrcef(data) works except I can only do it with about 30,000
> variables at a time. numpy.corrcef(data[:30000]). It uses up a lot of
> memory.
> Is there a better way?
>


how much memory does a
>>> 230000**2
52900000000L

float (double) array take ?

Josef
(I'm not going to try)



>
>   *Vincent Davis
> 720-301-3003 *
> vincent@vincentdavis.net
>  my blog <http://vincentdavis.net> | LinkedIn<http://www.linkedin.com/in/vincentdavis>
>
>
> _______________________________________________
> SciPy-User mailing list
> SciPy-User@scipy.org
> http://mail.scipy.org/mailman/listinfo/scipy-user
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/scipy-user/attachments/20100316/bd802c45/attachment-0001.html 


More information about the SciPy-User mailing list