[IPython-User] parallel IPython analysis with large dataset

Michael Kuhlen mqk@astro.berkeley....
Mon Jul 9 19:11:48 CDT 2012


Hi

I have essentially the same question that was asked by Robert Ferrell
back at the end of 2009,
http://python.6.n6.nabble.com/Multi-processor-access-to-a-large-data-set-tt1657458.html

Is the answer still the same (use python.multiprocessing), or is this
now possible with IPython parallel tools?

Specifically, is it now possible to analyze a large dataset using
IPython parallel tools *without* replicating it in memory Ncore times?
If yes, great! How would I do it?

Thanks for you help.

Mike

-- 
*********************************************************************
*                                                                   *
*  Dr. Michael Kuhlen              Theoretical Astrophysics Center  *
*  email: mqk@astro.berkeley.edu   UC Berkeley                      *
*  cell phone: (831) 588-1468      B-116 Hearst Field Annex # 3411  *
*  skype username: mikekuhlen      Berkeley, CA 94720               *
*                                                                   *
*********************************************************************


More information about the IPython-User mailing list