[IPython-User] parallel IPython analysis with large dataset
Michael Kuhlen
mqk@astro.berkeley....
Mon Jul 9 19:11:48 CDT 2012
Hi
I have essentially the same question that was asked by Robert Ferrell
back at the end of 2009,
http://python.6.n6.nabble.com/Multi-processor-access-to-a-large-data-set-tt1657458.html
Is the answer still the same (use python.multiprocessing), or is this
now possible with IPython parallel tools?
Specifically, is it now possible to analyze a large dataset using
IPython parallel tools *without* replicating it in memory Ncore times?
If yes, great! How would I do it?
Thanks for you help.
Mike
--
*********************************************************************
* *
* Dr. Michael Kuhlen Theoretical Astrophysics Center *
* email: mqk@astro.berkeley.edu UC Berkeley *
* cell phone: (831) 588-1468 B-116 Hearst Field Annex # 3411 *
* skype username: mikekuhlen Berkeley, CA 94720 *
* *
*********************************************************************
More information about the IPython-User
mailing list