[IPython-User] parallel IPython analysis with large dataset

Michael Kuhlen kuhlen@gmail....
Mon Jul 9 21:33:11 CDT 2012


[Apologies if this is posted twice, I originally emailed from an
unsubscribed email address.]

I have essentially the same question that was asked by Robert Ferrell
back at the end of 2009,

Is the answer still the same (use python.multiprocessing), or is this
now possible with IPython parallel tools?

Specifically, is it now possible to analyze a large dataset using
IPython parallel tools *without* replicating it in memory Ncore times?
If yes, great! How would I do it?

Thanks for you help.


More information about the IPython-User mailing list