[IPython-dev] Balancing code execution in ipython1

Hugo Gamboa hgamboa at gmail.com
Wed Mar 1 10:24:07 CST 2006


Hi,

I've started to work with the parallel ipython and feeling that this is a
fantastic and promising tool.

I want to run some of the tasks in parallel, but I'm not comfortable with
the scatter way, that equally divides a set of tasks.
I would like to balance the code execution between computers for two
reasons: I have computers with distinct speed and the code may be completed
earlier in some cases.

I would like to know when a computer have ended a task and assign a new one.


I've considered a solution similar to pylinda tuple spaces but (as far as I
know) the the kernel does not have access to the kernel client other than in
a form of answering. The kernel cannot take the iniciative and change a
cluster common data, that could be a way of solving my needs.

What is the best direction? Should I derive from a resultgatherer to monitor
the end of code execution or there is a better way?

Thanks in advance for your time.

Hugo Gamboa
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://projects.scipy.org/pipermail/ipython-dev/attachments/20060301/1cb5d7b5/attachment.html 


More information about the IPython-dev mailing list