[IPython-user] IPython1 and TaskClient: a helper for task farming

Yichun Wei yichun.wei@gmail....
Thu Apr 24 01:47:16 CDT 2008


Hi Brian,

For a while I've been using the attached file to do task farming in
IPython1. It provides a simple decorator to help turn a function into
a Task and submit it via TaskClient and return a Deferred as the
result. The user should attach new callbacks to get results. The
submission of Tasks and getting back task ids is synchronously done
though.

It enables usage like:

# commenting the decorator gives a local running function.
# with the decorator the function is to be submitted as a Task.
@parallelized(rc, tc):
def a_local_function(a,b,c):
    return a+b+c

result = a_local_function(1,2,3)
...

Currently this doesn't make use of the task dependency IPython1
provides, and doesn't set and use the properties of engines properly.
I see these as possibly improvements.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: asynparallel.py
Type: text/x-python
Size: 5931 bytes
Desc: not available
Url : http://lists.ipython.scipy.org/pipermail/ipython-user/attachments/20080423/61c3f833/attachment.py 


More information about the IPython-user mailing list