[IPython-user] IPython1 and TaskClient: a helper for task farming
Thu Apr 24 10:51:29 CDT 2008
This looks really nice! I will definitely have a look at this.
Question: are you willling to commit this code to IPython1 and release
it under a BSD license? If so, I will add some tests/examples/docs
and commit the code.
On Thu, Apr 24, 2008 at 12:47 AM, Yichun Wei <email@example.com> wrote:
> Hi Brian,
> For a while I've been using the attached file to do task farming in
> IPython1. It provides a simple decorator to help turn a function into
> a Task and submit it via TaskClient and return a Deferred as the
> result. The user should attach new callbacks to get results. The
> submission of Tasks and getting back task ids is synchronously done
> It enables usage like:
> # commenting the decorator gives a local running function.
> # with the decorator the function is to be submitted as a Task.
> @parallelized(rc, tc):
> def a_local_function(a,b,c):
> return a+b+c
> result = a_local_function(1,2,3)
> Currently this doesn't make use of the task dependency IPython1
> provides, and doesn't set and use the properties of engines properly.
> I see these as possibly improvements.
> IPython-user mailing list
More information about the IPython-user