[IPython-user] IPython1 and TaskClient: a helper for task farming

[Brian Granger]

Yichun,

This looks really nice!  I will definitely have a look at this.
Question: are you willling to commit this code to IPython1 and release
it under a BSD license?  If so, I will add some tests/examples/docs
and commit the code.

Thanks!

Brian

On Thu, Apr 24, 2008 at 12:47 AM, Yichun Wei <yichun.wei@gmail.com> wrote:
> Hi Brian,
>
>  For a while I've been using the attached file to do task farming in
>  IPython1. It provides a simple decorator to help turn a function into
>  a Task and submit it via TaskClient and return a Deferred as the
>  result. The user should attach new callbacks to get results. The
>  submission of Tasks and getting back task ids is synchronously done
>  though.
>
>  It enables usage like:
>
>  # commenting the decorator gives a local running function.
>  # with the decorator the function is to be submitted as a Task.
>  @parallelized(rc, tc):
>  def a_local_function(a,b,c):
>     return a+b+c
>
>  result = a_local_function(1,2,3)
>  ...
>
>  Currently this doesn't make use of the task dependency IPython1
>  provides, and doesn't set and use the properties of engines properly.
>  I see these as possibly improvements.
>
> _______________________________________________
>  IPython-user mailing list
>  IPython-user@scipy.org
>  http://lists.ipython.scipy.org/mailman/listinfo/ipython-user
>
>