[IPython-user] IPython1 and TaskClient: a helper for task farming

Yichun Wei yichun.wei@gmail....
Thu Apr 24 11:17:13 CDT 2008


I am happy if this goes into IPython1 repository. No problem with BSD
license and thanks a lot for the nice IPython1 work, Brian.  -yichun

On Thu, Apr 24, 2008 at 8:51 AM, Brian Granger <ellisonbg.net@gmail.com> wrote:
> Yichun,
>
>  This looks really nice!  I will definitely have a look at this.
>  Question: are you willling to commit this code to IPython1 and release
>  it under a BSD license?  If so, I will add some tests/examples/docs
>  and commit the code.
>
>  Thanks!
>
>  Brian
>
>
>
>  On Thu, Apr 24, 2008 at 12:47 AM, Yichun Wei <yichun.wei@gmail.com> wrote:
>  > Hi Brian,
>  >
>  >  For a while I've been using the attached file to do task farming in
>  >  IPython1. It provides a simple decorator to help turn a function into
>  >  a Task and submit it via TaskClient and return a Deferred as the
>  >  result. The user should attach new callbacks to get results. The
>  >  submission of Tasks and getting back task ids is synchronously done
>  >  though.
>  >
>  >  It enables usage like:
>  >
>  >  # commenting the decorator gives a local running function.
>  >  # with the decorator the function is to be submitted as a Task.
>  >  @parallelized(rc, tc):
>  >  def a_local_function(a,b,c):
>  >     return a+b+c
>  >
>  >  result = a_local_function(1,2,3)
>  >  ...
>  >
>  >  Currently this doesn't make use of the task dependency IPython1
>  >  provides, and doesn't set and use the properties of engines properly.
>  >  I see these as possibly improvements.
>  >
>
>
> > _______________________________________________
>  >  IPython-user mailing list
>  >  IPython-user@scipy.org
>  >  http://lists.ipython.scipy.org/mailman/listinfo/ipython-user
>  >
>  >
>


More information about the IPython-user mailing list