[IPython-dev] load_balanced_view

MinRK benjaminrk@gmail....
Mon Apr 23 11:47:53 CDT 2012


On Mon, Apr 23, 2012 at 04:14, Satrajit Ghosh <satra@mit.edu> wrote:

> ps. the reason i couldn't make it another task is because of the
> distributed context. the engine on which the dependent task runs cannot be
> controlled (i think).


Nope.  The engines can be controlled quite specifically.  LoadBalancedViews
have a 'targets' attribute, just like DirectViews, but they select which
*subset* of targets across which the tasks may be distributed.  If this is
a single engine, then you know exactly where it will run.

-MinRK



>
> cheers,
>
> satra
>
>
> On Mon, Apr 23, 2012 at 7:12 AM, Satrajit Ghosh <satra@mit.edu> wrote:
>
>> hi fernando,
>>
>> we just refactored our logging and config system! always good to clean up
>> some code right :)
>>
>> cheers,
>>
>> satra
>>
>>
>>
>> On Mon, Apr 23, 2012 at 12:45 AM, Fernando Perez <fperez.net@gmail.com>wrote:
>>
>>> On Sat, Mar 10, 2012 at 4:52 PM, Satrajit Ghosh <satra@mit.edu> wrote:
>>> >
>>> > the culprit was node, so instead of sending it directly, i pickled it
>>> and
>>> > sent it. and unpickled it inside the function  after i had done any of
>>> the
>>> > configuring that i needed to do.
>>>
>>> Why not define another task that does the prep you need, and declare
>>> it as a dependency of this task?  Would that not work?
>>>
>>> Best,
>>>
>>> f
>>> _______________________________________________
>>> IPython-dev mailing list
>>> IPython-dev@scipy.org
>>> http://mail.scipy.org/mailman/listinfo/ipython-dev
>>>
>>
>>
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev@scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/ipython-dev/attachments/20120423/f2238e72/attachment-0001.html 


More information about the IPython-dev mailing list