[IPython-User] parallel ssh problems

Toby Burnett tburnett@uw....
Sun Oct 23 09:44:28 CDT 2011


Hi, I’m trying to get the parallel ssh option to run on ipython 0.11 or 0.12.

In each case I ran "ipython profile create ssh" and modified the generated file ipcluster_config.py to specify

c.IPClusterStart.controller_launcher_class = 'SSHEngineSetLauncher'
and set c.SSHEngineSetLauncher.engines to the appropriate dict. (It is great that config files are python, allowing, in this case, a print statement to remind me which machines I'm trying to use, as you see in the output below.)

A machine with 0.12.dev: (I’m not sure exactly which version: how do I easily tell? It was installed Sep 26)

-----------------------------------------------------------------------------------------------------------------------------------------------
valhalla:~[379]$ipcluster start --profile=ssh
[IPClusterStart] Using existing profile dir: u'/home/burnett/.config/ipython/profile_ssh'
will start the engines {'tev10.phys.washington.edu': 4}
[IPClusterStart] Could not import launcher class: 'IPython.parallel.apps.launcher.SSHEngineSetLauncherControllerLauncher'
-----------------------------------------------------------------------------------------------------------------------------------------------
And 0.11, standard distribution.
-----------------------------------------------------------------------------------------------------------------------------------------------
tev11:~/analysis[825]$ipcluster start --profile=ssh &
[1] 17851
tev11:~/analysis[826]$[IPClusterStart] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_ssh'
will start the following engines: {'tev01': 4, 'tev02': 4, 'tev03': 4, 'tev04': 4, 'tev06': 4, 'tev11': 4, 'tev07': 4, 'tev08': 4, 'tev09': 4, 'tev10': 4, 'tev05': 4}
[IPClusterStart] Removing pid file: /phys/users/tburnett/.ipython/profile_ssh/pid/ipcluster.pid
[IPClusterStart] Starting ipcluster with [daemon=False]
[IPClusterStart] Creating pid file: /phys/users/tburnett/.ipython/profile_ssh/pid/ipcluster.pid
ERROR:root:Error in periodic callback
Traceback (most recent call last):
  File "/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/zmq/eventloop/ioloop.py", line 429, in _run
    self.callback()
  File "/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/ipython-0.11-py2.7.egg/IPython/parallel/apps/ipclusterapp.py", line 433, in start_controller
    self.profile_dir.location
TypeError: start() takes exactly 3 arguments (2 given)
[IPClusterStart] Starting 24 engines
INFO:IPClusterStart:Starting 24 engines
[... lots of output from the local engine start that it seems to have defaulted to.]



More information about the IPython-User mailing list