[IPython-User] Engines stop when using "ssh" profile

Jeremy Conlin jlconlin@gmail....
Tue Dec 13 11:48:48 CST 2011


I am trying to get an ssh cluster going on some machines here. I have
attempted to follow the instructions given here:

http://ipython.org/ipython-doc/stable/parallel/parallel_process.html#configuring-an-ipython-cluster

I'm running into trouble in that my engines stop shortly (i.e., 2
seconds) after they are started. The log files indicate that the
engines are not "registered" within 2.0 seconds.

My cluster consists of my desktop (the controller where I want to
start 4 engines) and two other remote machines (with 8 engines on each
machine, hopefully). All are OS X 10.6 machines and the file locations
in the configuration files are seen by all the machines.

I have attached the controller log, a sample engine log showing the
failure, a screen capture of the ipcluster command and my
ipcluster_config.py for this profile. I have removed all the comments
from the config file to keep it short.

Can someone help me figure out why my engines are failing?

Thanks,
Jeremy
-------------- next part --------------
$ ipcluster start --profile=ssh
[IPClusterStart] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] Starting ipcluster with [daemon=False]
[IPClusterStart] Creating pid file: /home/jlconlin/.ipython/profile_ssh/pid/ipcluster.pid
[IPClusterStart] Starting LocalControllerLauncher: ['/home/jlconlin/Library/EPD/2.7-64/bin/python', u'/home/jlconlin/Library/EPD/2.7-64/lib/python2.7/site-packages/IPython/parallel/apps/ipcontrollerapp.py', '--log-to-file', '--log-level=20', u'--profile-dir=/home/jlconlin/.ipython/profile_ssh']
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83529
[IPClusterStart] Starting 8 engines
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83531
[IPClusterStart] Starting LocalEngineSetLauncher: ['/home/jlconlin/Library/EPD/2.7-64/bin/python', u'/home/jlconlin/Library/EPD/2.7-64/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py', '--log-to-file', '--log-level=20', u'--profile-dir=/home/jlconlin/.ipython/profile_ssh']
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83532
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83533
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83534
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83535
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83536
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83537
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' started: 83538
[IPClusterStart] Process 'engine set' started: [None, None, None, None, None, None, None, None]
[IPClusterStart] [IPControllerApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/home/jlconlin/.ipython/profile_ssh'
[IPClusterStart] Scheduler started [leastload]
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83536, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83531, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83535, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83538, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83532, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83534, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83537, 'exit_code': 255}
[IPClusterStart] Process '/home/jlconlin/Library/EPD/2.7-64/bin/python' stopped: {'pid': 83533, 'exit_code': 255}
[IPClusterStart] Process 'engine set' stopped: {0: {'pid': 83531, 'exit_code': 255}, 1: {'pid': 83532, 'exit_code': 255}, 2: {'pid': 83533, 'exit_code': 255}, 3: {'pid': 83534, 'exit_code': 255}, 4: {'pid': 83535, 'exit_code': 255}, 5: {'pid': 83536, 'exit_code': 255}, 6: {'pid': 83537, 'exit_code': 255}, 7: {'pid': 83538, 'exit_code': 255}}
^C[IPClusterStart] IPython cluster: stopping
[IPClusterStart] Stopping Engines...
[IPClusterStart] Removing pid file: /home/jlconlin/.ipython/profile_ssh/pid/ipcluster.pid
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ipcluster_config.py
Type: application/octet-stream
Size: 1139 bytes
Desc: not available
Url : http://mail.scipy.org/pipermail/ipython-user/attachments/20111213/7813f51a/attachment.obj 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ipcontroller-83529.log
Type: application/octet-stream
Size: 388 bytes
Desc: not available
Url : http://mail.scipy.org/pipermail/ipython-user/attachments/20111213/7813f51a/attachment-0001.obj 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ipengine-83531.log
Type: application/octet-stream
Size: 225 bytes
Desc: not available
Url : http://mail.scipy.org/pipermail/ipython-user/attachments/20111213/7813f51a/attachment-0002.obj 


More information about the IPython-User mailing list