<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks for the clarifications, but my complaint was really that I don’t understand why it started the engines, and then shut them down. Are those tcgetattr
messages significant?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">--Toby<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> MinRK [mailto:benjaminrk@gmail.com]
<br>
<b>Sent:</b> Sunday, October 23, 2011 14:24<br>
<b>To:</b> Toby Burnett<br>
<b>Cc:</b> ipython-user@scipy.org<br>
<b>Subject:</b> Re: [IPython-User] parallel ssh problems<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Sun, Oct 23, 2011 at 11:38, Toby Burnett <<a href="mailto:tburnett@uw.edu" target="_blank">tburnett@uw.edu</a>> wrote:<o:p></o:p></p>
<p class="MsoNormal">Sorry, after reading the instructions, I realized that I set the wrong value, but there is some confusion between the online help and instructions in the generated config-ssh/ipcluster_config.py, so I put in both lines.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Argh, when in conflict, the online docs are out of date. I'll update them now. The default config files are automatically generated from the configurable objects,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">so a fresh `ipython profile create <name> --parallel` can't be out of date.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
c.IPClusterEngines.engine_launcher_class = 'SSHEngineSetLauncher'<br>
c.IPClusterEngines.engine_launcher = 'IPython.parallel.apps.launcher.SSHEngineSetLauncher'<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Changes from 0.11-0.12:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> * added the _class to be more clear<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> * allowed launchers from IPython.parallel.apps.launcher to be specified by classname only, for convenience. In fact, you can now just specify 'SSH' or 'MPIExec', and it will resolve to 'IPython.parallel.apps.launcher.SSHFooLauncher'.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Obviously, trying to clarify things without updating the docs is not a great success. What you have is exactly right for a config file to work on both 0.11 and 0.12. I will add a deprecation warning on the old name, so that users moving
from 0.11 to 0.12 get some help, and some more detail to docs and helpstrings, to hopefully avoid future confusion.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
and I set c.SSHEngineSetLauncher.engines to {'tev01':4}, another machine from the one I ran ipcluster<br>
The results follow: the last line is very confusing; I have no idea where it got the non-extentent machine names.<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">ha, that's just a poor choice on my part. When you start multiple engines on a single host, their keys in the dict that tracks them (which you are seeing in the log message) will be 'host0', 'host1', 'host2', etc.. Obviously, that doesn't
sit well with nodeNN machine naming, because they still look like machine names. I'll add a '/' separator, so it's clearer that these are four engines on 'tev01', not one engine each on 'tev011' etc.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
tev11:~/analysis[878]$ipcluster start --profile=ssh &<o:p></o:p></p>
<div>
<p class="MsoNormal">[IPClusterStart] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_ssh'<br>
will start the following engines: {'tev01': 4}<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">[IPClusterStart] Starting ipcluster with [daemon=False]<br>
[IPClusterStart] Creating pid file: /phys/users/tburnett/.ipython/profile_ssh/pid/ipcluster.pid<o:p></o:p></p>
</div>
<p class="MsoNormal">[IPClusterStart] Starting LocalControllerLauncher: ['/phys/users/olsont/TEV/Glast/python27/bin/python2.7', u'/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/ipython-0.11-py2.7.egg/IPython/parallel/apps/ipcontrollerapp.py',
'--log-to-file', '--log-level=20', u'--profile-dir=/phys/users/tburnett/.ipython/profile_ssh']<br>
[IPClusterStart] Process '/phys/users/olsont/TEV/Glast/python27/bin/python2.7' started: 20849<br>
[IPClusterStart] [IPControllerApp] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_ssh'<br>
[IPClusterStart] Scheduler started [leastload]<br>
[IPClusterStart] Starting 24 engines<br>
[IPClusterStart] Process 'ssh' started: 20868<br>
[IPClusterStart] Starting SSHEngineSetLauncher: ['ssh', '-tt', u'tburnett@tev01', '/phys/users/olsont/TEV/Glast/python27/bin/python2.7', u'/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/ipython-0.11-py2.7.egg/IPython/parallel/apps/ipengineapp.py',
'--log-to-file', '--log-level=20']<br>
[IPClusterStart] Process 'ssh' started: 20869<br>
[IPClusterStart] Process 'ssh' started: 20870<br>
[IPClusterStart] Process 'ssh' started: 20871<br>
[IPClusterStart] Process 'engine set' started: [None, None, None, None]<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_default'<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_default'<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_default'<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u'/phys/users/tburnett/.ipython/profile_default'<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process 'ssh' stopped: {'pid': 20870, 'exit_code': 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process 'ssh' stopped: {'pid': 20869, 'exit_code': 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process 'ssh' stopped: {'pid': 20868, 'exit_code': 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process 'ssh' stopped: {'pid': 20871, 'exit_code': 255}<br>
[IPClusterStart] Process 'engine set' stopped: {'tev012': {'pid': 20870, 'exit_code': 255}, 'tev013': {'pid': 20871, 'exit_code': 255}, 'tev010': {'pid': 20868, 'exit_code': 255}, 'tev011': {'pid': 20869, 'exit_code': 255}}<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
_______________________________________________<br>
IPython-User mailing list<br>
<a href="mailto:IPython-User@scipy.org" target="_blank">IPython-User@scipy.org</a><br>
<a href="http://mail.scipy.org/mailman/listinfo/ipython-user" target="_blank">http://mail.scipy.org/mailman/listinfo/ipython-user</a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>