<br><br><div class="gmail_quote">On Sun, Oct 23, 2011 at 11:38, Toby Burnett <span dir="ltr">&lt;<a href="mailto:tburnett@uw.edu" target="_blank">tburnett@uw.edu</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


Sorry, after reading the instructions, I realized that I set the wrong value, but there is some confusion between the online help and instructions in the generated config-ssh/ipcluster_config.py, so I put in both lines<span style="background-color:transparent">.</span></blockquote>


<div><br></div><div>Argh, when in conflict, the online docs are out of date.  I&#39;ll update them now.  The default config files are automatically generated from the configurable objects,</div><div>so a fresh `ipython profile create &lt;name&gt; --parallel` can&#39;t be out of date.</div>


<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
c.IPClusterEngines.engine_launcher_class = &#39;SSHEngineSetLauncher&#39;<br>
c.IPClusterEngines.engine_launcher = &#39;IPython.parallel.apps.launcher.SSHEngineSetLauncher&#39;<br></blockquote><div><br></div><div>Changes from 0.11-0.12:</div><div>  * added the _class to be more clear</div><div>  * allowed launchers from <span style="background-color:transparent">IPython.parallel.apps.</span><span style="background-color:transparent">launcher to be specified by classname only, for convenience.  In fact, you can now just specify &#39;SSH&#39; or &#39;MPIExec&#39;, and it will resolve to </span><span style="background-color:transparent">&#39;IPython.parallel.apps.</span><span style="background-color:transparent">launcher.SSHFooLauncher&#39;.</span></div>


<div><span style="background-color:transparent"><br></span></div><div><span style="background-color:transparent">Obviously, trying to clarify things without updating the docs is not a great success.  What you have is exactly right for a config file to work on both 0.11 and 0.12.  I will add a deprecation warning on the old name, so that users moving from 0.11 to 0.12 get some help, and some more detail to docs and helpstrings, to hopefully avoid future confusion.</span></div>

<div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
and I set c.SSHEngineSetLauncher.engines to {&#39;tev01&#39;:4}, another machine from the one I ran ipcluster<br>
The results follow: the last line is very confusing; I have no idea where it got the non-extentent machine names.<br></blockquote><div><br></div><div>ha, that&#39;s just a poor choice on my part.  When you start multiple engines on a single host, their keys in the dict that tracks them (which you are seeing in the log message) will be &#39;host0&#39;, &#39;host1&#39;, &#39;host2&#39;, etc..  Obviously, that doesn&#39;t sit well with nodeNN machine naming, because they still look like machine names.  I&#39;ll add a &#39;/&#39; separator, so it&#39;s clearer that these are four engines on &#39;tev01&#39;, not one engine each on &#39;tev011&#39; etc.</div>


<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
tev11:~/analysis[878]$ipcluster start --profile=ssh &amp;<br>
<div>[IPClusterStart] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_ssh&#39;<br>
will start the following engines: {&#39;tev01&#39;: 4}<br>
</div><div>[IPClusterStart] Starting ipcluster with [daemon=False]<br>
[IPClusterStart] Creating pid file: /phys/users/tburnett/.ipython/profile_ssh/pid/ipcluster.pid<br>
</div>[IPClusterStart] Starting LocalControllerLauncher: [&#39;/phys/users/olsont/TEV/Glast/python27/bin/python2.7&#39;, u&#39;/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/ipython-0.11-py2.7.egg/IPython/parallel/apps/ipcontrollerapp.py&#39;, &#39;--log-to-file&#39;, &#39;--log-level=20&#39;, u&#39;--profile-dir=/phys/users/tburnett/.ipython/profile_ssh&#39;]<br>



[IPClusterStart] Process &#39;/phys/users/olsont/TEV/Glast/python27/bin/python2.7&#39; started: 20849<br>
[IPClusterStart] [IPControllerApp] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_ssh&#39;<br>
[IPClusterStart] Scheduler started [leastload]<br>
[IPClusterStart] Starting 24 engines<br>
[IPClusterStart] Process &#39;ssh&#39; started: 20868<br>
[IPClusterStart] Starting SSHEngineSetLauncher: [&#39;ssh&#39;, &#39;-tt&#39;, u&#39;tburnett@tev01&#39;, &#39;/phys/users/olsont/TEV/Glast/python27/bin/python2.7&#39;, u&#39;/phys/users/olsont/TEV/Glast/python27/lib/python2.7/site-packages/ipython-0.11-py2.7.egg/IPython/parallel/apps/ipengineapp.py&#39;, &#39;--log-to-file&#39;, &#39;--log-level=20&#39;]<br>



[IPClusterStart] Process &#39;ssh&#39; started: 20869<br>
[IPClusterStart] Process &#39;ssh&#39; started: 20870<br>
[IPClusterStart] Process &#39;ssh&#39; started: 20871<br>
[IPClusterStart] Process &#39;engine set&#39; started: [None, None, None, None]<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] tcgetattr: Invalid argument<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_default&#39;<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_default&#39;<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_default&#39;<br>
[IPClusterStart] [IPEngineApp] Using existing profile dir: u&#39;/phys/users/tburnett/.ipython/profile_default&#39;<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 20870, &#39;exit_code&#39;: 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 20869, &#39;exit_code&#39;: 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 20868, &#39;exit_code&#39;: 255}<br>
[IPClusterStart] Connection to tev01 closed.<br>
[IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 20871, &#39;exit_code&#39;: 255}<br>
[IPClusterStart] Process &#39;engine set&#39; stopped: {&#39;tev012&#39;: {&#39;pid&#39;: 20870, &#39;exit_code&#39;: 255}, &#39;tev013&#39;: {&#39;pid&#39;: 20871, &#39;exit_code&#39;: 255}, &#39;tev010&#39;: {&#39;pid&#39;: 20868, &#39;exit_code&#39;: 255}, &#39;tev011&#39;: {&#39;pid&#39;: 20869, &#39;exit_code&#39;: 255}}<br>



<div><div></div><div><br>
_______________________________________________<br>
IPython-User mailing list<br>
<a href="mailto:IPython-User@scipy.org" target="_blank">IPython-User@scipy.org</a><br>
<a href="http://mail.scipy.org/mailman/listinfo/ipython-user" target="_blank">http://mail.scipy.org/mailman/listinfo/ipython-user</a><br>
</div></div></blockquote></div><br>