Holy crap, this is a one-character typo preventing the default value for remote_profile_dir from being derived from the given profile_dir, leaving it as an empty string.  Sorry about that!<br><br>You can workaround this by setting the remote profile dir explicitly with:<br>

<br>c.SSHEngineSetLauncher.remote_profile_dir=&#39;.ipython/profile_ssh&#39;<div><br></div><div>(or similar)<br><br><a href="https://github.com/ipython/ipython/pull/2163">PR #2163</a> (one-character patch) should fix it.  Can you confirm that?<br>

<br>-MinRK<br><br>On Wed, Jul 18, 2012 at 9:47 AM, M. Wimmer &lt;<a href="mailto:wimmer.mike@gmail.com">wimmer.mike@gmail.com</a>&gt; wrote:<br>&gt; Dear all,<br>&gt;<br>&gt; Having freshly installed ipython 0.13 I tried to get an ipython parallel cluster<br>

&gt; running via ssh. For this I followed precisely the documentation and did<br>&gt;<br>&gt;  ipython profile create --parallel --profile=ssh<br>&gt;<br>&gt; and modified, according to the docs, in ipcluster_config.py the lines<br>

&gt;<br>&gt;  c.IPClusterEngines.engine_launcher_class = &#39;SSHEngineSetLauncher&#39;<br>&gt;<br>&gt;  c.SSHEngineSetLauncher.engines = {&#39;xxx049&#39;: 1}<br>&gt;<br>&gt; Trying to start a cluster then misarebly fails<br>

&gt;<br>&gt;  ipcluster start --profile=ssh --debug<br>&gt;<br>&gt; and I&#39;ve added the debug output below. The failed `scp`-commands I can avoid by<br>&gt; writing in ipcluster_config.py<br>&gt;<br>&gt;  c.SSHLauncher.to_send = []<br>

&gt;  c.SSHLauncher.to_fetch = []<br>&gt;<br>&gt; As you can see from the logfile below, the engines are not started because of<br>&gt; arguments (&quot;&quot;--profile ...&quot;) being added to the python command. I can change the<br>

&gt; engine_cmd to `ipengine` but then I ran into other troubles, so I wanted to<br>&gt; discuss this step by step.<br>&gt;<br>&gt; What am I doing wrong? What should be added to the docs?<br>&gt;<br>&gt; - Michael<br>&gt;<br>

&gt; Logfile:<br>&gt; ---------------------------------------------------------<br>&gt; 2012-07-18 16:40:33,001.001 [IPClusterStart] Config changed:<br>&gt; 2012-07-18 16:40:33,001.001 [IPClusterStart] {&#39;Application&#39;: {&#39;log_level&#39;: 10},<br>

&gt;  &#39;BaseIPythonApplication&#39;: {&#39;profile&#39;: u&#39;ssh&#39;}}<br>&gt; 2012-07-18 16:40:33,003.003 [IPClusterStart] Using existing profile dir:<br>&gt;  u&#39;/home/wimmer/.ipython/profile_ssh&#39;<br>&gt; 2012-07-18 16:40:33,003.003 [IPClusterStart] Searching path [u&#39;/home/wimmer&#39;,<br>

&gt;  u&#39;/home/wimmer/.ipython/profile_ssh&#39;] for config files<br>&gt; 2012-07-18 16:40:33,003.003 [IPClusterStart] Attempting to load config file:<br>&gt;  ipython_config.py<br>&gt; 2012-07-18 16:40:33,005.005 [IPClusterStart] Loaded config file:<br>

&gt;  /home/wimmer/.ipython/profile_ssh/ipython_config.py<br>&gt; 2012-07-18 16:40:33,005.005 [IPClusterStart] Attempting to load config file:<br>&gt;  ipcluster_config.py<br>&gt; 2012-07-18 16:40:33,007.007 [IPClusterStart] Loaded config file:<br>

&gt;  /home/wimmer/.ipython/profile_ssh/ipcluster_config.py<br>&gt; 2012-07-18 16:40:33,009.009 [IPClusterStart] Config changed:<br>&gt; 2012-07-18 16:40:33,009.009 [IPClusterStart] {&#39;Application&#39;: {&#39;log_level&#39;: 10},<br>

&gt;  &#39;BaseIPythonApplication&#39;: {&#39;profile&#39;: u&#39;ssh&#39;}, &#39;IPClusterEngines&#39;:<br>&gt;  {&#39;engine_launcher_class&#39;: &#39;SSHEngineSetLauncher&#39;}, &#39;SSHEngineSetLauncher&#39;:<br>&gt;  {&#39;engines&#39;: {&#39;xxx049&#39;: 2}}, &#39;ProfileDir&#39;: {}}<br>

&gt; 2012-07-18 16:40:33.012 [IPClusterStart] Starting ipcluster with [daemon=False]<br>&gt; 2012-07-18 16:40:33.012 [IPClusterStart] Creating pid file:<br>&gt;  /home/wimmer/.ipython/profile_ssh/pid/ipcluster.pid<br>&gt; 2012-07-18 16:40:33.013 [IPClusterStart] Starting Controller with<br>

&gt;  LocalControllerLauncher<br>&gt; 2012-07-18 16:40:33.013 [IPClusterStart] Starting LocalControllerLauncher:<br>&gt;  [&#39;/usr/bin/python&#39;, &#39;-c&#39;, &#39;from IPython.parallel.apps.ipcontrollerapp import<br>

&gt;  launch_new_instance; launch_new_instance()&#39;, &#39;--profile-dir&#39;,<br>&gt;  u&#39;/home/wimmer/.ipython/profile_ssh&#39;, &#39;--cluster-id&#39;, u&#39;&#39;, &#39;--log-to-file&#39;,<br>&gt;  &#39;--log-level=20&#39;]<br>

&gt; 2012-07-18 16:40:33.020 [IPClusterStart] Process &#39;/usr/bin/python&#39; started:<br>&gt;  16130<br>&gt; 2012-07-18 16:40:33.747 [IPClusterStart] 2012-07-18 16:40:33,746.746<br>&gt;  [IPControllerApp] Using existing profile dir: u&#39;/home/wimmer/.ipython<br>

&gt;  /profile_ssh&#39;<br>&gt; 2012-07-18 16:40:34.012 [IPClusterStart] Starting 2 Engines with<br>&gt;  SSHEngineSetLauncher<br>&gt; 2012-07-18 16:40:34.017 [IPClusterStart] waiting for<br>&gt;  /home/wimmer/.ipython/profile_ssh/security/ipcontroller-client.json<br>

&gt; 2012-07-18 16:40:35.021 [IPClusterStart] sending<br>&gt;  /home/wimmer/.ipython/profile_ssh/security/ipcontroller-client.json to<br>&gt;  xxx049:security/ipcontroller-client.json<br>&gt;  scp: security/ipcontroller-client.json: No such file or directory<br>

&gt; 2012-07-18 16:40:36.792 [IPClusterStart] sending<br>&gt;  /home/wimmer/.ipython/profile_ssh/security/ipcontroller-engine.json to<br>&gt;  xxx049:security/ipcontroller-engine.json<br>&gt;  scp: security/ipcontroller-engine.json: No such file or directory<br>

&gt; 2012-07-18 16:40:37.957 [IPClusterStart] Starting SSHEngineLauncher: [&#39;ssh&#39;,<br>&gt;  &#39;-tt&#39;, u&#39;xxx049&#39;, &#39;/usr/bin/python&#39;, &#39;-c&#39;, &#39;from<br>&gt;  IPython.parallel.apps.ipengineapp import launch_new_instance;<br>

&gt;  launch_new_instance()&#39;, &#39;--profile-dir&#39;, u&#39;&#39;, &#39;--log-to-file&#39;,<br>&gt;  &#39;--log-level=20&#39;]<br>&gt; 2012-07-18 16:40:37.969 [IPClusterStart] Process &#39;ssh&#39; started: 16235<br>

&gt; 2012-07-18 16:40:38.075 [IPClusterStart] Starting SSHEngineLauncher: [&#39;ssh&#39;,<br>&gt;  &#39;-tt&#39;, u&#39;xxx049&#39;, &#39;/usr/bin/python&#39;, &#39;-c&#39;, &#39;from<br>&gt;  IPython.parallel.apps.ipengineapp import launch_new_instance;<br>

&gt;  launch_new_instance()&#39;, &#39;--profile-dir&#39;, u&#39;&#39;, &#39;--log-to-file&#39;,<br>&gt;  &#39;--log-level=20&#39;]<br>&gt; 2012-07-18 16:40:38.085 [IPClusterStart] Process &#39;ssh&#39; started: 16237<br>

&gt; 2012-07-18 16:40:38.086 [IPClusterStart] Process &#39;engine set&#39; started: [None,<br>&gt;  None]<br>&gt; 2012-07-18 16:40:38.086 [IPClusterStart] 2012-07-18 16:40:34.055 [scheduler]<br>&gt;  Scheduler started [leastload]<br>

&gt; 2012-07-18 16:40:39.249 [IPClusterStart] bash: -c: line 0: syntax error near<br>&gt;  unexpected token `--profile-dir&#39;<br>&gt; 2012-07-18 16:40:39.249 [IPClusterStart] Connection to xxx049 closed.<br>&gt; 2012-07-18 16:40:39.250 [IPClusterStart] bash: -c: line 0: `/usr/bin/python -c<br>

&gt;  from IPython.parallel.apps.ipengineapp import launch_new_instance;<br>&gt;  launch_new_instance() --profile-dir  --log-to-file --log-level=20&#39;<br>&gt; 2012-07-18 16:40:39.273 [IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 16235,<br>

&gt;  &#39;exit_code&#39;: 1}<br>&gt; 2012-07-18 16:40:39.451 [IPClusterStart] bash: -c: line 0: syntax error near<br>&gt;  unexpected token `--profile-dir&#39;<br>&gt; 2012-07-18 16:40:39.451 [IPClusterStart] Connection to xxx049 closed.<br>

&gt; 2012-07-18 16:40:39.452 [IPClusterStart] bash: -c: line 0: `/usr/bin/python -c<br>&gt;  from IPython.parallel.apps.ipengineapp import launch_new_instance;<br>&gt;  launch_new_instance() --profile-dir  --log-to-file --log-level=20&#39;<br>

&gt; 2012-07-18 16:40:39.455 [IPClusterStart] Process &#39;ssh&#39; stopped: {&#39;pid&#39;: 16237,<br>&gt;  &#39;exit_code&#39;: 1}<br>&gt; 2012-07-18 16:40:39.455 [IPClusterStart] Process &#39;engine set&#39; stopped:<br>

&gt;  {&#39;xxx049/0&#39;: {&#39;pid&#39;: 16235, &#39;exit_code&#39;: 1}, &#39;xxx049/1&#39;: {&#39;pid&#39;: 16237,<br>&gt;  &#39;exit_code&#39;: 1}}<br>&gt; 2012-07-18 16:40:39.455 [IPClusterStart]<br>&gt;             Engines shutdown early, they probably failed to connect.<br>

&gt;<br>&gt;             Check the engine log files for output.<br>&gt;<br>&gt;             If your controller and engines are not on the same machine, you probably<br>&gt;             have to instruct the controller to listen on an interface other than<br>

&gt; localhost.<br>&gt;<br>&gt;             You can set this by adding &quot;--ip=&#39;*&#39;&quot; to your<br>&gt; ControllerLauncher.controller_args.<br>&gt;<br>&gt;             Be sure to read our security docs before instructing your controller<br>

&gt; to listen on<br>&gt;             a public interface.<br>&gt;<br>&gt; 2012-07-18 16:40:39.456 [IPClusterStart] IPython cluster: stopping<br>&gt; 2012-07-18 16:40:39.553 [IPClusterStart] Process &#39;/usr/bin/python&#39; stopped:<br>

&gt;  {&#39;pid&#39;: 16130, &#39;exit_code&#39;: 0}<br>&gt; 2012-07-18 16:40:42.458 [IPClusterStart] Removing pid file:<br>&gt;  /home/wimmer/.ipython/profile_ssh/pid/ipcluster.pid<br>&gt;<br>&gt;<br>&gt; _______________________________________________<br>

&gt; IPython-User mailing list<br>&gt; <a href="mailto:IPython-User@scipy.org">IPython-User@scipy.org</a><br>&gt; <a href="http://mail.scipy.org/mailman/listinfo/ipython-user">http://mail.scipy.org/mailman/listinfo/ipython-user</a><br>

<br></div>