[IPython-User] Can't get ipcluster to run on LAN

MinRK benjaminrk@gmail....
Wed Aug 8 17:10:29 CDT 2012


Arg, it looks like the pipes.quote fix in
#2126<https://github.com/ipython/ipython/pull/2126> should
have been applied to SSH as well.  The workaround for this one is to
manually specify `c.SSHEngineSetLauncher.engine_cmd = ['ipengine']`, which
won't need to be quoted.

This should be fixed by PR #2270<https://github.com/ipython/ipython/pull/2270>

There's also clearly another bug in ipengine, where disambiguation of ip=*
with location={not local}, where it's coming up with localhost instead of
location.  The workaround for this is to explicitly use an engine-visible
IP on the controller (ip=1.2.3.4).  This part does not affect 0.13, and
should be fixed by PR #2269 <https://github.com/ipython/ipython/pull/2269>.


So, to sum up (hopefully), for 0.13 the necessary workarounds for 0.13:

SSHEngineSetLauncher.engine_cmd = ['ipengine']
SSHLauncher.remote_profile_dir = '.ipython/profile_ssh' # as appropriate
for your own profile

-MinRK

On Wed, Aug 8, 2012 at 2:08 PM, Johann Rohwer <jr@sun.ac.za> wrote:

> **
>
> On Wednesday 08 August 2012 11:55:48 Min RK wrote:
>
> > Ah, it sounds like this is #2163, which should be fixed in master.
>
> >
>
> > Can you do
>
> >
>
> > A. Set remote_profile_dir explicitly in your ipcluster_config.py
>
> > B. update to master
>
> >
>
> > And see if either/both fix the issue?
>
>
>
> OK that took care of the profile directory and copying of the json files
> :-)
>
>
>
> However, I'm getting another error which prevents ipcluster from starting.
> Here is the log excerpt. Using persistent json files. If I just run
> separate commands "ipcontroller --profile home" on 192.168.0.4 and
> "ipengine --profile home" on 192.168.0.2 , then the engine connects without
> problems. But with ipcluster it complains about a bash syntax error near
> unexpected token `--profile-dir' (see below).
>
>
>
> This is on master, but seeing the same error on 0.13.
>
>
>
> --Johann
>
>
>
> ----------------------------------------
>
>
>
> $ ipcluster start --profile=home --log-level=DEBUG
>
>
>
> >>>snip<<<
>
> 2012-08-08 23:01:27.679 [IPClusterStart] sending
> /home/jr/.config/ipython/profile_home/security/ipcontroller-client.json to
> 192.168.0.2:.config/ipython/profile_home/security/ipcontroller-client.json
>
> 2012-08-08 23:01:29.001 [IPClusterStart] sending
> /home/jr/.config/ipython/profile_home/security/ipcontroller-engine.json to
> 192.168.0.2:.config/ipython/profile_home/security/ipcontroller-engine.json
>
> 2012-08-08 23:01:30.312 [IPClusterStart] Starting SSHEngineLauncher:
> ['ssh', '-tt', u'192.168.0.2', '/usr/bin/python', '-c', 'from
> IPython.parallel.apps.ipengineapp import launch_new_instance;
> launch_new_instance()', '--profile-dir', u'.config/ipython/profile_home',
> '--log-to-file', '--log-level=20']
>
> 2012-08-08 23:01:30.325 [IPClusterStart] Process 'ssh' started: 8272
>
> 2012-08-08 23:01:30.430 [IPClusterStart] Starting SSHEngineLauncher:
> ['ssh', '-tt', u'192.168.0.2', '/usr/bin/python', '-c', 'from
> IPython.parallel.apps.ipengineapp import launch_new_instance;
> launch_new_instance()', '--profile-dir', u'.config/ipython/profile_home',
> '--log-to-file', '--log-level=20']
>
> 2012-08-08 23:01:30.442 [IPClusterStart] Process 'ssh' started: 8273
>
> 2012-08-08 23:01:30.444 [IPClusterStart] Process 'engine set' started:
> [None, None]
>
> 2012-08-08 23:01:32.182 [IPClusterStart] bash: -c: line 0: syntax error
> near unexpected token `--profile-dir'
>
> 2012-08-08 23:01:32.183 [IPClusterStart] Connection to 192.168.0.2 closed.
>
> 2012-08-08 23:01:32.183 [IPClusterStart] bash: -c: line 0:
> `/usr/bin/python -c from IPython.parallel.apps.ipengineapp import
> launch_new_instance; launch_new_instance() --profile-dir
> .config/ipython/profile_home --log-to-file --log-level=20'
>
> 2012-08-08 23:01:32.184 [IPClusterStart] Process 'ssh' stopped: {'pid':
> 8272, 'exit_code': 1}
>
> 2012-08-08 23:01:32.279 [IPClusterStart] bash: -c: line 0: syntax error
> near unexpected token `--profile-dir'
>
> 2012-08-08 23:01:32.280 [IPClusterStart] bash: -c: line 0:
> `/usr/bin/python -c from IPython.parallel.apps.ipengineapp import
> launch_new_instance; launch_new_instance() --profile-dir
> .config/ipython/profile_home --log-to-file --log-level=20'
>
> 2012-08-08 23:01:32.280 [IPClusterStart] Connection to 192.168.0.2 closed.
>
> 2012-08-08 23:01:32.280 [IPClusterStart] Process 'ssh' stopped: {'pid':
> 8273, 'exit_code': 1}
>
> 2012-08-08 23:01:32.281 [IPClusterStart] Process 'engine set' stopped: {'
> 192.168.0.2/1': {'pid': 8273, 'exit_code': 1}, '192.168.0.2/0': {'pid':
> 8272, 'exit_code': 1}}
>
> 2012-08-08 23:01:32.281 [IPClusterStart]
>
> Engines shutdown early, they probably failed to connect.
>
>  Check the engine log files for output.
>
>  If your controller and engines are not on the same machine, you probably
>
> have to instruct the controller to listen on an interface other than
> localhost.
>
>  You can set this by adding "--ip='*'" to your
> ControllerLauncher.controller_args.
>
>  Be sure to read our security docs before instructing your controller to
> listen on
>
> a public interface.
>
>  2012-08-08 23:01:32.282 [IPClusterStart] IPython cluster: stopping
>
> 2012-08-08 23:01:32.336 [IPClusterStart] Process '/usr/bin/python'
> stopped: {'pid': 8249, 'exit_code': 0}
>
>
>
>
>
> _______________________________________________
> IPython-User mailing list
> IPython-User@scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-user
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/ipython-user/attachments/20120808/91757008/attachment.html 


More information about the IPython-User mailing list