[IPython-User] starting ipcluster from inside an IPython session

Ian Stokes-Rees ijstokes@spmetric....
Fri Apr 12 17:21:43 CDT 2013


On 4/12/13 6:11 PM, MinRK wrote:

> You cannot have multiple 'Application' instances in one process.  If 
> you want to start ipcluster from IPython, it may be best to just call 
> out to the command-line with:
>
> ! ipcluster start -n 4 --daemon
>
> Then stop it later with:
>
> ! ipcluster stop
>
Right, except that I get a stack trace inside of ipcluster, and I want 
to be able to use pdb to debug it. So is the answer then for me to use 
vanilla python? Gets me part of the way, but it looks like the stack 
trace is being returned by some |exec| or perhaps even something 
happening on one of the "engine" nodes that is complaining about files 
not being available. I am running it with:

|>>>import  pdb
>>>import  IPython.parallel.apps.ipclusterappas  ipa
>>>
>>>import  sys
>>> sys.argv= ["ipcluster","start","--profile=wakari"]
>>> app = ipa.IPClusterApp.instance()
>>> app.initialize()
2013-04-13  02:17:45,234.234  [IPClusterStart] Using existing profile dir:u'/user_home/w_ijstokes/code/wakari-backend/ops/automation/ipcluster/profile_wakari'
>>> pdb.run('app.start()')|

But I still get back this error:

|2013-04-13  02:18:58.560  [IPClusterStart] sending /user_home/w_ijstokes/code/wakari-backend/ops/automation/ipcluster/profile_wakari/security/ipcontroller-client.json to2.ipcluster.wakari.io:code/wakari-backend/ops/automation/ipcluster/profile_wakari/security/ipcontroller-client.json
2013-04-13  02:18:59.082  [IPClusterStart] sending /user_home/w_ijstokes/code/wakari-backend/ops/automation/ipcluster/profile_wakari/security/ipcontroller-engine.json to2.ipcluster.wakari.io:code/wakari-backend/ops/automation/ipcluster/profile_wakari/security/ipcontroller-engine.json
ERROR:root:Errorin  delayed callback
Traceback (most recent call last):
   File"/opt/anaconda/lib/python2.7/site-packages/zmq/eventloop/ioloop.py", line554,in  _run
     self.callback()
   File"/opt/anaconda/lib/python2.7/site-packages/IPython/parallel/apps/ipclusterapp.py", line353,in  start_engines
     self.engine_launcher.start(self.n)
   File"/opt/anaconda/lib/python2.7/site-packages/IPython/parallel/apps/launcher.py", line781,in  start
     d = el.start(user=user, hostname=host)
   File"/opt/anaconda/lib/python2.7/site-packages/IPython/parallel/apps/launcher.py", line637,in  start
     super(SSHLauncher, self).start()
   File"/opt/anaconda/lib/python2.7/site-packages/IPython/parallel/apps/launcher.py", line272,in  start
     cwd=self.work_dir
   File"/opt/anaconda/lib/python2.7/subprocess.py", line679,in  __init__
     errread, errwrite)
   File"/opt/anaconda/lib/python2.7/subprocess.py", line1249,in  _execute_child
     raise  child_exception
OSError: [Errno2] No such fileor  directory|

Any suggestions how to figure out what is going wrong?

TIA!

Ian

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/ipython-user/attachments/20130412/25d0173f/attachment-0001.html 


More information about the IPython-User mailing list