[IPython-User] IPython cluster: stopping

Ariel Rokem arokem@gmail....
Fri Jan 27 17:57:26 CST 2012


Hi Min,

Thanks for taking a look - I will have to try something else then.

Apologies - I didn't mean to respond only to you. I am replying back to the
list, so that this is up for posterity (and google).

Thanks again,

Ariel

On Fri, Jan 27, 2012 at 3:44 PM, MinRK <benjaminrk@gmail.com> wrote:

> Thanks for the report.
>
> It looks like your controller is being killed (hence exit status=-9),
> and ipcluster knows that when you don't have a controller anymore,
> your engines aren't useful so they get cleaned up.  I don't know what
> would be killing your controller, but if, as you say, memory is
> skyrocketing, something could be killing it to prevent gobbling up
> resources.  I don't know how you would find that out.  If you are
> using current master, you might use `--nodb` to disable to the Hub's
> logging of tasks, depending on your usage.
>
> -MinRK
>
> On Fri, Jan 27, 2012 at 15:05, Ariel Rokem <arokem@gmail.com> wrote:
> > On Fri, Jan 27, 2012 at 12:34 PM, MinRK <benjaminrk@gmail.com> wrote:
> >>
> >>
> >> Can you post the entire message when the cluster is stopping? Or
> >> better yet the entire output of ipcluster adding `--debug`?
> >>
> > celadon:~  $ipcluster start --debug
> > [IPClusterStart] Config changed:
> > [IPClusterStart] {'Application': {'log_level': 10}}
> > [IPClusterStart] Using existing profile dir:
> > u'/home/arokem/.config/ipython/profile_default'
> > [IPClusterStart] Searching path [u'/white/u6/arokem',
> > u'/home/arokem/.config/ipython/profile_default'] for config files
> > [IPClusterStart] Attempting to load config file: ipython_config.py
> > [IPClusterStart] Loaded config file:
> > /home/arokem/.config/ipython/profile_default/ipython_config.py
> > [IPClusterStart] Attempting to load config file: ipcluster_config.py
> > [IPClusterStart] Loaded config file:
> > /home/arokem/.config/ipython/profile_default/ipcluster_config.py
> > 2012-01-27 12:54:58.974 [IPClusterStart] Starting ipcluster with
> > [daemon=False]
> > 2012-01-27 12:54:58.975 [IPClusterStart] Creating pid file:
> > /home/arokem/.config/ipython/profile_default/pid/ipcluster.pid
> > 2012-01-27 12:54:58.976 [IPClusterStart] Starting Controller with
> > LocalControllerLauncher
> > 2012-01-27 12:54:58.976 [IPClusterStart] Starting
> LocalControllerLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipcontrollerapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:54:58.981 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24446
> > 2012-01-27 12:54:59.837 [IPClusterStart] [IPControllerApp] Using
> existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:54:59.975 [IPClusterStart] Starting 8 Engines with
> > LocalEngineSetLauncher
> > 2012-01-27 12:54:59.976 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:54:59.981 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24453
> > 2012-01-27 12:55:00.082 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.087 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24454
> > 2012-01-27 12:55:00.189 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.193 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24467
> > 2012-01-27 12:55:00.294 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.298 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24468
> > 2012-01-27 12:55:00.400 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.403 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24469
> > 2012-01-27 12:55:00.505 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.509 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24470
> > 2012-01-27 12:55:00.610 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.615 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24471
> > 2012-01-27 12:55:00.716 [IPClusterStart] Starting LocalEngineLauncher:
> > ['/usr/bin/python',
> >
> u'/home/arokem/usr/local/lib/python2.7/site-packages/IPython/parallel/apps/ipengineapp.py',
> > '--profile-dir', u'/home/arokem/.config/ipython/profile_default',
> > '--log-to-file', '--log-level=20']
> > 2012-01-27 12:55:00.721 [IPClusterStart] Process '/usr/bin/python'
> started:
> > 24472
> > 2012-01-27 12:55:00.721 [IPClusterStart] Process 'engine set' started:
> > [None, None, None, None, None, None, None, None]
> > 2012-01-27 12:55:00.722 [IPClusterStart] 2012-01-27 12:55:00.122
> [scheduler]
> > Scheduler started [leastload]
> > 2012-01-27 12:55:00.961 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.196 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.357 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.401 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.511 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.571 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.666 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:01.730 [IPClusterStart] [IPEngineApp] Using existing
> > profile dir: u'/home/arokem/.config/ipython/profile_default'
> > 2012-01-27 12:55:30.722 [IPClusterStart] Engines appear to have started
> > successfully
> > 2012-01-27 13:31:19.203 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24446, 'exit_code': -9}
> > 2012-01-27 13:31:20.268 [IPClusterStart] IPython cluster: stopping
> > 2012-01-27 13:31:20.282 [IPClusterStart] Stopping Engines...
> > 2012-01-27 13:31:20.556 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24453, 'exit_code': -9}
> > 2012-01-27 13:31:20.610 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24454, 'exit_code': -9}
> > 2012-01-27 13:31:20.625 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24467, 'exit_code': -9}
> > 2012-01-27 13:31:20.632 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24468, 'exit_code': -9}
> > 2012-01-27 13:31:23.110 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24472, 'exit_code': -2}
> > 2012-01-27 13:31:23.169 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24469, 'exit_code': -2}
> > 2012-01-27 13:31:23.222 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24470, 'exit_code': -2}
> > 2012-01-27 13:31:23.222 [IPClusterStart] Process '/usr/bin/python'
> stopped:
> > {'pid': 24471, 'exit_code': -2}
> > 2012-01-27 13:31:23.222 [IPClusterStart] Process 'engine set' stopped:
> {0:
> > {'pid': 24453, 'exit_code': -9}, 1: {'pid': 24454, 'exit_code': -9}, 2:
> > {'pid': 24467, 'exit_code': -9}, 3: {'pid': 24468, 'exit_code': -9}, 4:
> > {'pid': 24469, 'exit_code': -2}, 5: {'pid': 24470, 'exit_code': -2}, 6:
> > {'pid': 24471, 'exit_code': -2}, 7: {'pid': 24472, 'exit_code': -2}}
> > 2012-01-27 13:31:23.702 [IPClusterStart] Removing pid file:
> > /home/arokem/.config/ipython/profile_default/pid/ipcluster.pid
> > celadon:~  $
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.scipy.org/pipermail/ipython-user/attachments/20120127/d8ccd509/attachment-0001.html 


More information about the IPython-User mailing list