[SciPy-user] running scipy code simultaneously on several machines
Sun Oct 14 15:39:15 CDT 2007
On 10/14/07, Brian Granger <email@example.com> wrote:
> Robert gives the link to more details about how to start everything.
> But if you are just running on a single machine, the easiest way is to
> just do:
> $ ipcluster -n 4
> >From the shell after installing ipython1. Let us know if you have
> further problems.
Thanks for the pointers! Very impressive piece of work -- it will
help me very much with my batch jobs and I'll be watching it as it
matures. Impressive scatter/gather interface, too -- very clean.
There was a bit of a hangup when running ipcluster -- on my MacBook,
if you put it in the background right away, the process is stopped
immediately before the script has a chance to set up the controller
and spawn the engines:
$ ipcluster -n 4 &
$ Starting controller: Controller PID: 452
+ Stopped ipcluster -n 4
Since it is stopped and the engines aren't created, trying to use it fails.
I have to run 'ipcluster -n <num>' in the foreground, let it set up
the engines, suspend it (CTRL-Z) and put it in the background for
things to work nicely. Is there any way around this? Not a big deal,
just wondering if I'm doing anything wrong.
> On 10/13/07, Kurt Smith <firstname.lastname@example.org> wrote:
> > On 10/12/07, Brian Granger <email@example.com> wrote:
> > > Mentioned below by Jarrod, IPython1 is probably the best solution for
> > > this. Here is the simplest parallel implementation in IPython1:
> > >
> > > In : import ipython1.kernel.api as kernel
> > >
> > > In : rc = kernel.RemoteController(('127.0.0.1',10105))
> > >
> > > In : rc.getIDs()
> > > Out: [0, 1, 2, 3]
> > Hi all:
> > I installed everything to ipython1's liking, and here is what I get
> > running the above code:
> > ksmith@laptop:~/Devel/python/ipython1
> > $ ipython
> > Python 2.5.1 (r251:54863, Sep 21 2007, 22:12:00)
> > Type "copyright", "credits" or "license" for more information.
> > IPython 0.8.2.svn.r2750 -- An enhanced Interactive Python.
> > ? -> Introduction and overview of IPython's features.
> > %quickref -> Quick reference.
> > help -> Python's own help system.
> > object? -> Details about 'object'. ?object also works, ?? prints more.
> > In : import ipython1.kernel.api as kernel
> > In : rc = kernel.RemoteController(('127.0.0.1',10105))
> > In : rc.getIDs()
> > [snip traceback]
> > ConnectionError: Error connecting to the server, please recreate the client.
> > The original internal error was:
> > error(61, 'Connection refused')
> > I'm sure it's something really simple, but I don't know what.
> > Pointers? I'm on a MacBook, 10.4.10, python 2.5.1, ipython1 from svn.
> > Thanks for any help you can give -- googling turned up nothing.
> > Kurt
> > _______________________________________________
> > SciPy-user mailing list
> > SciPyfirstname.lastname@example.org
> > http://projects.scipy.org/mailman/listinfo/scipy-user
> SciPy-user mailing list
More information about the SciPy-user