[SciPy-user] running scipy code simultaneously on several machines

[Kurt Smith]

On 10/14/07, Brian Granger <ellisonbg.net at gmail.com> wrote:
> Robert gives the link to more details about how to start everything.
> But if you are just running on a single machine, the easiest way is to
> just do:
>
> $ ipcluster -n 4
>
> >From the shell after installing ipython1.  Let us know if you have
> further problems.
>
> Brian

Thanks for the pointers!  Very impressive piece of work -- it will
help me very much with my batch jobs and I'll be watching it as it
matures.  Impressive scatter/gather interface, too -- very clean.

There was a bit of a hangup when running ipcluster -- on my MacBook,
if you put it in the background right away, the process is stopped
immediately before the script has a chance to set up the controller
and spawn the engines:

$ ipcluster -n 4 &
[1] 450
$ Starting controller: Controller PID: 452
[1]+  Stopped                 ipcluster -n 4
$

Since it is stopped and the engines aren't created, trying to use it fails.

I have to run 'ipcluster -n <num>' in the foreground, let it set up
the engines, suspend it (CTRL-Z) and put it in the background for
things to work nicely.  Is there any way around this?  Not a big deal,
just wondering if I'm doing anything wrong.

Thanks again!

Kurt


>
> On 10/13/07, Kurt Smith <kwmsmith at gmail.com> wrote:
> > On 10/12/07, Brian Granger <ellisonbg.net at gmail.com> wrote:
> > > Mentioned below by Jarrod, IPython1 is probably the best solution for
> > > this.  Here is the simplest parallel implementation in IPython1:
> > >
> > > In [1]: import ipython1.kernel.api as kernel
> > >
> > > In [2]: rc = kernel.RemoteController(('127.0.0.1',10105))
> > >
> > > In [3]: rc.getIDs()
> > > Out[3]: [0, 1, 2, 3]
> >
> > Hi all:
> >
> > I installed everything to ipython1's liking, and here is what I get
> > running the above code:
> >
> > ksmith at laptop:~/Devel/python/ipython1
> > [183]$ ipython
> > Python 2.5.1 (r251:54863, Sep 21 2007, 22:12:00)
> > Type "copyright", "credits" or "license" for more information.
> >
> > IPython 0.8.2.svn.r2750 -- An enhanced Interactive Python.
> > ?         -> Introduction and overview of IPython's features.
> > %quickref -> Quick reference.
> > help      -> Python's own help system.
> > object?   -> Details about 'object'. ?object also works, ?? prints more.
> >
> > In [1]: import ipython1.kernel.api as kernel
> >
> > In [2]: rc = kernel.RemoteController(('127.0.0.1',10105))
> >
> > In [3]: rc.getIDs()
> > [snip traceback]
> > ConnectionError: Error connecting to the server, please recreate the client.
> > The original internal error was:
> > error(61, 'Connection refused')
> >
> > I'm sure it's something really simple, but I don't know what.
> > Pointers?  I'm on a MacBook, 10.4.10, python 2.5.1, ipython1 from svn.
> >
> > Thanks for any help you can give -- googling turned up nothing.
> >
> > Kurt
> > _______________________________________________
> > SciPy-user mailing list
> > SciPy-user at scipy.org
> > http://projects.scipy.org/mailman/listinfo/scipy-user
> >
> _______________________________________________
> SciPy-user mailing list
> SciPy-user at scipy.org
> http://projects.scipy.org/mailman/listinfo/scipy-user
>