[SciPy-user] running scipy code simultaneously on several machines

[Brian Granger]

> Thanks for the pointers!  Very impressive piece of work -- it will
> help me very much with my batch jobs and I'll be watching it as it
> matures.  Impressive scatter/gather interface, too -- very clean.

Thanks, we would love any further feedback you have.

> There was a bit of a hangup when running ipcluster -- on my MacBook,
> if you put it in the background right away, the process is stopped
> immediately before the script has a chance to set up the controller
> and spawn the engines:
>
> $ ipcluster -n 4 &
> [1] 450
> $ Starting controller: Controller PID: 452
> [1]+  Stopped                 ipcluster -n 4
> $
>
> Since it is stopped and the engines aren't created, trying to use it fails.

On OS X, the following works (I have no idea why?!?!) for backgrounding:

$ (ipcluster -n 4 &)

The parenthesis around everything does the trick.

> I have to run 'ipcluster -n <num>' in the foreground, let it set up
> the engines, suspend it (CTRL-Z) and put it in the background for
> things to work nicely.  Is there any way around this?  Not a big deal,
> just wondering if I'm doing anything wrong.

Nope, just some wierdness with OS X.

> Thanks again!
>
> Kurt
>
>
> >
> > On 10/13/07, Kurt Smith <kwmsmith at gmail.com> wrote:
> > > On 10/12/07, Brian Granger <ellisonbg.net at gmail.com> wrote:
> > > > Mentioned below by Jarrod, IPython1 is probably the best solution for
> > > > this.  Here is the simplest parallel implementation in IPython1:
> > > >
> > > > In [1]: import ipython1.kernel.api as kernel
> > > >
> > > > In [2]: rc = kernel.RemoteController(('127.0.0.1',10105))
> > > >
> > > > In [3]: rc.getIDs()
> > > > Out[3]: [0, 1, 2, 3]
> > >
> > > Hi all:
> > >
> > > I installed everything to ipython1's liking, and here is what I get
> > > running the above code:
> > >
> > > ksmith at laptop:~/Devel/python/ipython1
> > > [183]$ ipython
> > > Python 2.5.1 (r251:54863, Sep 21 2007, 22:12:00)
> > > Type "copyright", "credits" or "license" for more information.
> > >
> > > IPython 0.8.2.svn.r2750 -- An enhanced Interactive Python.
> > > ?         -> Introduction and overview of IPython's features.
> > > %quickref -> Quick reference.
> > > help      -> Python's own help system.
> > > object?   -> Details about 'object'. ?object also works, ?? prints more.
> > >
> > > In [1]: import ipython1.kernel.api as kernel
> > >
> > > In [2]: rc = kernel.RemoteController(('127.0.0.1',10105))
> > >
> > > In [3]: rc.getIDs()
> > > [snip traceback]
> > > ConnectionError: Error connecting to the server, please recreate the client.
> > > The original internal error was:
> > > error(61, 'Connection refused')
> > >
> > > I'm sure it's something really simple, but I don't know what.
> > > Pointers?  I'm on a MacBook, 10.4.10, python 2.5.1, ipython1 from svn.
> > >
> > > Thanks for any help you can give -- googling turned up nothing.
> > >
> > > Kurt
> > > _______________________________________________
> > > SciPy-user mailing list
> > > SciPy-user at scipy.org
> > > http://projects.scipy.org/mailman/listinfo/scipy-user
> > >
> > _______________________________________________
> > SciPy-user mailing list
> > SciPy-user at scipy.org
> > http://projects.scipy.org/mailman/listinfo/scipy-user
> >
> _______________________________________________
> SciPy-user mailing list
> SciPy-user at scipy.org
> http://projects.scipy.org/mailman/listinfo/scipy-user
>