distributed queue?

Robert Kern robert.kern at gmail.com
Sat Mar 10 18:07:12 EST 2007


Paul Rubin wrote:
> Does anyone have an implementation of a distributed queue?  I.e. I
> have a long running computation f(x) and I'd like to be able to
> evaluate it (for different values of x) on a bunch of different
> computers simultaneously, the usual "worker thread" pattern except
> distributed across a network.  I guess this is pretty easy to write
> with a centralized socket listener that dispatches requests through a
> Queue to multiple threads on the same machine, each talking
> synchronously to a server socket.  I wonder if something like it
> already exists.  I see a little bit of discussion in the newsgroup
> archive but no obvious pointers to code.

Take a look at the work being done on IPython:

  http://ipython.scipy.org/moin/Parallel_Computing

-- 
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless enigma
 that is made terrible by our own mad attempt to interpret it as though it had
 an underlying truth."
  -- Umberto Eco




More information about the Python-list mailing list