distributed queue?

Irmen de Jong irmen.NOSPAM at xs4all.nl
Sun Mar 11 07:36:42 EDT 2007


Paul Rubin wrote:
> Does anyone have an implementation of a distributed queue?  I.e. I
> have a long running computation f(x) and I'd like to be able to
> evaluate it (for different values of x) on a bunch of different
> computers simultaneously, the usual "worker thread" pattern except
> distributed across a network.  I guess this is pretty easy to write
> with a centralized socket listener that dispatches requests through a
> Queue to multiple threads on the same machine, each talking
> synchronously to a server socket.  I wonder if something like it
> already exists.  I see a little bit of discussion in the newsgroup
> archive but no obvious pointers to code.
> 
> Thanks.

Pyro (http://pyro.sf.net) contains 2 examples that do just this.
One is a distributed merge sort / md5 "cracker", the other is
distributed prime factorization of a set of numbers.

--Irmen



More information about the Python-list mailing list