Parallel/distributed generator

George Sakkis george.sakkis at gmail.com
Wed May 23 14:00:56 EDT 2007


I'm looking for any existing packages or ideas on how to implement the
equivalent of a generator (in the Python sense, i.e.
http://www.python.org/dev/peps/pep-0255/) in a parallel/distributed
way. As a use case, imagine a function that generates a range of
primes. I'd like to be able to do something along the following lines:

def iterprimes(start=1, end=None):
   # ...
   yield prime


# rpc-related initialization
...
rpc_proxy = some_rpc_lib(iterprimes, start=1e6, end=1e12)
for prime in proxy:
    print prime

Is there any module out there that does anything close to this ?

George




More information about the Python-list mailing list