multiprocessing : farming out python functions to a cluster

Abhishek Pratap abhishek.vit at gmail.com
Thu May 17 13:32:55 EDT 2012


Hey Guys

I am wondering if I can execute/run python functions through
multiprocessing package on a grid/cluster rather than on the same local
machine. It will help me create 100's of jobs on which same function has to
be used and farm them out to our local cluster through DRMAA. I am not sure
if this is possible or makes sense to do with child processes/forks.

Any example or advice would be helpful.

Thanks!
-Abhi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20120517/515ed615/attachment.html>


More information about the Python-list mailing list