[SciPy-dev] NumPy/SciPy + MPI for Python

[Bill Spotz]

On Oct 14, 2006, at 2:58 AM, thamelry at binf.ku.dk wrote:

> On 10/13/06, Lisandro Dalcin <dalcinl at gmail.com> wrote:
>> This post is surely OT, but I cannot imagine a better place to  
>> contact
>> people about this subject. Please, don't blame me.
>>
>> Any people here interested in NumPy/SciPy + MPI?
>
> I've been working on a Dynamic Bayesian Network (DBN) toolkit for  
> some time
> (called Mocapy, freely available from sourceforge https:// 
> sourceforge.net/projects/mocapy/). The thing is almost entirely  
> implemented in Python, and currently uses Numeric and pyMPI. I  
> routinely train DBNs from 100.000s of observations on our 240 CPU  
> cluster.
>
> I'm in the proces of porting Mocapy to numpy. I assume pyMPI will  
> also work with numpy, but I haven't tried it out yet. Would be  
> great if scipy came with default MPI support, especially since  
> pyMPI does not seem to be actively developed anymore.

I would like to second the notion of converging on a single MPI  
interface.  My parallel project encapsulates most of the inter- 
processor communication within higher-level objects because the lower- 
level communication patterns can usually be determined from higher- 
level data structures.  But still, there are times when a user would  
like access to the lower-level MPI interface.

I haven't tried to make my project compatible with any of the several  
MPI python interfaces out there, because it isn't clear to me which  
one is most widely used.  If one were to emerge -- and even better,  
if the various independent projects were to then combine their  
efforts in an open source environment (the way Numeric and numarray  
are converging to NumPy) -- then this choice would be easy.

** Bill Spotz                                              **
** Sandia National Laboratories  Voice: (505)845-0170      **
** P.O. Box 5800                 Fax:   (505)284-5451      **
** Albuquerque, NM 87185-0370    Email: wfspotz at sandia.gov **




-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642