Using Python for processing of large datasets (convincing managment)

[Alex Martelli]

Thomas Jensen wrote:
        ...
> I was planning on spawning one single-threaded XMLRPC-server per CPU per
> machine and then having a control process on one of the machines with a
> thread per process. These threads would fetch unit numbers from a Queue
> object and call the XMLRPC server using xmlrpclib.
> 
> Am I correct in beliving that this would utilize all CPUs? (Windows
> issues aside).

Yes, but xmlrpclib may not yield the best performance -- since performance 
appears to be key for you, you may want to look at other distributed
computing solutions, such as pyro (pyro.sourceforge.net).


Alex