1 Million users.. I can't Scale!!

Jeff Schwab jeffrey.schwab at rcn.com
Wed Sep 28 18:30:55 EDT 2005


skip at pobox.com wrote:
>     Damjan> Is there some python module that provides a multi process Queue?
> 
>     Skip> Not as cleanly encapsulated as Queue, but writing a class that
>     Skip> does that shouldn't be all that difficult using a socket and the
>     Skip> pickle module.
> 
>     Jeremy> What about bsddb?  The example code below creates a multiprocess
>     Jeremy> queue.
> 
> I tend to think "multiple computers" when someone says "multi-process".  I
> realize that's not always the case, but I think you need to consider that
> case (it's the only practical way for a multi-process application to scale
> beyond a few processors).

How many are more than "a few?"

I think processors with multiple cores per die are going to be far more 
mainstream within the next few years, so I still don't think of multiple 
computers for most of my multi-processing.



More information about the Python-list mailing list