1 Million users.. I can't Scale!!
Jeff Schwab
jeffrey.schwab at rcn.com
Wed Sep 28 18:30:55 EDT 2005
skip at pobox.com wrote:
> Damjan> Is there some python module that provides a multi process Queue?
>
> Skip> Not as cleanly encapsulated as Queue, but writing a class that
> Skip> does that shouldn't be all that difficult using a socket and the
> Skip> pickle module.
>
> Jeremy> What about bsddb? The example code below creates a multiprocess
> Jeremy> queue.
>
> I tend to think "multiple computers" when someone says "multi-process". I
> realize that's not always the case, but I think you need to consider that
> case (it's the only practical way for a multi-process application to scale
> beyond a few processors).
How many are more than "a few?"
I think processors with multiple cores per die are going to be far more
mainstream within the next few years, so I still don't think of multiple
computers for most of my multi-processing.
More information about the Python-list
mailing list