1 Million users.. I can't Scale!!

[Jeremy Jones]

skip at pobox.com wrote:

>    Damjan> Is there some python module that provides a multi process Queue?
>
>    Skip> Not as cleanly encapsulated as Queue, but writing a class that
>    Skip> does that shouldn't be all that difficult using a socket and the
>    Skip> pickle module.
>
>    Jeremy> What about bsddb?  The example code below creates a multiprocess
>    Jeremy> queue.
>
>I tend to think "multiple computers" when someone says "multi-process".  I
>realize that's not always the case, but I think you need to consider that
>case (it's the only practical way for a multi-process application to scale
>beyond a few processors).
>
>Skip
>  
>
Doh!  I'll buy that.  When I hear "multi-process", I tend to think of 
folks overcoming the scaling issues that accompany the GIL.  This, of 
course, won't scale across computers without a networking interface.

- JMJ