Get multiprocessing.Queue to do priorities

madeleine.udell at gmail.com madeleine.udell at gmail.com
Mon Apr 1 18:35:44 EDT 2013


Was this issue ever resolved? What is the current best practice for those wishing to use a priority queue with multiprocessing?

On Sunday, May 10, 2009 6:35:03 AM UTC-7, Jesse Noller wrote:
> On Sat, May 9, 2009 at 6:11 PM, uuid <M8R-gqmgb4 at mailinator.com> wrote:
> > The Queue module, apparently, is thread safe, but *not* process safe. If you
> > try to use an ordinary Queue, it appears inaccessible to the worker process.
> > (Which, after all, is quite logical, since methods for moving items between
> > the threads of the same process are quite different from inter-process
> > communication.) It appears that creating a manager that holds a shared queue
> > might be an option
> > (http://stackoverflow.com/questions/342556/python-2-6-multiprocessing-queue-compatible-with-threads).
> 
> Using a manager, or submitting a patch which adds priority queue to
> the multiprocessing.queue module is the correct solution for this.
> 
> You can file an enhancement in the tracker, and assign/add me to it,
> but without a patch it may take me a bit (wicked busy right now).
> 
> jesse




More information about the Python-list mailing list