[Python-ideas] multiprocessing IPC

Antoine Pitrou solipsis at pitrou.net
Fri Feb 10 21:02:09 CET 2012


On Fri, 10 Feb 2012 21:01:07 +0100
Sturla Molden <sturla at molden.no> wrote:

> On 09.02.2012 22:05, Nick Coghlan wrote:
> 
> > Have you even *tried* concurrent.futures
> > (http://docs.python.org/py3k/library/concurrent.futures)? Or the 2.x
> > backport on PyPI (http://pypi.python.org/pypi/futures)?
> 
> Multiprocessing is fine, but is uses pickle for IPC and this is 
> inefficient. We need unpickled, type-specialized queues. Or a queue that 
> has the interface of a binary file.

If you have any concrete idea for that, don't hesitate to post it on
the bug tracker, or here under a separate thread (this thread
is a train wreck).

Regards

Antoine.





More information about the Python-ideas mailing list