[Python-ideas] multiprocessing IPC
Antoine Pitrou
solipsis at pitrou.net
Fri Feb 10 21:02:09 CET 2012
On Fri, 10 Feb 2012 21:01:07 +0100
Sturla Molden <sturla at molden.no> wrote:
> On 09.02.2012 22:05, Nick Coghlan wrote:
>
> > Have you even *tried* concurrent.futures
> > (http://docs.python.org/py3k/library/concurrent.futures)? Or the 2.x
> > backport on PyPI (http://pypi.python.org/pypi/futures)?
>
> Multiprocessing is fine, but is uses pickle for IPC and this is
> inefficient. We need unpickled, type-specialized queues. Or a queue that
> has the interface of a binary file.
If you have any concrete idea for that, don't hesitate to post it on
the bug tracker, or here under a separate thread (this thread
is a train wreck).
Regards
Antoine.
More information about the Python-ideas
mailing list