[Python-ideas] multiprocessing IPC

Antoine Pitrou solipsis at pitrou.net
Sat Feb 11 16:27:08 CET 2012


On Sat, 11 Feb 2012 00:36:15 +0100
Sturla Molden <sturla at molden.no> wrote:
> 
> Finally, I'd like to say that I think Python's standard lib should 
> support high-performance asynchronous I/O for concurrency. That is not 
> poll/select (on Windows it does not even work properly). Rather, I want 
> IOCP on Windows, epoll on Linux, and kqueue on Mac. (Yes I know about 
> twisted.)

This is not trivial (especially the IOCP part, if I consider the amount
of code Twisted has for that).

> There should also be a requirement that it works with 
> multiprocessing. E.g. if we open a process pool, the processes should be 
> able to use the same IOCP. In other words some highly scalable 
> asynchronous I/O that works with multiprocessing.

Ouch.

Regards

Antoine.





More information about the Python-ideas mailing list