[Python-ideas] channel (synchronous queue)

Massimo Di Pierro massimo.dipierro at gmail.com
Mon Feb 20 01:44:38 CET 2012


+1

On Feb 19, 2012, at 6:40 PM, Sturla Molden wrote:

> Den 20.02.2012 00:38, skrev Massimo Di Pierro:
>> It would be very useful to have something like these channels built-in. Notice that using OS pipes have the problem of a OS dependent size. send is non-blocking for small data-size but becomes blocking for large data sizes. Using OS mkfifo or multiprocessing Queue is better but the OS limits the number of files open by one program. 
> 
> Most MPI implementations use shared memory on localhost. In theory one could implement a queue (deque and lock) using a shared memory region (a file on /tmp or Windows equivalent). It would be extremely fast and could contain any number of "pipes" of arbitrary size.
> 
> Sturla
> _______________________________________________
> Python-ideas mailing list
> Python-ideas at python.org
> http://mail.python.org/mailman/listinfo/python-ideas




More information about the Python-ideas mailing list