Too many open files

[Christian Heimes]

Jeff wrote:
> Why don't you start around 50 threads at a time to do the file
> writes?  Threads are effective for IO.  You open the source file,
> start a queue, and start sending data sets to be written to the
> queue.  Your source file processing can go on while the writes are
> done in other threads.

I'm sorry, but you are totally wrong. Threads are a very bad idea for IO
bound operation. Asynchronous event IO is the best answer for any IO
bound problem. That is select, poll, epoll, kqueue or IOCP.

Christian