[Python-ideas] solving multi-core Python

[Nathaniel Smith]

On Wed, Jun 24, 2015 at 3:10 PM, Devin Jeanpierre
<jeanpierreda at gmail.com> wrote:
> So there's two reasons I can think of to use threads for CPU parallelism:
>
> - My thing does a lot of parallel work, and so I want to save on
> memory by sharing an address space
>
> This only becomes an especially pressing concern if you start running
> tens of thousands or more of workers. Fork also allows this.

Not necessarily true... e.g., see two threads from yesterday (!) on
the pandas mailing list, from users who want to perform queries
against a large data structure shared between threads/processes:

https://groups.google.com/d/msg/pydata/Emkkk9S9rUk/eh0nfiGR7O0J
https://groups.google.com/forum/#!topic/pydata/wOwe21I65-I
("Are we just screwed on windows?")

-n

-- 
Nathaniel J. Smith -- http://vorpus.org