[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

DanilZ report at bugs.python.org
Mon Nov 2 10:48:29 EST 2020


DanilZ <danil.com at me.com> added the comment:

FYI: I’ve tried all the three of the possible backends: ‘loky’ (default) / ’threading’ / ‘multiprocessing’. None of them solved the problem.

> On 2 Nov 2020, at 17:34, Ken Jin <report at bugs.python.org> wrote:
> 
> A temporary workaround might be to reduce n_jobs OR even better: use scikit-learn's multiprocessing parallel backend that's dedicated for that, and should have the necessary protections in place against such behavior. https://joblib.readthedocs.io/en/latest/parallel.html#joblib.parallel_backend <https://joblib.readthedocs.io/en/latest/parallel.html#joblib.parallel_backend>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue42245>
_______________________________________


More information about the Python-bugs-list mailing list