[issue37294] concurrent.futures.ProcessPoolExecutor state=finished raised error

[DanilZ]

DanilZ <danil.com at me.com> added the comment:

After executing a single task inside a process the result is returned with state=finished raised error.

Error happens when trying to load a big dataset (over 5 GB). Otherwise the same dataset reduced to a smaller nrows executes and returns from result() without errors.

with concurrent.futures.ProcessPoolExecutor(max_workers = 1) as executor:
    results = executor.submit(pd.read_csv, path)

data = results.result()

----------
components: +2to3 (2.x to 3.x conversion tool) -Library (Lib)
nosy: +DanilZ
title: concurrent.futures.ProcessPoolExecutor and multiprocessing.pool.Pool fail with super -> concurrent.futures.ProcessPoolExecutor state=finished raised error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________