[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class
noxdafox
report at bugs.python.org
Sat Oct 5 19:30:41 CEST 2013
New submission from noxdafox:
As a developer I want the multiprocessing Pool class to expose the internal queue size limit in order to better control the task flow in my application.
Consider the following scenarios:
1. The tasks I want to run into the pool require a considerably big amount of data as input (a big XML string for example). A limitless queue and a high number of tasks would cause my application to consume a huge amount of memory, this is unacceptable.
2. I want to always ensure a small amount of tasks queued into the pool so that, if my application crashes, I won't loose much data.
Patch includes code changes, tests and documentation.
----------
components: Library (Lib)
files: maxqueuesize.patch
keywords: patch
messages: 198992
nosy: noxdafox
priority: normal
severity: normal
status: open
title: Expose Queue maxsize parameter to multiprocessing.Pool class
type: enhancement
versions: Python 3.4
Added file: http://bugs.python.org/file31967/maxqueuesize.patch
_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue19173>
_______________________________________
More information about the Python-bugs-list
mailing list