Best practice tips for sizing thread/process pools and concurrent futures max_workers?

Malcolm Greene python at bdurham.com
Thu May 4 21:46:32 EDT 2017


Looking for best practice tips on how to size thread/process pools or
max workers with the concurrent futures module. Are there specific
heuristics that can be applied or is this more a manual tuning process
based on the run time behavior of a script and the nuances of one's
environment? Are there any 3rd party libraries that monitor CPU/core
and memory utilization to dynamically tune these values based on
system capacity?
Thank you,
Malcolm



More information about the Python-list mailing list