memory consumption

[Barry]

> On 31 Mar 2021, at 09:42, Alexey <zen.supagood at gmail.com> wrote:
> 
> среда, 31 марта 2021 г. в 01:20:06 UTC+3, Dan Stromberg:
>>> On Tue, Mar 30, 2021 at 1:25 AM Alexey <zen.su... at gmail.com> wrote: 
>>> 
>>> 
>>> I'm sorry. I didn't understand your question right. If I have 4 workers, 
>>> they require 4Gb 
>>> in idle state and some extra memory when they execute other tasks. If I 
>>> increase workers 
>>> count up to 16, they`ll eat all the memory I have (16GB) on my machine and 
>>> will crash as soon 
>>> as system get swapped. 
>>> 
>> What if you increase the machine's (operating system's) swap space? Does 
>> that take care of the problem in practice?
> 
> I can`t do that because it will affect other containers running on this host.
> In my opinion it may significantly reduce their performance.

Assuming this a modern linux then you should have control groups that allow you to set limits on memory and swap for each container.

Are you running with systemd?

Barry

> -- 
> https://mail.python.org/mailman/listinfo/python-list