memory consumption

[Alexey]

понедельник, 29 марта 2021 г. в 19:56:52 UTC+3, Stestagg:
> > > 2. Can you try a test with 16 or 32 active workers (i.e. number of 
> > > workers=2x available memory in GB), do they all still end up with 1gb 
> > > usage? or do you get any other memory-related issues running this? 
> > Yes. They will consume 1Gb each. It doesn't matter how many workers I 
> > have, 
> > they behave exactly the same. We can even forget about Flask and Celery. 
> > If I run this code in Python console, behavior will remain the same. 
> > 
> >
> Woah, funky, so you got to a situation where your workers were allocating 
> 2x more ram than your system had available? and they were still working? 
> Were you hitting lots of swap? 
> 
> If no big swap load, then it looks like no problem, it's just that the 
> metrics you're looking at aren't saying what they appear to be. 
> 
> 
> 
> > -- 
> > https://mail.python.org/mailman/listinfo/python-list 
> >

I'm sorry. I didn't understand your question right. If I have 4 workers, they require 4Gb
in idle state and some extra memory when they execute other tasks. If I increase workers
count up to 16, they`ll eat all the memory I have (16GB) on my machine and will crash as soon
as system get swapped.