memory consumption

[Alexey]

среда, 31 марта 2021 г. в 11:52:43 UTC+3, Marco Ippolito:
> > > At which point does the problem start manifesting itself? 
> > The problem spot is my cache(dict). I simplified my code to just load 
> > all the objects to this dict and then clear it.
> What's the memory utilisation just _before_ performing this load? I am assuming 
> it's much less than this 1 GB you can't seem to drop under after you run your 
> `.clear()`. 

Around 100Mb before first run.

> > After loading "top" 
> 
> You may be using `top` in command line mode already but in case you aren't, 
> consider sorting processes whose command name is `python` (or whatever filter 
> selects your program) by RSS, like so, for easier collection of 
> machine-readable statistics:

I'm using following command to highlight what I need -
top -c -p $(pgrep -d',' -f python) and then sort by RSS 
and switch to Mb by pressing 'e'.


> # ps -o rss,ppid,pid,args --sort -rss $(pgrep python) 
> RSS PPID PID COMMAND 
> 32836 14130 14377 python3 
> 10644 14540 14758 python3
> > For debugging I use Pycharm
> Sounds good, you can then use the GUI to set the breakpoint and consult 
> external statistics-gathering programs (like the `ps` invocation above) as you 
> step through your code. 
> 
> Pycharm also allows you to see which variables are in scope in a particular 
> stack frame, so you'll have an easier time reasoning about garbage collection 
> in terms of which references might be preventing GC.

That's what I tried in the first place and I see no references 
to this dict. I'll try that one more time anyway.