[New-bugs-announce] [issue32759] multiprocessing.Array do not release shared memory
OO O
report at bugs.python.org
Sat Feb 3 16:14:22 EST 2018
New submission from OO O <dogod621 at gmail.com>:
OS: Win10 / 8.1
Python: 3.5 / 3.6
My program use mp.Array to share huge data.
But suffer from out of memory after running for a while.
But Windows task manager didn't show which process use that huge memory. And I use pympler to check my python memory usage. Still shows noting. So, I use RamMap to check, it shows a huge shared memory is used.
I can reproduce the case by the simple test code:
#-------------------------------------------------------
import numpy as np
import multiprocessing as mp
import gc
def F ():
a = mp.Array ( 'I', 1800000000, lock = False )
#
F ()
gc.collect ()
#-------------------------------------------------------
No matter how hard I tried. the memory is not released.
I put what I tried in the attachment picture.
----------
components: Windows
files: result.jpg
messages: 311571
nosy: OO O, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: multiprocessing.Array do not release shared memory
type: resource usage
versions: Python 3.6
Added file: https://bugs.python.org/file47424/result.jpg
_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32759>
_______________________________________
More information about the New-bugs-announce
mailing list