Generator using item[n-1] + item[n] memory
Dave Angel
davea at davea.name
Fri Feb 14 18:03:21 EST 2014
Nick Timkovich <prometheus235 at gmail.com> Wrote in message:
>
def biggen():
  sizes = 1, 1, 10, 1, 1, 10, 10, 1, 1, 10, 10, 20, 1, 1, 20,
20, 1, 1
  for size in sizes:
    data = [1] * int(size * 1e6)
    #time.sleep(1)
    yield data
> def consumer():
  for data in biggen():
    rusage = resource.getrusage(resource.RUSAGE_SELF)
    peak_mb = rusage.ru_maxrss/1024.0
    print('Peak: {0:6.1f} MB, Data Len: {1:6.1f} M'.format(
        peak_mb, len(data)/1e6))
    #print(memory_usage())
    data = None  # go
    del data   # away
    gc.collect() # please.
............
I think one problem is in the generator itself. After the yield,
set data=None
--
DaveA
More information about the Python-list
mailing list