Generator using item[n-1] + item[n] memory

Dave Angel davea at davea.name
Fri Feb 14 18:03:21 EST 2014


 Nick Timkovich <prometheus235 at gmail.com> Wrote in message:
> 
 def biggen():
    sizes = 1, 1, 10, 1, 1, 10, 10, 1, 1, 10, 10, 20, 1, 1, 20,
 20, 1, 1
    for size in sizes:
        data = [1] * int(size * 1e6)
        #time.sleep(1)
        yield data

> def consumer():
    for data in biggen():
        rusage = resource.getrusage(resource.RUSAGE_SELF)
        peak_mb = rusage.ru_maxrss/1024.0
        print('Peak: {0:6.1f} MB, Data Len: {1:6.1f} M'.format(
                peak_mb, len(data)/1e6))
        #print(memory_usage())

        data = None  # go
        del data     # away
        gc.collect() # please.


............
I think one problem is in the generator itself.  After the yield,
 set data=None

-- 
DaveA




More information about the Python-list mailing list