[AstroPy] PyFITS memory usage

Brandon Craig Rhodes brandon.craig.rhodes at gmail.com
Fri May 13 13:20:29 EDT 2011


G Jones <glenn.caltech at gmail.com> writes:

> I am processing PSRFITS files which are ~40 GB and have a table with
> the data in it. Since the files are so large, I open them with
> memmap=True. I would expect the following simple script to have a
> constant memory footprint, but instead I see continuously growing
> memory usage. ...  I can see that the data is being read in from disk
> as it should be, but I don't expect the memory usage to increase,
> since x is constantly overwritten.

What are you using to measure its memory use - what tool is showing you
that its memory use is going up?  It will help us answer if we know
which memory-use metric (of the several offered by tools like "ps" and
"top") are the ones you see increasing.

-- 
Brandon Craig Rhodes   brandon at rhodesmill.org   http://rhodesmill.org/brandon



More information about the AstroPy mailing list