[AstroPy] PyFITS memory usage
Brandon Craig Rhodes
brandon.craig.rhodes at gmail.com
Fri May 13 13:20:29 EDT 2011
G Jones <glenn.caltech at gmail.com> writes:
> I am processing PSRFITS files which are ~40 GB and have a table with
> the data in it. Since the files are so large, I open them with
> memmap=True. I would expect the following simple script to have a
> constant memory footprint, but instead I see continuously growing
> memory usage. ... I can see that the data is being read in from disk
> as it should be, but I don't expect the memory usage to increase,
> since x is constantly overwritten.
What are you using to measure its memory use - what tool is showing you
that its memory use is going up? It will help us answer if we know
which memory-use metric (of the several offered by tools like "ps" and
"top") are the ones you see increasing.
--
Brandon Craig Rhodes brandon at rhodesmill.org http://rhodesmill.org/brandon
More information about the AstroPy
mailing list