[Numpy-discussion] Tiling / disk storage for matrix in numpy?
Travis Oliphant
oliphant at ee.byu.edu
Mon Apr 10 15:14:05 EDT 2006
Webb Sprague wrote:
>Hi all,
>
>Is there a way in numpy to associate a (large) matrix with a disk
>file, then and tile and index it, then cache it as you process the
>various pieces? This is pretty important with massive image files,
>which can't fit into working memory, but in which (for example) you
>might be doing a convolution on a 100 x 100 pixel window on a small
>subset of the image.
>
>
>
I suppose if you used a memory-mapped array, then you would be at the
mercy of the operating system caching. But, this would be the easiest way.
-Travis
More information about the NumPy-Discussion
mailing list