Large Amount of Data

[kaens]

On 5/25/07, Jack <nospam at invalid.com> wrote:
> I need to process large amount of data. The data structure fits well
> in a dictionary but the amount is large - close to or more than the size
> of physical memory. I wonder what will happen if I try to load the data
> into a dictionary. Will Python use swap memory or will it fail?
>
> Thanks.
>
>
> --
> http://mail.python.org/mailman/listinfo/python-list
>

Could you process it in chunks, instead of reading in all the data at once?