Large Amount of Data

Marc 'BlackJack' Rintsch bj_666 at gmx.net
Fri May 25 14:03:09 EDT 2007


In <H8udnTwG_s1QvMrbnZ2dnUVZ_o2vnZ2d at comcast.com>, Jack wrote:

> I need to process large amount of data. The data structure fits well
> in a dictionary but the amount is large - close to or more than the size
> of physical memory. I wonder what will happen if I try to load the data
> into a dictionary. Will Python use swap memory or will it fail?

What about putting the data into a database?  If the keys are strings the
`shelve` module might be a solution.

Ciao,
	Marc 'BlackJack' Rintsch



More information about the Python-list mailing list