Heap Memory

Marc 'BlackJack' Rintsch bj_666 at gmx.net
Thu Nov 16 14:15:25 EST 2006


In <mailman.283.1163704111.32031.python-list at python.org>, Gregory Piñero
wrote:

> This computer it was running on has 2GB of RAM and 6GB of virtual
> memory so I really doubt I had used up all of that memory.

On 32 bit systems the per process limit is usually 2 GiB, no matter how
much physical and virtual memory you have.

And with 2 GiB and 400000 objects you have about 5 KiB per object.  If
you pickle that huge list there has to be enough memory to hold the
pickled data in memory before it is written to disk.

Ciao,
	Marc 'BlackJack' Rintsch



More information about the Python-list mailing list