[Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot

[Jesus Cea]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 10/09/11 05:02, Jesus Cea wrote:
> I have committed a few patches in the last hours to get my
> buildbots "green", back again. The memory used was <500MB, compared
> with >4GB before the "-j".

One of my patches solves a "process leak" in multiprocessing, when
some tests failed. Doing "make test" leaked quite a few processes, but
only in OpenIndiana, where those tests actually failed. That is solved
now, both the leak and the test failure.

Details:

http://bugs.python.org/issue12948
http://bugs.python.org/issue12950

I think the buildbots toke care of this rogue processes after the
timeout expires, anyway, but...

> Could you reconfigure my buildbots to be able to run all the six
> (2.7, 3.2, 3.x, in 32 and 64 bits) instances at the same time,
> again?. I have enough resources now. I really sorry to waste your
> time...

Now, a buildbot run of 3.x compiled in 64bits takes around 500MB. I
have seen a peak of around 4GB and a few of around 800MB, for a
fraction of a second.

- -- 
Jesus Cea Avion                         _/_/      _/_/_/        _/_/_/
jcea at jcea.es - http://www.jcea.es/     _/_/    _/_/  _/_/    _/_/  _/_/
jabber / xmpp:jcea at jabber.org         _/_/    _/_/          _/_/_/_/_/
.                              _/_/  _/_/    _/_/          _/_/  _/_/
"Things are not so easy"      _/_/  _/_/    _/_/  _/_/    _/_/  _/_/
"My name is Dump, Core Dump"   _/_/_/        _/_/_/      _/_/  _/_/
"El amor es poner tu felicidad en la felicidad de otro" - Leibniz
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQCVAwUBTmrY6plgi5GaxT1NAQKvUgP/YlS7wneU5dsWoAmtqauC02gZUi1D4OpQ
7waM8G1q8OHXLbpV1jKmBb/32G+rDp1Tm/XCjlHpK1wJcmwWmdPGAbbQp1o5TduJ
z+lbPnzWvMCRLJwZDtZAitn4/7VchoAcdTfIYCyBoK/JEUI1Oq0Mt5XeIgtD+FX9
IjwuWzXISqM=
=ojrq
-----END PGP SIGNATURE-----