[Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot

Antoine Pitrou solipsis at pitrou.net
Fri Sep 9 19:04:32 CEST 2011


Le Fri, 09 Sep 2011 17:14:18 +0200,
Jesus Cea <jcea at jcea.es> a écrit :
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> On 08/09/11 09:18, Antoine Pitrou wrote:
> > Ok, I've added "-j4", let's how that works.
> 
> It is not helping. it is taking tons of memory yet.

That's rather strange. Is it for every test or a few select ones?

> >> Another option would be to have a single Python process and 
> >> "fork" for each test. That would launch each test in a separate 
> >> process without requiring a full python interpreter launching 
> >> each time. Is this the way "-j" is implemented
> > 
> > It uses subprocess actually, so fork() + exec() is used.
> 
> Yes, does it but fork for each test or simply launch 4 processes, each
> doing 1/4 of the tests?.

It forks for each test.

Regards

Antoine.




More information about the Python-Dev mailing list