[issue26275] perf.py: calibrate benchmarks using time, not using a fixed number of iterations

STINNER Victor report at bugs.python.org
Wed Feb 3 15:33:03 EST 2016


STINNER Victor added the comment:

> If running time is close to the limit, different run will use different number of repetitions. This will add additional instability.

Maybe, to be honest I don't know. How can we decide if a patch makes
perf.py more and less stable?

> I prefer a stable number of repetitions manually calibrated for average modern computer.

The problem is to define an "average modern computer".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue26275>
_______________________________________


More information about the Python-bugs-list mailing list