[issue26275] perf.py: calibrate benchmarks using time, not using a fixed number of iterations

[Yury Selivanov]

Yury Selivanov added the comment:

Here's a very interesting table from Zach Byrne: http://bugs.python.org/issue21955#msg259490

It shows that some benchmarks are indeed very unstable.  This also correlates with my own experience.

These ones are very unstable: pickle_dict, nbody, regex_v8, etree_parse, telco.

----------
nosy: +zbyrne

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue26275>
_______________________________________