[New-bugs-announce] [issue28106] [Benchmarks] Add --testonly argument to perf.py to run benchmarks only for correctness checking

[Thomas Wouters]

New submission from Thomas Wouters:

The attached patch adds a --testonly mode to the 'perf.py' benchmark runner, which runs the selected benchmarks in the fastest possible way with just one interpreter (without filtering out slow benchmarks, or benchmarks that can't run in raw mode).

The intent is for this to be a relatively quick way to check that the benchmarks are not broken. I'm including the benchmarks in this mode in our continuous-build system (making sure the benchmarks will run when we need to do actual benchmarking), and this saves a significant amount of time while still allowing us to test all benchmarks (both --fast and --raw skip certain benchmarks).

----------
components: Benchmarks
files: benchmarks-testonly.diff
keywords: patch
messages: 276086
nosy: brett.cannon, gregory.p.smith, pitrou, twouters
priority: normal
severity: normal
stage: patch review
status: open
title: [Benchmarks] Add --testonly argument to perf.py to run benchmarks only for correctness checking
type: enhancement
Added file: http://bugs.python.org/file44597/benchmarks-testonly.diff

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue28106>
_______________________________________