[issue19108] Benchmark runner tries to execute external Python command and fails on error reporting

[Stefan Behnel]

Stefan Behnel added the comment:

What about this: by default, we assume all runtimes to have the same major version as the Python runtime that executes the benchmark runner. If that's not the case, users must override it explicitly with a command line option, say, "--pyversions 2:3" for a reference 2.x and a comparison 3.x version of Python (i.e. in the order the programs appear on the command line).

Does that sound ok?

I'd like to avoid a trial-and-fallback approach as that would mean that any wrapper scripts would still have to support being called twice and handling the -c option in one way or another.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue19108>
_______________________________________