[issue19108] Benchmark runner tries to execute external Python command and fails on error reporting

[Stefan Behnel]

Stefan Behnel added the comment:

> I'm leaving you with this, if you're wanting to do anything about it

Sorry, but weren't you just asking *me* to be constructive?

I'm aware that getting this change right isn't trivial. But that doesn't mean we should happily break other people's code and then leave the cleanup to them. This isn't a green-field project, the code is actually being used by other projects than CPython. In fact, the whole purpose of this code is to be used by other projects as well. That means that there may be some additional restrictions on what we should expect from a benchmarked runtime. Previously, the requirements were "can run a Python script from the command line". Now, the additional requirements are "accepts the -c switch" and "can execute a line of Python code passed on the command line". That is substantially harder to handle in a script.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue19108>
_______________________________________