[Speed] Issues to run benchmarks on Python before 2015-04-01

[Victor Stinner]

Hi,

I'm trying to run benchmarks on revisions between 2014-01-01 and
today, but I got two different issues: see below. I'm now looking for
workarounds :-/ Because of these bugs, I'm unable to get benchmarks
results before 2015-04-01 (at 2015-04-01, benchmarks work again).


(1) 2014-01-01: "python3 -m pip install performance" fails with a
TypeError: "charset argument must be specified when non-ASCII
characters are used in the payload"

It's a regression of Python 3.4 beta: http://bugs.python.org/issue20531


(2) 2014-04-01, 2014-07-01, 2014-10-01, 2015-01-01: "venv/bin/python
-m pip install" fails in extract_stack() of pyparsing

---
haypo at selma$ /home/haypo/prog/bench_python/tmpdir/prefix/bin/python3
Python 3.5.0a0 (default, Apr  1 2017, 00:01:30)
[GCC 6.3.1 20161221 (Red Hat 6.3.1-1)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pip
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/__init__.py",
line 26, in <module>
    from pip.utils import get_installed_distributions, get_prog
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/utils/__init__.py",
line 27, in <module>
    from pip._vendor import pkg_resources
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/pkg_resources/__init__.py",
line 74, in <module>
    __import__('pip._vendor.packaging.requirements')
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/packaging/requirements.py",
line 9, in <module>
    from pip._vendor.pyparsing import (
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/pyparsing.py",
line 4715, in <module>
    _escapedPunc = Word( _bslash, r"\[]-*.$+^?()~ ", exact=2
).setParseAction(lambda s,l,t:t[0][1])
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/pyparsing.py",
line 1261, in setParseAction
    self.parseAction = list(map(_trim_arity, list(fns)))
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/pyparsing.py",
line 1043, in _trim_arity
    this_line = extract_stack(limit=2)[-1]
  File "/home/haypo/prog/bench_python/tmpdir/prefix/lib/python3.5/site-packages/pip/_vendor/pyparsing.py",
line 1028, in extract_stack
    return [(frame_summary.filename, frame_summary.lineno)]
AttributeError: 'tuple' object has no attribute 'filename'
---

Note: same error using the pip program (ex: " prefix/bin/pip --version").

Victor