[Speed] Should we change what benchmarks we have?

[Brett Cannon]

On Sun, 14 Feb 2016 at 08:57 Brett Cannon <brett at python.org> wrote:

>
>
> On Fri, Feb 12, 2016, 07:49 Antoine Pitrou <solipsis at pitrou.net> wrote:
>
>> On Fri, 12 Feb 2016 15:48:01 +0100
>> Maciej Fijalkowski <fijall at gmail.com>
>> wrote:
>> > I presume you looked at the pypy benchmark suite, which contains a
>> > large collection of library-based benchmarks.
>>
>> Not in a long time, I admit...
>>
>
> So it sounds like:
>
> * we should drop regex_v8, telco, and spectral_norm
>

Created http://bugs.python.org/issue26416 to track this.


> *Having an explanation as to what a benchmark is meant to exercise
> wouldn't go amiss
>

This can wait until we migrate to GitHub.


> * Pyston and PyPy have potential benchmarks to steal (although they need
> to work with at least Python 3.5 to be considered)
>

No one stepped forward for this on either the PyPy/Pyston or CPython side.

-Brett


>
> Anyone want the satisfaction of deprecating those benchmarks? How about
> writing a README file for what each of the benchmarks are for (which will
> become the README for the future GitHub repo)? And do we want the Pyston
> and PyPy folks to nominate benchmarks they think we really should add (with
> a wild hope of finally having a single suite that everyone at least starts
> from), or should some cpython devs look s at what PyPy and Pyston have and
> raid their benchmarks?
>
> Brett
>
>
>
>> Regards
>>
>> Antoine.
>>
>>
>> _______________________________________________
>> Speed mailing list
>> Speed at python.org
>> https://mail.python.org/mailman/listinfo/speed
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/speed/attachments/20160222/b378530e/attachment.html>