[Python-Dev] [GSoC] Developing a benchmark suite (for Python 3.x)

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 04/07/2011 04:28 PM, Jesse Noller wrote:
> On Thu, Apr 7, 2011 at 3:54 PM, Anthony Scopatz <scopatz at gmail.com> wrote:
>> Hi Daniel,
>> Thanks for putting this together.  I am a huge supporter of benchmarking
>> efforts.  My brief comment is below.
>>
>> On Wed, Apr 6, 2011 at 11:52 AM, DasIch <dasdasich at googlemail.com> wrote:
>>>
>>> 1. Definition of the benchmark suite. This will entail contacting
>>> developers of Python implementations (CPython, PyPy, IronPython and
>>> Jython), via discussion on the appropriate mailing lists. This might
>>> be achievable as part of this proposal.
>>>
>>
>> If you are reaching out to other projects at this stage, I think you should
>> also be in touch with the Cython people  (even if its 'implementation'
>> sits on top of CPython).
>> As a scientist/engineer what I care about is how Cython benchmarks to
>> CPython.  I believe that they have some ideas on benchmarking and have
>> also explored this space.  Their inclusion would be helpful to me thinking
>> this GSoC successful at the end of the day (summer).
>> Thanks for your consideration.
>> Be Well
>> Anthony
> 
> Right now, we are talking about building "speed.python.org" to test
> the speed of python interpreters, over time, and alongside one another
> - cython *is not* an interpreter.
> 
> Cython is out of scope for this.

Why is it out of scope to use the benchmarks and test harness to answer
questions like "can we use Cython to provide optional optimizations for
the stdlib"?  I can certainly see value in havng an objective way to
compare the macro benchmark performance of a Cython-optimized CPython
vs. a vanilla CPython, as well as vs. PyPY, Jython, or IronPython.


Tres.
- -- 
===================================================================
Tres Seaver          +1 540-429-0999          tseaver at palladion.com
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk2eLWcACgkQ+gerLs4ltQ4R7wCgmam/W+3JzJRgxtehnnfbE54S
RxcAn0ooO2kpw84kRvmTP5dCAWir9g3i
=3mL7
-----END PGP SIGNATURE-----