[pypy-dev] Idea for speed.pypy.org

Wed Dec 22 09:33:08 CET 2010

ai: runs a bruce force n-queens solver

Alex

On Wed, Dec 22, 2010 at 2:26 AM, Miquel Torres <tobami at googlemail.com>wrote:

> so, what about the ai and spectral-norm benchmarks. Anybody can come
> up with a description for them?
>
>
> 2010/12/15 Paolo Giarrusso <p.giarrusso at gmail.com>:
> > On Mon, Dec 13, 2010 at 09:31, Miquel Torres <tobami at googlemail.com>
> wrote:
> >> Oh, btw., the "normalized" stacked bars now display a warning note
> >> about its correctness, and how it must be viewed as giving results a
> >> weighting instead of them being normalized. It even includes a link to
> >> the proper paper. I hope that is enough for the strict statisticians
> >> among us ;-)
> >
> > I see. Thanks!
> >
> >> See:
> >>
> http://speed.pypy.org/comparison/?exe=1%2B172,3%2B172,1%2BL,3%2BL&ben=1,2,25,3,4,5,22,6,7,8,23,24,9,10,11,12,13,14,15,16,17,18,19,20&env=1&hor=true&bas=2%2B35&chart=stacked+bars
> >>
> >> PS: there is a bug in the jqPlot plotting library when null values are
> >> present. Trying to display PyPy 1.3 results for the newer go, pyflake
> >> or  raytrace will create some nasty js loops. It also has problems
> >> with autoscaling the axis sometimes.
> >>
> >>
> >>
> >> 2010/12/13 Miquel Torres <tobami at googlemail.com>:
> >>> Thanks all for the input.
> >>> I've compiled a list based on your mails, the Unladen benchmarks page
> >>> (http://code.google.com/p/unladen-swallow/wiki/Benchmarks), and the
> >>> alioth descriptions. Here is an extract of the current speed.pypy.org
> >>> admin:
> >>>
> >>> ai
> >>> chaos   Creates chaosgame-like fractals
> >>> crypto_pyaes    A pure python implementation of AES
> >>> django          Uses the Django template system to build a 150x150-cell
> HTML table
> >>>
> >>> fannkuch                Indexed-access to tiny integer-sequence. The
> fannkuch
> >>> benchmark is defined by programs in Performing Lisp Analysis of the
> >>> FANNKUCH Benchmark, Kenneth R. Anderson and Duane Rettig.
> >>>
> >>> float           Creates an array of points using circular projection
> and then
> >>> normalizes and maximizes them. Floating-point heavy.
> >>> go              A go (chess like game) computer player AI.
> >>> html5lib        Parses the HTML 5 spec using html5lib
> >>> meteor-contest  Searchs for solutions to shape packing puzzle.
> >>> nbody_modified          Double-precision N-body simulation. It models
> the
> >>> orbits of Jovian planets, using a simple symplectic-integrator.
> >>> pyflate-fast            Stand-alone pure-Python DEFLATE (gzip) and
> bzip2
> >>> decoder/decompressor.
> >>> raytrace-simple A raytracer renderer
> >>> richards                Medium-sized language benchmark that simulates
> the task
> >>> dispatcher in the kernel of an operating system.
> >>> rietveld        A Django application benchmark.
> >>> slowspitfire
> >>> spambayes       Runs a canned mailbox through a SpamBayes ham/spam
> classifier
> >>> spectral-norm
> >>> spitfire        Uses the Spitfire template system to build a
> 1000x1000-cell HTML table.
> >>> spitfire_cstringio      Uses the Spitfire template system to build a
> >>> 1000x1000-cell HTML table, using the cstringio module.
> >>> telco
> >>> twisted_iteration
> >>> twisted_names
> >>> twisted_pb
> >>> twisted_tcp     Connects one Twised client to one Twisted server over
> TCP
> >>> (on the loopback interface) and then writes bytes as fast as it can.
> >>> waf     Python-based framework for configuring, compiling and
> installing
> >>> applications. It derives from the concepts of other build tools such
> >>> as Scons, Autotools, CMake or Ant.
> >>>
> >>>
> >>> So the remaining descriptions are
> >>> ai
> >>> slowspitfire (what is the exact difference between the three spitfire
> benches?)
> >>> spectral-norm
> >>> telco
> >>> twisted (most of them)
> >>>
> >>> Are the descriptions all right so far?. They can be made much longer
> >>> if you deem it desirable.
> >>>
> >>> on speed.pypy.org you will currently see the descriptions in 3 places:
> >>> - Changes view: A tooltip on hover over each benchmark
> >>> - Timeline: a description box beneath each plot
> >>> - Comparison: A tooltip over each benchmark when hovering the
> >>> selection menu on the left side.
> >>>
> >>> Any suggestions on how to improve it further are welcome ;-)
> >>>
> >>> Miquel
> >>>
> >>>
> >>> 2010/12/9 Paolo Giarrusso <p.giarrusso at gmail.com>:
> >>>> On Thu, Dec 9, 2010 at 14:14, Leonardo Santagada <santagada at gmail.com>
> wrote:
> >>>>> Here is a incomplete draft list:
> >>>>
> >>>>> [slow]spitfire[cstringio]: Spitfire is a template language, the
> >>>>> cstringio version uses a modified engine (that uses cstringio)
> >>>>
> >>>>> spambayes: Spambayes is a bayesian spam filter
> >>>>
> >>>> Why is [slow]spitfire slower with PyPy? Is it regex-related? I
> >>>> remember when, because of this, spambayes was slower (including
> >>>> release 1.3, now solved). But for spitfire, 1.3 was faster than 1.4
> >>>> and the head (for slowspitfire it's the opposite).
> >>>>
> >>>> For the rest, I see no significant case of slowdown of PyPy over time.
> >>>>
> http://speed.pypy.org/comparison/?exe=2%2B35,1%2B41,1%2B172,1%2BL&ben=1,2,25,3,4,5,22,6,7,8,23,24,9,10,11,12,13,14,15,16,17,18,19,20,26&env=1&hor=true&bas=2%2B35&chart=normal+bars
> >>>> --
> >>>> Paolo Giarrusso - Ph.D. Student
> >>>> http://www.informatik.uni-marburg.de/~pgiarrusso/<http://www.informatik.uni-marburg.de/%7Epgiarrusso/>
> >>>>
> >>>
> >>
> >
> >
> >
> > --
> > Paolo Giarrusso - Ph.D. Student
> > http://www.informatik.uni-marburg.de/~pgiarrusso/<http://www.informatik.uni-marburg.de/%7Epgiarrusso/>
> >
> _______________________________________________
> pypy-dev at codespeak.net
> http://codespeak.net/mailman/listinfo/pypy-dev
>

-- 
"I disapprove of what you say, but I will defend to the death your right to
say it." -- Evelyn Beatrice Hall (summarizing Voltaire)
"The people's good is the highest law." -- Cicero
"Code can always be simpler than you think, but never as simple as you want"
-- Me
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20101222/7f377bee/attachment.html>