[pypy-dev] speed.pypy.org launched

[Carl Friedrich Bolz]

On 02/25/2010 11:39 PM, Jacob Hallén wrote:
> Thursday 25 February 2010 you wrote:
>> Hi Carl,
>>
>> error bars are certainly doable and supported by the plot lib. The
>> only problem is that my backend model doesn't include such a field, so
>> at the moment the data (which is certainly included in the json files)
>> is not being saved. I will need to change the DB models in order to
>> acomodate that kind of information.
>>
>> I'll add this to the wish list.

Great, thanks.

> How do you actually determine the error? Multiple runs or sliding average of
> historic data?

We use the Unladen Swallow benchmark runner, which runs each benchmark 
multiple times and computes the standard deviation. I then computes a 
95% confidence interval using, I think, Student's T distribution.

Cheers,

Carl Friedrich