From solipsis at pitrou.net  Mon Oct  1 01:21:39 2012
From: solipsis at pitrou.net (Antoine Pitrou)
Date: Mon, 1 Oct 2012 01:21:39 +0200
Subject: [Speed] slow benchmark
Message-ID: <20121001012139.2f0150af@pitrou.net>


Hello,

The hexiom benchmark is very slow. Is there a reason it's included
there?

Regards

Antoine.


-- 
Software development and contracting: http://pro.pitrou.net



From brett at python.org  Mon Oct  1 01:58:02 2012
From: brett at python.org (Brett Cannon)
Date: Sun, 30 Sep 2012 19:58:02 -0400
Subject: [Speed] slow benchmark
In-Reply-To: <20121001012139.2f0150af@pitrou.net>
References: <20121001012139.2f0150af@pitrou.net>
Message-ID: <CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>

On Sun, Sep 30, 2012 at 7:21 PM, Antoine Pitrou <solipsis at pitrou.net> wrote:

>
> Hello,
>
> The hexiom benchmark is very slow. Is there a reason it's included
> there?
>

Already been asked and answered:
http://mail.python.org/pipermail/speed/2012-September/000209.html
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/speed/attachments/20120930/7a7c6d26/attachment.html>

From solipsis at pitrou.net  Mon Oct  1 02:04:02 2012
From: solipsis at pitrou.net (Antoine Pitrou)
Date: Mon, 1 Oct 2012 02:04:02 +0200
Subject: [Speed] slow benchmark
References: <20121001012139.2f0150af@pitrou.net>
	<CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>
Message-ID: <20121001020402.175911c8@pitrou.net>

On Sun, 30 Sep 2012 19:58:02 -0400
Brett Cannon <brett at python.org> wrote:
> On Sun, Sep 30, 2012 at 7:21 PM, Antoine Pitrou <solipsis at pitrou.net> wrote:
> 
> >
> > Hello,
> >
> > The hexiom benchmark is very slow. Is there a reason it's included
> > there?
> >
> 
> Already been asked and answered:
> http://mail.python.org/pipermail/speed/2012-September/000209.html

I didn't realize when reading this discussion that hexiom2 was *that*
slow. I don't think a benchmark taking 100+ seconds to run *in fast
mode* has a place in the benchmark suite. PyPy can maintain their own
benchmarks in their source tree, like CPython does.

Regards

Antoine.


-- 
Software development and contracting: http://pro.pitrou.net



From fijall at gmail.com  Mon Oct  1 08:47:31 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Mon, 1 Oct 2012 08:47:31 +0200
Subject: [Speed] slow benchmark
In-Reply-To: <20121001020402.175911c8@pitrou.net>
References: <20121001012139.2f0150af@pitrou.net>
	<CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>
	<20121001020402.175911c8@pitrou.net>
Message-ID: <CAK5idxSxJqSpPBdu26NVTD1o9cvSB=y7CMoy4rOY5ipoJ552YA@mail.gmail.com>

On Mon, Oct 1, 2012 at 2:04 AM, Antoine Pitrou <solipsis at pitrou.net> wrote:
> On Sun, 30 Sep 2012 19:58:02 -0400
> Brett Cannon <brett at python.org> wrote:
>> On Sun, Sep 30, 2012 at 7:21 PM, Antoine Pitrou <solipsis at pitrou.net> wrote:
>>
>> >
>> > Hello,
>> >
>> > The hexiom benchmark is very slow. Is there a reason it's included
>> > there?
>> >
>>
>> Already been asked and answered:
>> http://mail.python.org/pipermail/speed/2012-September/000209.html
>
> I didn't realize when reading this discussion that hexiom2 was *that*
> slow. I don't think a benchmark taking 100+ seconds to run *in fast
> mode* has a place in the benchmark suite. PyPy can maintain their own
> benchmarks in their source tree, like CPython does.
>
> Regards
>
> Antoine.

I strongly disagree. There are quite a few slow benchmarks that are
very useful, like pypy translation toolchain. How about you skip this
one in fast mode?

From stefan_ml at behnel.de  Mon Oct  1 09:14:04 2012
From: stefan_ml at behnel.de (Stefan Behnel)
Date: Mon, 01 Oct 2012 09:14:04 +0200
Subject: [Speed] slow benchmark
In-Reply-To: <CAK5idxSxJqSpPBdu26NVTD1o9cvSB=y7CMoy4rOY5ipoJ552YA@mail.gmail.com>
References: <20121001012139.2f0150af@pitrou.net>
	<CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>
	<20121001020402.175911c8@pitrou.net>
	<CAK5idxSxJqSpPBdu26NVTD1o9cvSB=y7CMoy4rOY5ipoJ552YA@mail.gmail.com>
Message-ID: <506942BC.7060307@behnel.de>

Maciej Fijalkowski, 01.10.2012 08:47:
> On Mon, Oct 1, 2012 at 2:04 AM, Antoine Pitrou wrote:
>> On Sun, 30 Sep 2012 19:58:02 -0400
>> Brett Cannon wrote:
>>> On Sun, Sep 30, 2012 at 7:21 PM, Antoine Pitrou wrote:
>>>> The hexiom benchmark is very slow. Is there a reason it's included
>>>> there?
>>>
>>> Already been asked and answered:
>>> http://mail.python.org/pipermail/speed/2012-September/000209.html
>>
>> I didn't realize when reading this discussion that hexiom2 was *that*
>> slow. I don't think a benchmark taking 100+ seconds to run *in fast
>> mode* has a place in the benchmark suite. PyPy can maintain their own
>> benchmarks in their source tree, like CPython does.
> 
> I strongly disagree. There are quite a few slow benchmarks that are
> very useful, like pypy translation toolchain. How about you skip this
> one in fast mode?

I think the basic question here is: what good is a benchmark that takes
ages to run?

Either it benchmarks mostly a specific part of the overall runtime, in that
case, there's no reason for it to take ages. It can just be stripped down
to run a reasonably sized workload that exercises the target code well.

If it does not benchmark anything specific, and thus cannot be sized down
in any way, then what's the interesting thing that its broad and unspecific
result would tell us?

I think it's either a matter of investing some time into retailoring the
work load of that benchmark, or, if that's not feasible, consider if
dropping it isn't a better solution.

Stefan


From arigo at tunes.org  Mon Oct  1 11:40:43 2012
From: arigo at tunes.org (Armin Rigo)
Date: Mon, 1 Oct 2012 11:40:43 +0200
Subject: [Speed] slow benchmark
In-Reply-To: <506942BC.7060307@behnel.de>
References: <20121001012139.2f0150af@pitrou.net>
	<CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>
	<20121001020402.175911c8@pitrou.net>
	<CAK5idxSxJqSpPBdu26NVTD1o9cvSB=y7CMoy4rOY5ipoJ552YA@mail.gmail.com>
	<506942BC.7060307@behnel.de>
Message-ID: <CAMSv6X0u7=B74SG2yLEB_esZVDqcmFnL7R3Uh9x=BDNNYQ3ebg@mail.gmail.com>

Hi Stefan,

On Mon, Oct 1, 2012 at 9:14 AM, Stefan Behnel <stefan_ml at behnel.de> wrote:
> Either it benchmarks mostly a specific part of the overall runtime, in that
> case, there's no reason for it to take ages. It can just be stripped down
> to run a reasonably sized workload that exercises the target code well.
>
> If it does not benchmark anything specific, and thus cannot be sized down
> in any way, then what's the interesting thing that its broad and unspecific
> result would tell us?

Broad and unspecific results are what is most interesting from the
point of view of the end user using a large program.

For example, changes to the cycle collector of CPython, as occurred
between 2.6 and 2.7, had good results on large and complicated
programs but I guess not on anything typically benchmarkish.

As a result, at least one "large and complicated" program runs quite a
lot faster on CPython.  This large program is included into our
benchmark suite.  Feel free to throw it away on first principles, but
we would disagree with your approach.


A bient?t,

Armin.

From solipsis at pitrou.net  Mon Oct  1 13:46:25 2012
From: solipsis at pitrou.net (Antoine Pitrou)
Date: Mon, 1 Oct 2012 13:46:25 +0200
Subject: [Speed] slow benchmark
References: <20121001012139.2f0150af@pitrou.net>
	<CAP1=2W76p5yqFG3ozSGh3ZCRQC+zxKznJVeGwiEKv+ZRp-iz-g@mail.gmail.com>
	<20121001020402.175911c8@pitrou.net>
	<CAK5idxSxJqSpPBdu26NVTD1o9cvSB=y7CMoy4rOY5ipoJ552YA@mail.gmail.com>
Message-ID: <20121001134625.35b6addb@pitrou.net>

On Mon, 1 Oct 2012 08:47:31 +0200
Maciej Fijalkowski <fijall at gmail.com>
wrote:
> > I didn't realize when reading this discussion that hexiom2 was *that*
> > slow. I don't think a benchmark taking 100+ seconds to run *in fast
> > mode* has a place in the benchmark suite. PyPy can maintain their own
> > benchmarks in their source tree, like CPython does.
> >
> > Regards
> >
> > Antoine.
> 
> I strongly disagree. There are quite a few slow benchmarks that are
> very useful, like pypy translation toolchain. How about you skip this
> one in fast mode?

The problem is that the benchmark suite is normally runnable in
interactive mode. A very long-running benchmark isn't a good fit for
that model.
Yes, I guess we could at least skip it in fast mode.

Regards

Antoine.


-- 
Software development and contracting: http://pro.pitrou.net



From victor.stinner at gmail.com  Thu Oct 18 22:40:44 2012
From: victor.stinner at gmail.com (Victor Stinner)
Date: Thu, 18 Oct 2012 22:40:44 +0200
Subject: [Speed] Status of speed.python.org?
Message-ID: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>

Hi,

What is the status of speed.python.org? Where are the benchmarks? Does
anyone try to setup something to run regulary benchmarks and display
data on web pages?

How can I help?

Victor

From mark.john.rees at gmail.com  Fri Oct 19 00:26:41 2012
From: mark.john.rees at gmail.com (Mark Rees)
Date: Fri, 19 Oct 2012 09:26:41 +1100
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
Message-ID: <CAHqYHTYfyKyAXOY97u1J1sPU33Lr3Vc7OA2Xh8ezddRbHahGVg@mail.gmail.com>

Hi Victor,

Brett Cannon has been porting many of the benchmarks the pypy team uses to
Python 3 for the "standard" benchmark suite. During PyConAU 2012 coding
sprints I did some work on using codespeed (
https://github.com/tobami/codespeed) to work with this benchmark suite so
the speed.python.org could use it to display benchmarks. Due to some health
issues anda heavy workload, I haven't been able to put this up for people
to review. Thankfully both these impediments look like they are almost
resolved so hope to get back to it very soon. We would appreciate any help
you would want to give.

On Fri, Oct 19, 2012 at 7:40 AM, Victor Stinner <victor.stinner at gmail.com>wrote:

> Hi,
>
> What is the status of speed.python.org? Where are the benchmarks? Does
> anyone try to setup something to run regulary benchmarks and display
> data on web pages?
>
> How can I help?
>
> Victor
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/speed/attachments/20121019/a7019629/attachment.html>

From fijall at gmail.com  Fri Oct 19 12:25:51 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Fri, 19 Oct 2012 12:25:51 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
Message-ID: <CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>

On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
<victor.stinner at gmail.com> wrote:
> Hi,
>
> What is the status of speed.python.org? Where are the benchmarks? Does
> anyone try to setup something to run regulary benchmarks and display
> data on web pages?
>
> How can I help?
>
> Victor

Hi Victor.

The status is "noone cares". Brett ported a bunch of py3k benchmarks,
so I suppose this is a very good start. Someone has to add a
buildslave there (preferably for cpython buildbots) that runs
runner.py from US and uploads the info to codespeed.

Codespeed can be also set up somewhere (I did, it's not the end of the world).

Cheers,
fijal

From jnoller at gmail.com  Fri Oct 19 12:46:24 2012
From: jnoller at gmail.com (Jesse Noller)
Date: Fri, 19 Oct 2012 06:46:24 -0400
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
Message-ID: <9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>



On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com> wrote:

> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
> <victor.stinner at gmail.com> wrote:
>> Hi,
>> 
>> What is the status of speed.python.org? Where are the benchmarks? Does
>> anyone try to setup something to run regulary benchmarks and display
>> data on web pages?
>> 
>> How can I help?
>> 
>> Victor
> 
> Hi Victor.
> 
> The status is "noone cares".

Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning.


> Brett ported a bunch of py3k benchmarks,
> so I suppose this is a very good start. Someone has to add a
> buildslave there (preferably for cpython buildbots) that runs
> runner.py from US and uploads the info to codespeed.
> 
> Codespeed can be also set up somewhere (I did, it's not the end of the world).
> 
> Cheers,
> fijal
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed

From fijall at gmail.com  Fri Oct 19 16:00:24 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Fri, 19 Oct 2012 16:00:24 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
Message-ID: <CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>

On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller at gmail.com> wrote:
>
>
> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com> wrote:
>
>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
>> <victor.stinner at gmail.com> wrote:
>>> Hi,
>>>
>>> What is the status of speed.python.org? Where are the benchmarks? Does
>>> anyone try to setup something to run regulary benchmarks and display
>>> data on web pages?
>>>
>>> How can I help?
>>>
>>> Victor
>>
>> Hi Victor.
>>
>> The status is "noone cares".
>
> Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning.

Ok, to be precise "noone cares enough to make things happen", this is
a fact. I actually care to some extend and I'm willing to help with
stuff, however, there must be someone who cares more on the python
core development team to make the exercise not-completely-pointless.

Cheers,
fijal

From tobami at gmail.com  Fri Oct 19 21:38:22 2012
From: tobami at gmail.com (Miquel Torres)
Date: Fri, 19 Oct 2012 21:38:22 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
Message-ID: <CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>

Right. On the webapp (Codespeed) side of things I am willing to help
in anything you need.
The blocker has been mostly the benchmark runner, AFAIK.

Miquel


2012/10/19 Maciej Fijalkowski <fijall at gmail.com>:
> On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller at gmail.com> wrote:
>>
>>
>> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com> wrote:
>>
>>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
>>> <victor.stinner at gmail.com> wrote:
>>>> Hi,
>>>>
>>>> What is the status of speed.python.org? Where are the benchmarks? Does
>>>> anyone try to setup something to run regulary benchmarks and display
>>>> data on web pages?
>>>>
>>>> How can I help?
>>>>
>>>> Victor
>>>
>>> Hi Victor.
>>>
>>> The status is "noone cares".
>>
>> Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning.
>
> Ok, to be precise "noone cares enough to make things happen", this is
> a fact. I actually care to some extend and I'm willing to help with
> stuff, however, there must be someone who cares more on the python
> core development team to make the exercise not-completely-pointless.
>
> Cheers,
> fijal
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed

From brett at python.org  Sat Oct 20 00:08:40 2012
From: brett at python.org (Brett Cannon)
Date: Fri, 19 Oct 2012 18:08:40 -0400
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
Message-ID: <CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>

On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami at gmail.com> wrote:

> Right. On the webapp (Codespeed) side of things I am willing to help
> in anything you need.
> The blocker has been mostly the benchmark runner, AFAIK.
>
>
And how specifically is that a blocker so we can work on eliminating those
issues?

-Brett


> Miquel
>
>
> 2012/10/19 Maciej Fijalkowski <fijall at gmail.com>:
> > On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller at gmail.com>
> wrote:
> >>
> >>
> >> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com>
> wrote:
> >>
> >>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
> >>> <victor.stinner at gmail.com> wrote:
> >>>> Hi,
> >>>>
> >>>> What is the status of speed.python.org? Where are the benchmarks?
> Does
> >>>> anyone try to setup something to run regulary benchmarks and display
> >>>> data on web pages?
> >>>>
> >>>> How can I help?
> >>>>
> >>>> Victor
> >>>
> >>> Hi Victor.
> >>>
> >>> The status is "noone cares".
> >>
> >> Hi. I care. Other people do too. Maybe you don't - that's ok. The
> problem is lack of time / project planning.
> >
> > Ok, to be precise "noone cares enough to make things happen", this is
> > a fact. I actually care to some extend and I'm willing to help with
> > stuff, however, there must be someone who cares more on the python
> > core development team to make the exercise not-completely-pointless.
> >
> > Cheers,
> > fijal
> > _______________________________________________
> > Speed mailing list
> > Speed at python.org
> > http://mail.python.org/mailman/listinfo/speed
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/speed/attachments/20121019/ec983a87/attachment.html>

From andrew.svetlov at gmail.com  Sat Oct 20 00:25:57 2012
From: andrew.svetlov at gmail.com (Andrew Svetlov)
Date: Sat, 20 Oct 2012 01:25:57 +0300
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
Message-ID: <CAL3CFcUWF_0Ew-=k+8qMqpQBJKtZ-ogLOfDRsqiYyTd4WZt64w@mail.gmail.com>

I like to be a volunteer.
What shall I do? Is there some roadmap for this project?

On Sat, Oct 20, 2012 at 1:08 AM, Brett Cannon <brett at python.org> wrote:
>
>
> On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami at gmail.com> wrote:
>>
>> Right. On the webapp (Codespeed) side of things I am willing to help
>> in anything you need.
>> The blocker has been mostly the benchmark runner, AFAIK.
>>
>
> And how specifically is that a blocker so we can work on eliminating those
> issues?
>
> -Brett
>
>>
>> Miquel
>>
>>
>> 2012/10/19 Maciej Fijalkowski <fijall at gmail.com>:
>> > On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller at gmail.com>
>> > wrote:
>> >>
>> >>
>> >> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com>
>> >> wrote:
>> >>
>> >>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
>> >>> <victor.stinner at gmail.com> wrote:
>> >>>> Hi,
>> >>>>
>> >>>> What is the status of speed.python.org? Where are the benchmarks?
>> >>>> Does
>> >>>> anyone try to setup something to run regulary benchmarks and display
>> >>>> data on web pages?
>> >>>>
>> >>>> How can I help?
>> >>>>
>> >>>> Victor
>> >>>
>> >>> Hi Victor.
>> >>>
>> >>> The status is "noone cares".
>> >>
>> >> Hi. I care. Other people do too. Maybe you don't - that's ok. The
>> >> problem is lack of time / project planning.
>> >
>> > Ok, to be precise "noone cares enough to make things happen", this is
>> > a fact. I actually care to some extend and I'm willing to help with
>> > stuff, however, there must be someone who cares more on the python
>> > core development team to make the exercise not-completely-pointless.
>> >
>> > Cheers,
>> > fijal
>> > _______________________________________________
>> > Speed mailing list
>> > Speed at python.org
>> > http://mail.python.org/mailman/listinfo/speed
>> _______________________________________________
>> Speed mailing list
>> Speed at python.org
>> http://mail.python.org/mailman/listinfo/speed
>
>
>
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed
>



-- 
Thanks,
Andrew Svetlov

From ncoghlan at gmail.com  Sat Oct 20 03:51:19 2012
From: ncoghlan at gmail.com (Nick Coghlan)
Date: Sat, 20 Oct 2012 11:51:19 +1000
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAL3CFcUWF_0Ew-=k+8qMqpQBJKtZ-ogLOfDRsqiYyTd4WZt64w@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
	<CAL3CFcUWF_0Ew-=k+8qMqpQBJKtZ-ogLOfDRsqiYyTd4WZt64w@mail.gmail.com>
Message-ID: <CADiSq7d0FBwfj1cMuhvyzJ13MKHZiHKo5MCediFcdgch_jQGLQ@mail.gmail.com>

On Sat, Oct 20, 2012 at 8:25 AM, Andrew Svetlov
<andrew.svetlov at gmail.com> wrote:
> I like to be a volunteer.
> What shall I do? Is there some roadmap for this project?

The issue tracker for the project is now on the PSF's BitBucket org
account: https://bitbucket.org/PSF/python-speed/issues?status=new&status=open

It would be great if people could update those issues to indicate what
they're working on - I just sent a bunch of invitations to make sure
respondents to this thread have appropriate access.

Cheers,
Nick.

-- 
Nick Coghlan   |   ncoghlan at gmail.com   |   Brisbane, Australia

From fijall at gmail.com  Sat Oct 20 10:47:21 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Sat, 20 Oct 2012 10:47:21 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
Message-ID: <CAK5idxSVfUVBwLZxJXnn-tX+h5h8eMMPk4HbOK7XTEV9mydJkA@mail.gmail.com>

On Sat, Oct 20, 2012 at 12:08 AM, Brett Cannon <brett at python.org> wrote:
>
>
> On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami at gmail.com> wrote:
>>
>> Right. On the webapp (Codespeed) side of things I am willing to help
>> in anything you need.
>> The blocker has been mostly the benchmark runner, AFAIK.
>>
>
> And how specifically is that a blocker so we can work on eliminating those
> issues?
>
> -Brett

Log in, setup a buildbot, make sure it's connected to the python
buildmaster and it's running. Before that go to Noah and ask for an
account. Then set up a codespeed instance somewhere (not sure where)
and connect the two together.

From tobami at gmail.com  Sat Oct 20 12:32:47 2012
From: tobami at gmail.com (Miquel Torres)
Date: Sat, 20 Oct 2012 12:32:47 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAK5idxSVfUVBwLZxJXnn-tX+h5h8eMMPk4HbOK7XTEV9mydJkA@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<CAP1=2W4o2WPco7YgP+YpSecetBhMOcYK33_jJ0W-DX1b+c8oCw@mail.gmail.com>
	<CAK5idxSVfUVBwLZxJXnn-tX+h5h8eMMPk4HbOK7XTEV9mydJkA@mail.gmail.com>
Message-ID: <CAGf+9VyA7rw_h5Dx+N1UFvaK8-iniZNb42h0y--2AU-O-9-6QQ@mail.gmail.com>

Maciej: Last year, as the project begun, I immediately set up an
instance. We removed it from port 80 because nothing was ready yet,
but it has been there since:
http://speed.python.org:8080/

As soon as there is data somewhere I can upgrade and setup the
Codespeed version properly.


2012/10/20 Maciej Fijalkowski <fijall at gmail.com>:
> On Sat, Oct 20, 2012 at 12:08 AM, Brett Cannon <brett at python.org> wrote:
>>
>>
>> On Fri, Oct 19, 2012 at 3:38 PM, Miquel Torres <tobami at gmail.com> wrote:
>>>
>>> Right. On the webapp (Codespeed) side of things I am willing to help
>>> in anything you need.
>>> The blocker has been mostly the benchmark runner, AFAIK.
>>>
>>
>> And how specifically is that a blocker so we can work on eliminating those
>> issues?
>>
>> -Brett
>
> Log in, setup a buildbot, make sure it's connected to the python
> buildmaster and it's running. Before that go to Noah and ask for an
> account. Then set up a codespeed instance somewhere (not sure where)
> and connect the two together.

From senger at rehfisch.de  Sat Oct 20 13:21:20 2012
From: senger at rehfisch.de (Carsten Senger)
Date: Sat, 20 Oct 2012 13:21:20 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
Message-ID: <50828930.601@rehfisch.de>

Am 19.10.2012 21:38, schrieb Miquel Torres:
> Right. On the webapp (Codespeed) side of things I am willing to help
> in anything you need.
> The blocker has been mostly the benchmark runner, AFAIK.

Some month ago I worked on the benchmark runner and the build slave
helpers in the pypy repository. They can run the test suite for both
pypy and cpython. It will need no or minor tweeks to use python3. What
was missing back then, and IIRC planned to be discussed at PyCo, was the
port of the benchmarks to python 3.

Now it can be set up on speed.p.o (with minor adjustments if necessary).
I'd do work on that too.

..Carsten


> 2012/10/19 Maciej Fijalkowski <fijall at gmail.com>:
>> On Fri, Oct 19, 2012 at 12:46 PM, Jesse Noller <jnoller at gmail.com> wrote:
>>>
>>>
>>> On Oct 19, 2012, at 6:25 AM, Maciej Fijalkowski <fijall at gmail.com> wrote:
>>>
>>>> On Thu, Oct 18, 2012 at 10:40 PM, Victor Stinner
>>>> <victor.stinner at gmail.com> wrote:
>>>>> Hi,
>>>>>
>>>>> What is the status of speed.python.org? Where are the benchmarks? Does
>>>>> anyone try to setup something to run regulary benchmarks and display
>>>>> data on web pages?
>>>>>
>>>>> How can I help?
>>>>>
>>>>> Victor
>>>>
>>>> Hi Victor.
>>>>
>>>> The status is "noone cares".
>>>
>>> Hi. I care. Other people do too. Maybe you don't - that's ok. The problem is lack of time / project planning.
>>
>> Ok, to be precise "noone cares enough to make things happen", this is
>> a fact. I actually care to some extend and I'm willing to help with
>> stuff, however, there must be someone who cares more on the python
>> core development team to make the exercise not-completely-pointless.
>>
>> Cheers,
>> fijal
>> _______________________________________________
>> Speed mailing list
>> Speed at python.org
>> http://mail.python.org/mailman/listinfo/speed
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed
> 

-- 
Carsten Senger - Schumannstr. 38 - 65193 Wiesbaden
senger at rehfisch.de - (0611) 5324176
PGP: gpg --recv-keys --keyserver hkp://subkeys.pgp.net 0xE374C75A

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 490 bytes
Desc: OpenPGP digital signature
URL: <http://mail.python.org/pipermail/speed/attachments/20121020/e66ab163/attachment.pgp>

From fijall at gmail.com  Sun Oct 21 11:08:43 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Sun, 21 Oct 2012 11:08:43 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <50828930.601@rehfisch.de>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<50828930.601@rehfisch.de>
Message-ID: <CAK5idxS4Prpivw2k+g+syoKWDDLFicNHH6dxX-htzNuYHZ_dig@mail.gmail.com>

On Sat, Oct 20, 2012 at 1:21 PM, Carsten Senger <senger at rehfisch.de> wrote:
> Am 19.10.2012 21:38, schrieb Miquel Torres:
>> Right. On the webapp (Codespeed) side of things I am willing to help
>> in anything you need.
>> The blocker has been mostly the benchmark runner, AFAIK.
>
> Some month ago I worked on the benchmark runner and the build slave
> helpers in the pypy repository. They can run the test suite for both
> pypy and cpython. It will need no or minor tweeks to use python3. What
> was missing back then, and IIRC planned to be discussed at PyCo, was the
> port of the benchmarks to python 3.
>
> Now it can be set up on speed.p.o (with minor adjustments if necessary).
> I'd do work on that too.
>
> ..Carsten
>

FYI the running on python 2 never worked (because of option passing).
It roughly shows up how people care (or how much they know). I suppose
we can declare "running benchmarks on python 2" a completely pointless
exercise.

From senger at rehfisch.de  Sun Oct 21 14:06:59 2012
From: senger at rehfisch.de (Carsten Senger)
Date: Sun, 21 Oct 2012 14:06:59 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <CAK5idxS4Prpivw2k+g+syoKWDDLFicNHH6dxX-htzNuYHZ_dig@mail.gmail.com>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<50828930.601@rehfisch.de>
	<CAK5idxS4Prpivw2k+g+syoKWDDLFicNHH6dxX-htzNuYHZ_dig@mail.gmail.com>
Message-ID: <5083E563.50003@rehfisch.de>



Am 21.10.2012 11:08, schrieb Maciej Fijalkowski:
> On Sat, Oct 20, 2012 at 1:21 PM, Carsten Senger <senger at rehfisch.de> wrote:
>> Am 19.10.2012 21:38, schrieb Miquel Torres:
>>> Right. On the webapp (Codespeed) side of things I am willing to help
>>> in anything you need.
>>> The blocker has been mostly the benchmark runner, AFAIK.
>>
>> Some month ago I worked on the benchmark runner and the build slave
>> helpers in the pypy repository. They can run the test suite for both
>> pypy and cpython. It will need no or minor tweeks to use python3. What
>> was missing back then, and IIRC planned to be discussed at PyCo, was the
>> port of the benchmarks to python 3.
>>
>> Now it can be set up on speed.p.o (with minor adjustments if necessary).
>> I'd do work on that too.
>>
>> ..Carsten
>>
> 
> FYI the running on python 2 never worked (because of option passing).
> It roughly shows up how people care (or how much they know). I suppose
> we can declare "running benchmarks on python 2" a completely pointless
> exercise.


I know I cared. It worked with my patches that where merged by you. They
removed the hard coded configuration from the build factories and the
runner. I stopped then cause nobody was interested to collect data for
2.7 which would not receive notable changes. Same applied to historical
data for python 2. Pointless describes that very well, but for different
reasons.

There where no python 3 benchmarks and the how and when seemed more like
a political discussion to me.


..Carsten


-- 
Carsten Senger - Schumannstr. 38 - 65193 Wiesbaden
senger at rehfisch.de - (0611) 5324176
PGP: gpg --recv-keys --keyserver hkp://subkeys.pgp.net 0xE374C75A

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 490 bytes
Desc: OpenPGP digital signature
URL: <http://mail.python.org/pipermail/speed/attachments/20121021/95c57341/attachment.pgp>

From fijall at gmail.com  Sun Oct 21 14:24:27 2012
From: fijall at gmail.com (Maciej Fijalkowski)
Date: Sun, 21 Oct 2012 14:24:27 +0200
Subject: [Speed] Status of speed.python.org?
In-Reply-To: <5083E563.50003@rehfisch.de>
References: <CAMpsgwYtd_1HnZjZ74vNaOrD2KcW2NSFi9p+j4YxqsV=TWMY6w@mail.gmail.com>
	<CAK5idxScPAdLFDOY=UCVzTEhvtEpFYUwB9Fx4WOLyS_7Z=xqOg@mail.gmail.com>
	<9E373E44-5483-4EBC-BD96-B740FBA9138F@gmail.com>
	<CAK5idxTx+YDXwNAkQNQ-4y-CAAezUeNo1AeBjH4-T0i69rX3Xw@mail.gmail.com>
	<CAGf+9Vx73hwv-2Ho1JzG6vois_vAxvwpPspOHET=gwqu3sR0PQ@mail.gmail.com>
	<50828930.601@rehfisch.de>
	<CAK5idxS4Prpivw2k+g+syoKWDDLFicNHH6dxX-htzNuYHZ_dig@mail.gmail.com>
	<5083E563.50003@rehfisch.de>
Message-ID: <CAK5idxSRZC=yPLJ8iZwzh8WDYd6ZNMbkQ=YtVepN9_fvN1w27w@mail.gmail.com>

On Sun, Oct 21, 2012 at 2:06 PM, Carsten Senger <senger at rehfisch.de> wrote:
>
>
> Am 21.10.2012 11:08, schrieb Maciej Fijalkowski:
>> On Sat, Oct 20, 2012 at 1:21 PM, Carsten Senger <senger at rehfisch.de> wrote:
>>> Am 19.10.2012 21:38, schrieb Miquel Torres:
>>>> Right. On the webapp (Codespeed) side of things I am willing to help
>>>> in anything you need.
>>>> The blocker has been mostly the benchmark runner, AFAIK.
>>>
>>> Some month ago I worked on the benchmark runner and the build slave
>>> helpers in the pypy repository. They can run the test suite for both
>>> pypy and cpython. It will need no or minor tweeks to use python3. What
>>> was missing back then, and IIRC planned to be discussed at PyCo, was the
>>> port of the benchmarks to python 3.
>>>
>>> Now it can be set up on speed.p.o (with minor adjustments if necessary).
>>> I'd do work on that too.
>>>
>>> ..Carsten
>>>
>>
>> FYI the running on python 2 never worked (because of option passing).
>> It roughly shows up how people care (or how much they know). I suppose
>> we can declare "running benchmarks on python 2" a completely pointless
>> exercise.
>
>
> I know I cared. It worked with my patches that where merged by you. They
> removed the hard coded configuration from the build factories and the
> runner. I stopped then cause nobody was interested to collect data for
> 2.7 which would not receive notable changes. Same applied to historical
> data for python 2. Pointless describes that very well, but for different
> reasons.
>
> There where no python 3 benchmarks and the how and when seemed more like
> a political discussion to me.
>
>
> ..Carsten

I'm sorry, my mail was definitely too harsh.

For what is worth, there are python 3 benchmarks now. Maybe we should
somehow restart it?

Cheers,
fijal