[Speed] Codespeed up and running

Mon Sep 26 20:33:47 CEST 2011

Great Tennessee. Feel free to use your project to do the actual
benchmarking. He Who Codes Decides. That is Open Source ;-)

The tool used for PyPy (Unladen Swallow¨s) does several runs and gets
the average and standard deviation. That value is currently not used
much (and a VM/JIT makes that number probably not very useful at all),
but it does help sometimes to tell whether a strange result is caused
by the infrastructure (measuring error) or it is a genuine change in
performance. Does benchmarker.py cover that?

The Codespeed instance is already working and accessible through
http://speed.python.org
I added user "tleeuwenburg"
pass "speed" so that you can adjust environments and projects.

Ready to save data!

Anyway great to hear you are going to give it a try.
Miquel

2011/9/26 Tennessee Leeuwenburg <tleeuwenburg at gmail.com>:
> Thanks, at the point where I'm doing something, I'll remember I've got
> someone I can ask a few questions of... much appreciated!
>
> -T
>
> On Mon, Sep 26, 2011 at 10:05 AM, Noah Kantrowitz <noah at coderanger.net> wrote:
>> I'm on IRC and XMPP (coderanger, coderanger at gmail.com) if you want another pair of eyes on anything.
>>
>> --Noah
>>
>> On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote:
>>
>>> Sweet. Well, that was the biggest obstacle. Now we're back to time
>>> being the bottleneck. I'll try to find some in the next day or two and
>>> get *something* going.
>>>
>>> Cheers,
>>> -T
>>>
>>> On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz <noah at coderanger.net> wrote:
>>>> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority.
>>>>
>>>> --Noah
>>>>
>>>> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote:
>>>>
>>>>> I am more than happy to do the work (still), but am idle waiting for
>>>>> instructions on how to do about it. It seemed like I needed to use
>>>>> Chef, and make some (hopefully easy) choices about how to do it. I'll
>>>>> dig out the email I sent round outlining a task list and with a few
>>>>> queries...
>>>>>
>>>>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller <jnoller at gmail.com> wrote:
>>>>>> We need someone to do it. Are there instructions everywhere
>>>>>>
>>>>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres <tobami at googlemail.com> wrote:
>>>>>>
>>>>>>> So, is anyone working on the benchmark runner part? or should we
>>>>>>> "resign" that task, or look for other possibilities?
>>>>>>>
>>>>>>> Miquel
>>>>>>>
>>>>>>>
>>>>>>> 2011/9/14 Miquel Torres <tobami at googlemail.com>:
>>>>>>>> Ok, great!
>>>>>>>>
>>>>>>>> I can help out by giving you the rough recipe outline:
>>>>>>>> ============================================
>>>>>>>> include_recipe "apache2::mod_wsgi"
>>>>>>>>
>>>>>>>> easy_install "codespeed"
>>>>>>>>
>>>>>>>> web_app "codespeed" do
>>>>>>>>  server_name node['hostname']
>>>>>>>>  server_aliases [node['fqdn'], "speed.python.org"]
>>>>>>>>  template "speed.conf.erb"
>>>>>>>>  docroot "/home/tobami/speed/"  # though we can change that
>>>>>>>> end
>>>>>>>> ============================================
>>>>>>>>
>>>>>>>> As a base for the custom template you can take the current
>>>>>>>> /etc/apache2/sites-enables/codespeed
>>>>>>>>
>>>>>>>> Now this is were things get more complicated. The Django project is
>>>>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy
>>>>>>>> anything).
>>>>>>>> The speed/templates/ contains the basic templates for the views. and
>>>>>>>> the content of sitestatic was created with "./manage.py
>>>>>>>> collectstatic".
>>>>>>>>
>>>>>>>> So this last part will need some execute block or similar. For
>>>>>>>> anything else you need just ask and I'll help!
>>>>>>>>
>>>>>>>> Miquel
>>>>>>>>
>>>>>>>>
>>>>>>>> PS: Python logo is up ;-)
>>>>>>>>
>>>>>>>>
>>>>>>>> 2011/9/14 Noah Kantrowitz <noah at coderanger.net>:
>>>>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly!
>>>>>>>>>
>>>>>>>>> --Noah
>>>>>>>>>
>>>>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote:
>>>>>>>>>
>>>>>>>>>> Hi Noah,
>>>>>>>>>>
>>>>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of
>>>>>>>>>> course like to have a cookbook and run_list for it all, but I am not
>>>>>>>>>> there yet.
>>>>>>>>>>
>>>>>>>>>> Miquel
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 2011/9/13 Noah Kantrowitz <noah at coderanger.net>:
>>>>>>>>>>> Just wanted to poke about this again post-weekend :-)
>>>>>>>>>>>
>>>>>>>>>>> --Noah
>>>>>>>>>>>
>>>>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-)
>>>>>>>>>>>>
>>>>>>>>>>>> --Noah
>>>>>>>>>>>>
>>>>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi all,
>>>>>>>>>>>>>
>>>>>>>>>>>>> it took longer than expected, but speed.python.org points now to a
>>>>>>>>>>>>> proper Codespeed instance!
>>>>>>>>>>>>> The admin media does not yet load properly, need to fix that yet.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I
>>>>>>>>>>>>> looks like we are going to directly test on that big server, bare
>>>>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster?
>>>>>>>>>>>>>
>>>>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a
>>>>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we
>>>>>>>>>>>>> are still setting up thing, and only go live when we are finished and
>>>>>>>>>>>>> want to announce.
>>>>>>>>>>>>>
>>>>>>>>>>>>> What do you think?
>>>>>>>>>>>>> Miquel
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Speed mailing list
>>>>>>>>>>>>> Speed at python.org
>>>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed
>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Speed mailing list
>>>>>>>>>>>> Speed at python.org
>>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Speed mailing list
>>>>>>> Speed at python.org
>>>>>>> http://mail.python.org/mailman/listinfo/speed
>>>>>> _______________________________________________
>>>>>> Speed mailing list
>>>>>> Speed at python.org
>>>>>> http://mail.python.org/mailman/listinfo/speed
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> --------------------------------------------------
>>>>> Tennessee Leeuwenburg
>>>>> http://myownhat.blogspot.com/
>>>>> "Don't believe everything you think"
>>>>> _______________________________________________
>>>>> Speed mailing list
>>>>> Speed at python.org
>>>>> http://mail.python.org/mailman/listinfo/speed
>>>>
>>>>
>>>> -----BEGIN PGP SIGNATURE-----
>>>>
>>>> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd
>>>> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ
>>>> =JlrA
>>>> -----END PGP SIGNATURE-----
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> --------------------------------------------------
>>> Tennessee Leeuwenburg
>>> http://myownhat.blogspot.com/
>>> "Don't believe everything you think"
>>
>>
>> -----BEGIN PGP SIGNATURE-----
>>
>> iEYEARECAAYFAk5/wdQACgkQA9fEp2eRsU8HiACgj0YYa4Gd87G+2F0IsLek8tV5
>> p+IAoLobJ2dBZnIvipB6FusJgqJSq3A/
>> =+vkF
>> -----END PGP SIGNATURE-----
>>
>>
>
>
>
> --
> --------------------------------------------------
> Tennessee Leeuwenburg
> http://myownhat.blogspot.com/
> "Don't believe everything you think"
> _______________________________________________
> Speed mailing list
> Speed at python.org
> http://mail.python.org/mailman/listinfo/speed
>