From tleeuwenburg at gmail.com Thu Sep 1 08:45:00 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Thu, 1 Sep 2011 16:45:00 +1000 Subject: [Speed] [pypy-dev] Co-ordinating benchmarking Message-ID: Okay, so all of a sudden there seem to be a *lot* of people looking at this. This was a long thread quickly, and I only just got up to speed with it. There are a lot of new names, and I don't know what existing skills, interest and territories exist. Apologies for any faux pas. I would like to organise the list of tasks a bit more clearly if that is okay. I may be less familiar with the parts of this process than others, so I just want to get it down clearly. What I've done: -- Clone the Python repo into /home/speedracer/cpython/cpython (updated to 2.7) -- Installed os packages to support a reasonable build. -- Built and installed python2.7 into /home/speedraver/cpython/27_bin Presumably, people would like to be monitoring both PyPy and Cpython as they progress over time. This means some kind of auto runner which updates from the repo, re-runs the timings, and submits them to codespeed. I am unclear on whether there is a "clear winner" for this piece of technology. List of Required Infrastructure on speed.python.org: -- A home for the cpython repo (check) -- An installed and running codespeed server (pending) -- A buildbot / automation for keeping up to date with the PyPy and cpython repos (???) -- Automation to execute a process which must (???) 1) Run the benchmarks 2) Submit results to codespeed I would suggest that the codespeed server be installed into speedracer's home directory. This must all be installable and configurable from Chef (which appears to me like Fabric, i.e. an automation tool for deployment and management of systems). This is not yet accomplished. We also clearly need some kind of wiki documentation on what is going on, so that contributors (or just newbies like me) can figure out where things are at and what is going on. The bitbucket project is great, but the task titles are currently rather brief if someone isn't already totally up-to-speed on what is going on. There appear to me to be two unresolved questions: 1) What piece of technology should we use for a buildbot / build automation 2) What piece of technology should we use for the benchmark runner? I have no suggestions on (1), it's not a strong point for me. As regards (2), I am ignorant to what others might already be using, except to say the landscape seems unclear and fractured to me. My work, benchmarker.py, is likely to be adaptable to our needs and I am more than happy to support the package so it can be applied here. As I understand it, the GSOC project was about the actual benchmarking functions, not so much about automation and support for managing the results of benchmarking. If an already-working alternative to benchmarker.py exists and makes more sense to use, then that is fine by me. I would still like to help out to learn more about benchmarking. The main issue with me as a contributor will be time. I have a full plate as a result of Real Life, so I will sometimes go dark for a week or so. However, I'm motivated and interested, and can put in a few hours a week most weeks. Do I have this right? Is that a reasonable description of the work breakdown? Do we have clear names against tasks so that co-ordination can be done through those people (rather than via the whole list)? Regards, -Tennessee On Thu, Sep 1, 2011 at 6:28 AM, Noah Kantrowitz wrote: > Its all branches all the way down, so we can start work anywhere and push it to an "official" PSF bin later I think. I'm sure we will want to host a mirror of it on the python.org hg server too, just for discoverability. > > --Noah > > On Aug 31, 2011, at 1:12 PM, Miquel Torres wrote: > >> Oh, cool, so there will be an Opscode hosted account for the PSF, >> right? Then the Chef repo should be for the PSF. Maybe in a current >> account somewhere? What do you propose? >> >> Miquel >> >> >> 2011/8/31 Noah Kantrowitz : >>> Opscode has already agreed to donate a Hosted account as long we keep it under ~20 clients :-) I can hand out the info for it to anyone that wants. As for setting up the Chef repo, just remember we are trying to not manage this system in isolation and that it will be part of a bigger PSF infrastructure management effort. >>> >>> --Noah >>> >>> On Aug 31, 2011, at 11:34 AM, Miquel Torres wrote: >>> >>>> Hi all, >>>> >>>> though I took up on the task of installing a Codespeed instance >>>> myself, I didn't have time until now. This weekend I will definitely >>>> have ?a *lot* of time to work on this, so count on that task being >>>> done by then. >>>> >>>> The bitbucket issue tracker is a start (though a organization account >>>> would be better) and the splash page is great. So let's get started >>>> organizing things. >>>> >>>> Regarding the deployment strategy, it turns out I use Chef at work, so >>>> I am in full agreement with Noah here (yey!). Actually, I am the >>>> author of LittleChef (which we can use as a tool to execute Chef on >>>> the node). >>>> >>>> So, Configuration Management. I would propose that Noah starts the >>>> repo with the Chef cookbooks (preferably a complete LittleChef >>>> kitchen, but that is not a must :), and gets the main recipes (apache, >>>> django) going, while I create a cookbook for Codespeed. What do you >>>> think? >>>> >>>> The benchmark runner question is still open. We need to clarify that. >>>> Use the pypy runner? Tennessee's work? >>>> >>>> Regarding repositories and issues, we could maybe have a "speed" >>>> organization account (not sure on Bitbucket, you can do that in >>>> Github), where we have a wiki, issues, and runner + config management >>>> repo + other stuff. >>>> >>>> Cheers, >>>> Miquel >>>> >>>> 2011/8/31 Jesse Noller : >>>>> I've put up a splash page for the project this AM: >>>>> >>>>> http://speed.python.org/ >>>>> >>>>> jesse >>>>> _______________________________________________ >>>>> pypy-dev mailing list >>>>> pypy-dev at python.org >>>>> http://mail.python.org/mailman/listinfo/pypy-dev >>>>> >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> >>> > > > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed > > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From anto.cuni at gmail.com Thu Sep 1 09:50:14 2011 From: anto.cuni at gmail.com (Antonio Cuni) Date: Thu, 01 Sep 2011 09:50:14 +0200 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: Message-ID: <4E5F3936.8050002@gmail.com> On 31/08/11 22:11, Brett Cannon wrote: > The PyPy folk could answer this as they have their repo on bitbucket > already. Else I guess we can just create a standalone account that > represents the official speed.python.org account. for pypy we do exactly that. There is a bitbucket user named "pypy" whose credentials are shared among all the core devs. ciao, Anto From ncoghlan at gmail.com Thu Sep 1 10:10:27 2011 From: ncoghlan at gmail.com (Nick Coghlan) Date: Thu, 1 Sep 2011 18:10:27 +1000 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: <4E5F3936.8050002@gmail.com> References: <4E5F3936.8050002@gmail.com> Message-ID: On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: > On 31/08/11 22:11, Brett Cannon wrote: >> >> The PyPy folk could answer this as they have their repo on bitbucket >> already. Else I guess we can just create a standalone account that >> represents the official speed.python.org account. > > for pypy we do exactly that. There is a bitbucket user named "pypy" whose > credentials are shared among all the core devs. The security auditing part of my brain has its fingers in its ears and is singing "La La La" rather loudly :) Cheers, Nick. -- Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia From brett at python.org Thu Sep 1 20:10:21 2011 From: brett at python.org (Brett Cannon) Date: Thu, 1 Sep 2011 11:10:21 -0700 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: > On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >> On 31/08/11 22:11, Brett Cannon wrote: >>> >>> The PyPy folk could answer this as they have their repo on bitbucket >>> already. Else I guess we can just create a standalone account that >>> represents the official speed.python.org account. >> >> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >> credentials are shared among all the core devs. > > The security auditing part of my brain has its fingers in its ears and > is singing "La La La" rather loudly :) What about Google Code? Projects there can have multiple owners and they support hg, have a tracker, and a wiki. > > Cheers, > Nick. > > -- > Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia > From tobami at googlemail.com Thu Sep 1 20:44:27 2011 From: tobami at googlemail.com (Miquel Torres) Date: Thu, 1 Sep 2011 20:44:27 +0200 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: You can also do that in Github, which I prefer. However, since CPython and PyPy use mercurial, the general preference for Bitbucket is understandable. 2011/9/1 Brett Cannon : > On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>> On 31/08/11 22:11, Brett Cannon wrote: >>>> >>>> The PyPy folk could answer this as they have their repo on bitbucket >>>> already. Else I guess we can just create a standalone account that >>>> represents the official speed.python.org account. >>> >>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>> credentials are shared among all the core devs. >> >> The security auditing part of my brain has its fingers in its ears and >> is singing "La La La" rather loudly :) > > What about Google Code? Projects there can have multiple owners and > they support hg, have a tracker, and a wiki. > > >> >> Cheers, >> Nick. >> >> -- >> Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia >> > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed > From stefan_ml at behnel.de Fri Sep 2 15:46:59 2011 From: stefan_ml at behnel.de (Stefan Behnel) Date: Fri, 02 Sep 2011 15:46:59 +0200 Subject: [Speed] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: <4E60DE53.80205@behnel.de> Miquel Torres, 01.09.2011 20:44: > You can also do that in Github, which I prefer. > > However, since CPython and PyPy use mercurial, the general preference > for Bitbucket is understandable. Note that github is perfectly usable with hg, using hg-git. Stefan From jnoller at gmail.com Thu Sep 8 15:15:54 2011 From: jnoller at gmail.com (Jesse Noller) Date: Thu, 8 Sep 2011 09:15:54 -0400 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: PING: Did we make progress? On Thu, Sep 1, 2011 at 2:44 PM, Miquel Torres wrote: > You can also do that in Github, which I prefer. > > However, since CPython and PyPy use mercurial, the general preference > for Bitbucket is understandable. > > > 2011/9/1 Brett Cannon : >> On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >>> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>>> On 31/08/11 22:11, Brett Cannon wrote: >>>>> >>>>> The PyPy folk could answer this as they have their repo on bitbucket >>>>> already. Else I guess we can just create a standalone account that >>>>> represents the official speed.python.org account. >>>> >>>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>>> credentials are shared among all the core devs. >>> >>> The security auditing part of my brain has its fingers in its ears and >>> is singing "La La La" rather loudly :) >> >> What about Google Code? Projects there can have multiple owners and >> they support hg, have a tracker, and a wiki. >> >> >>> >>> Cheers, >>> Nick. >>> >>> -- >>> Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia >>> >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed >> > _______________________________________________ > pypy-dev mailing list > pypy-dev at python.org > http://mail.python.org/mailman/listinfo/pypy-dev > From tobami at googlemail.com Thu Sep 8 21:16:51 2011 From: tobami at googlemail.com (Miquel Torres) Date: Thu, 8 Sep 2011 21:16:51 +0200 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: Hi Jesse, Sorry, I spent last week polishing up some things to be able to release Codespeed 0.9.1 and deploy that, because I had some Apache configuration issues... I'll have to try again this weekend. Cheers, Miquel 2011/9/8 Jesse Noller : > PING: Did we make progress? > > On Thu, Sep 1, 2011 at 2:44 PM, Miquel Torres wrote: >> You can also do that in Github, which I prefer. >> >> However, since CPython and PyPy use mercurial, the general preference >> for Bitbucket is understandable. >> >> >> 2011/9/1 Brett Cannon : >>> On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >>>> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>>>> On 31/08/11 22:11, Brett Cannon wrote: >>>>>> >>>>>> The PyPy folk could answer this as they have their repo on bitbucket >>>>>> already. Else I guess we can just create a standalone account that >>>>>> represents the official speed.python.org account. >>>>> >>>>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>>>> credentials are shared among all the core devs. >>>> >>>> The security auditing part of my brain has its fingers in its ears and >>>> is singing "La La La" rather loudly :) >>> >>> What about Google Code? Projects there can have multiple owners and >>> they support hg, have a tracker, and a wiki. >>> >>> >>>> >>>> Cheers, >>>> Nick. >>>> >>>> -- >>>> Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia >>>> >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >>> >> _______________________________________________ >> pypy-dev mailing list >> pypy-dev at python.org >> http://mail.python.org/mailman/listinfo/pypy-dev >> > From tleeuwenburg at gmail.com Fri Sep 9 01:04:10 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Fri, 9 Sep 2011 09:04:10 +1000 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: I would be more than happy to be progressing the cpython benchmarking automation, but I got no reply to my email summarising what needed to be done based on the comments from the list... I'm worried that anything I do will have to be undone if I don't follow the right path in terms of setting up buildbots, using Chef, etc etc. Thanks, -T On Fri, Sep 9, 2011 at 5:16 AM, Miquel Torres wrote: > Hi Jesse, > > Sorry, I spent last week polishing up some things to be able to > release Codespeed 0.9.1 and deploy that, because I had some Apache > configuration issues... > I'll have to try again this weekend. > > Cheers, > Miquel > > > 2011/9/8 Jesse Noller : >> PING: Did we make progress? >> >> On Thu, Sep 1, 2011 at 2:44 PM, Miquel Torres wrote: >>> You can also do that in Github, which I prefer. >>> >>> However, since CPython and PyPy use mercurial, the general preference >>> for Bitbucket is understandable. >>> >>> >>> 2011/9/1 Brett Cannon : >>>> On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >>>>> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>>>>> On 31/08/11 22:11, Brett Cannon wrote: >>>>>>> >>>>>>> The PyPy folk could answer this as they have their repo on bitbucket >>>>>>> already. Else I guess we can just create a standalone account that >>>>>>> represents the official speed.python.org account. >>>>>> >>>>>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>>>>> credentials are shared among all the core devs. >>>>> >>>>> The security auditing part of my brain has its fingers in its ears and >>>>> is singing "La La La" rather loudly :) >>>> >>>> What about Google Code? Projects there can have multiple owners and >>>> they support hg, have a tracker, and a wiki. >>>> >>>> >>>>> >>>>> Cheers, >>>>> Nick. >>>>> >>>>> -- >>>>> Nick Coghlan?? |?? ncoghlan at gmail.com?? |?? Brisbane, Australia >>>>> >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>>> >>> _______________________________________________ >>> pypy-dev mailing list >>> pypy-dev at python.org >>> http://mail.python.org/mailman/listinfo/pypy-dev >>> >> > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From jnoller at gmail.com Fri Sep 9 01:07:34 2011 From: jnoller at gmail.com (Jesse Noller) Date: Thu, 8 Sep 2011 19:07:34 -0400 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: References: <4E5F3936.8050002@gmail.com> Message-ID: <09310A69-6D78-4CFA-973C-9CFD7335C173@gmail.com> Miquel, Noah and the people who know what needs to be ran should be able to fill you in. You're right to not want to duplicate or do busy work. On Sep 8, 2011, at 7:04 PM, Tennessee Leeuwenburg wrote: > I would be more than happy to be progressing the cpython benchmarking > automation, but I got no reply to my email summarising what needed to > be done based on the comments from the list... I'm worried that > anything I do will have to be undone if I don't follow the right path > in terms of setting up buildbots, using Chef, etc etc. > > Thanks, > -T > > On Fri, Sep 9, 2011 at 5:16 AM, Miquel Torres wrote: >> Hi Jesse, >> >> Sorry, I spent last week polishing up some things to be able to >> release Codespeed 0.9.1 and deploy that, because I had some Apache >> configuration issues... >> I'll have to try again this weekend. >> >> Cheers, >> Miquel >> >> >> 2011/9/8 Jesse Noller : >>> PING: Did we make progress? >>> >>> On Thu, Sep 1, 2011 at 2:44 PM, Miquel Torres wrote: >>>> You can also do that in Github, which I prefer. >>>> >>>> However, since CPython and PyPy use mercurial, the general preference >>>> for Bitbucket is understandable. >>>> >>>> >>>> 2011/9/1 Brett Cannon : >>>>> On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >>>>>> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>>>>>> On 31/08/11 22:11, Brett Cannon wrote: >>>>>>>> >>>>>>>> The PyPy folk could answer this as they have their repo on bitbucket >>>>>>>> already. Else I guess we can just create a standalone account that >>>>>>>> represents the official speed.python.org account. >>>>>>> >>>>>>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>>>>>> credentials are shared among all the core devs. >>>>>> >>>>>> The security auditing part of my brain has its fingers in its ears and >>>>>> is singing "La La La" rather loudly :) >>>>> >>>>> What about Google Code? Projects there can have multiple owners and >>>>> they support hg, have a tracker, and a wiki. >>>>> >>>>> >>>>>> >>>>>> Cheers, >>>>>> Nick. >>>>>> >>>>>> -- >>>>>> Nick Coghlan | ncoghlan at gmail.com | Brisbane, Australia >>>>>> >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>> _______________________________________________ >>>> pypy-dev mailing list >>>> pypy-dev at python.org >>>> http://mail.python.org/mailman/listinfo/pypy-dev >>>> >>> >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed >> > > > > -- > -------------------------------------------------- > Tennessee Leeuwenburg > http://myownhat.blogspot.com/ > "Don't believe everything you think" From noah at coderanger.net Fri Sep 9 01:29:00 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Thu, 8 Sep 2011 16:29:00 -0700 Subject: [Speed] [pypy-dev] Moving the project forward In-Reply-To: <09310A69-6D78-4CFA-973C-9CFD7335C173@gmail.com> References: <4E5F3936.8050002@gmail.com> <09310A69-6D78-4CFA-973C-9CFD7335C173@gmail.com> Message-ID: Sorry, been somewhat incommunicado this week due to DjangoCon. I will write up a summary of the next steps the moment I get home! --Noah On Sep 8, 2011, at 4:07 PM, Jesse Noller wrote: > Miquel, Noah and the people who know what needs to be ran should be able to fill you in. You're right to not want to duplicate or do busy work. > > > On Sep 8, 2011, at 7:04 PM, Tennessee Leeuwenburg wrote: > >> I would be more than happy to be progressing the cpython benchmarking >> automation, but I got no reply to my email summarising what needed to >> be done based on the comments from the list... I'm worried that >> anything I do will have to be undone if I don't follow the right path >> in terms of setting up buildbots, using Chef, etc etc. >> >> Thanks, >> -T >> >> On Fri, Sep 9, 2011 at 5:16 AM, Miquel Torres wrote: >>> Hi Jesse, >>> >>> Sorry, I spent last week polishing up some things to be able to >>> release Codespeed 0.9.1 and deploy that, because I had some Apache >>> configuration issues... >>> I'll have to try again this weekend. >>> >>> Cheers, >>> Miquel >>> >>> >>> 2011/9/8 Jesse Noller : >>>> PING: Did we make progress? >>>> >>>> On Thu, Sep 1, 2011 at 2:44 PM, Miquel Torres wrote: >>>>> You can also do that in Github, which I prefer. >>>>> >>>>> However, since CPython and PyPy use mercurial, the general preference >>>>> for Bitbucket is understandable. >>>>> >>>>> >>>>> 2011/9/1 Brett Cannon : >>>>>> On Thu, Sep 1, 2011 at 01:10, Nick Coghlan wrote: >>>>>>> On Thu, Sep 1, 2011 at 5:50 PM, Antonio Cuni wrote: >>>>>>>> On 31/08/11 22:11, Brett Cannon wrote: >>>>>>>>> >>>>>>>>> The PyPy folk could answer this as they have their repo on bitbucket >>>>>>>>> already. Else I guess we can just create a standalone account that >>>>>>>>> represents the official speed.python.org account. >>>>>>>> >>>>>>>> for pypy we do exactly that. There is a bitbucket user named "pypy" whose >>>>>>>> credentials are shared among all the core devs. >>>>>>> >>>>>>> The security auditing part of my brain has its fingers in its ears and >>>>>>> is singing "La La La" rather loudly :) >>>>>> >>>>>> What about Google Code? Projects there can have multiple owners and >>>>>> they support hg, have a tracker, and a wiki. >>>>>> >>>>>> >>>>>>> >>>>>>> Cheers, >>>>>>> Nick. >>>>>>> >>>>>>> -- >>>>>>> Nick Coghlan | ncoghlan at gmail.com | Brisbane, Australia >>>>>>> >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>> _______________________________________________ >>>>> pypy-dev mailing list >>>>> pypy-dev at python.org >>>>> http://mail.python.org/mailman/listinfo/pypy-dev >>>>> >>>> >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >>> >> >> >> >> -- >> -------------------------------------------------- >> Tennessee Leeuwenburg >> http://myownhat.blogspot.com/ >> "Don't believe everything you think" > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4789 bytes Desc: not available URL: From tobami at googlemail.com Sun Sep 11 11:15:37 2011 From: tobami at googlemail.com (Miquel Torres) Date: Sun, 11 Sep 2011 11:15:37 +0200 Subject: [Speed] Codespeed up and running Message-ID: Hi all, it took longer than expected, but speed.python.org points now to a proper Codespeed instance! The admin media does not yet load properly, need to fix that yet. Anyway, for further configuring, we need to define an environment. I looks like we are going to directly test on that big server, bare metal. Should we call it by a name? or just 24-Core-monster? As to the welcome page, if you prefer we can put it back in, with a link to a subdomain or other URL were we keep Codespeed as long as we are still setting up thing, and only go live when we are finished and want to announce. What do you think? Miquel From jnoller at gmail.com Sun Sep 11 12:49:15 2011 From: jnoller at gmail.com (Jesse Noller) Date: Sun, 11 Sep 2011 06:49:15 -0400 Subject: [Speed] Codespeed up and running In-Reply-To: References: Message-ID: <859BC7D0-E2E4-4A51-9615-19689C11DD08@gmail.com> Awesome - I think the welcoming page information has to live somewhere, moving it to an "about" sub page works for me As for the name, just name it "speed-primary" for now On Sep 11, 2011, at 5:15 AM, Miquel Torres wrote: > Hi all, > > it took longer than expected, but speed.python.org points now to a > proper Codespeed instance! > The admin media does not yet load properly, need to fix that yet. > > Anyway, for further configuring, we need to define an environment. I > looks like we are going to directly test on that big server, bare > metal. Should we call it by a name? or just 24-Core-monster? > > As to the welcome page, if you prefer we can put it back in, with a > link to a subdomain or other URL were we keep Codespeed as long as we > are still setting up thing, and only go live when we are finished and > want to announce. > > What do you think? > Miquel > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed From noah at coderanger.net Mon Sep 12 00:39:07 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Sun, 11 Sep 2011 15:39:07 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: Message-ID: Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) --Noah On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: > Hi all, > > it took longer than expected, but speed.python.org points now to a > proper Codespeed instance! > The admin media does not yet load properly, need to fix that yet. > > Anyway, for further configuring, we need to define an environment. I > looks like we are going to directly test on that big server, bare > metal. Should we call it by a name? or just 24-Core-monster? > > As to the welcome page, if you prefer we can put it back in, with a > link to a subdomain or other URL were we keep Codespeed as long as we > are still setting up thing, and only go live when we are finished and > want to announce. > > What do you think? > Miquel > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4789 bytes Desc: not available URL: From noah at coderanger.net Tue Sep 13 04:46:19 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Mon, 12 Sep 2011 19:46:19 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: Message-ID: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> Just wanted to poke about this again post-weekend :-) --Noah On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: > Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) > > --Noah > > On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: > >> Hi all, >> >> it took longer than expected, but speed.python.org points now to a >> proper Codespeed instance! >> The admin media does not yet load properly, need to fix that yet. >> >> Anyway, for further configuring, we need to define an environment. I >> looks like we are going to directly test on that big server, bare >> metal. Should we call it by a name? or just 24-Core-monster? >> >> As to the welcome page, if you prefer we can put it back in, with a >> link to a subdomain or other URL were we keep Codespeed as long as we >> are still setting up thing, and only go live when we are finished and >> want to announce. >> >> What do you think? >> Miquel >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed > > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4789 bytes Desc: not available URL: From tobami at googlemail.com Wed Sep 14 20:21:34 2011 From: tobami at googlemail.com (Miquel Torres) Date: Wed, 14 Sep 2011 20:21:34 +0200 Subject: [Speed] Codespeed up and running In-Reply-To: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> Message-ID: Hi Noah, I didn't use any recipes for it, was more of a one-off. Would of course like to have a cookbook and run_list for it all, but I am not there yet. Miquel 2011/9/13 Noah Kantrowitz : > Just wanted to poke about this again post-weekend :-) > > --Noah > > On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: > >> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >> >> --Noah >> >> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >> >>> Hi all, >>> >>> it took longer than expected, but speed.python.org points now to a >>> proper Codespeed instance! >>> The admin media does not yet load properly, need to fix that yet. >>> >>> Anyway, for further configuring, we need to define an environment. I >>> looks like we are going to directly test on that big server, bare >>> metal. Should we call it by a name? or just 24-Core-monster? >>> >>> As to the welcome page, if you prefer we can put it back in, with a >>> link to a subdomain or other URL were we keep Codespeed as long as we >>> are still setting up thing, and only go live when we are finished and >>> want to announce. >>> >>> What do you think? >>> Miquel >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >> >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed > > From noah at coderanger.net Wed Sep 14 20:22:40 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Wed, 14 Sep 2011 11:22:40 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> Message-ID: <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! --Noah On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: > Hi Noah, > > I didn't use any recipes for it, was more of a one-off. Would of > course like to have a cookbook and run_list for it all, but I am not > there yet. > > Miquel > > > 2011/9/13 Noah Kantrowitz : >> Just wanted to poke about this again post-weekend :-) >> >> --Noah >> >> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >> >>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>> >>> --Noah >>> >>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>> >>>> Hi all, >>>> >>>> it took longer than expected, but speed.python.org points now to a >>>> proper Codespeed instance! >>>> The admin media does not yet load properly, need to fix that yet. >>>> >>>> Anyway, for further configuring, we need to define an environment. I >>>> looks like we are going to directly test on that big server, bare >>>> metal. Should we call it by a name? or just 24-Core-monster? >>>> >>>> As to the welcome page, if you prefer we can put it back in, with a >>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>> are still setting up thing, and only go live when we are finished and >>>> want to announce. >>>> >>>> What do you think? >>>> Miquel >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >> >> From tobami at googlemail.com Wed Sep 14 21:16:46 2011 From: tobami at googlemail.com (Miquel Torres) Date: Wed, 14 Sep 2011 21:16:46 +0200 Subject: [Speed] Codespeed up and running In-Reply-To: <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> Message-ID: Ok, great! I can help out by giving you the rough recipe outline: ============================================ include_recipe "apache2::mod_wsgi" easy_install "codespeed" web_app "codespeed" do server_name node['hostname'] server_aliases [node['fqdn'], "speed.python.org"] template "speed.conf.erb" docroot "/home/tobami/speed/" # though we can change that end ============================================ As a base for the custom template you can take the current /etc/apache2/sites-enables/codespeed Now this is were things get more complicated. The Django project is under /home/tobami/speed/, with www-data permissions (so you can copy anything). The speed/templates/ contains the basic templates for the views. and the content of sitestatic was created with "./manage.py collectstatic". So this last part will need some execute block or similar. For anything else you need just ask and I'll help! Miquel PS: Python logo is up ;-) 2011/9/14 Noah Kantrowitz : > No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! > > --Noah > > On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: > >> Hi Noah, >> >> I didn't use any recipes for it, was more of a one-off. Would of >> course like to have a cookbook and run_list for it all, but I am not >> there yet. >> >> Miquel >> >> >> 2011/9/13 Noah Kantrowitz : >>> Just wanted to poke about this again post-weekend :-) >>> >>> --Noah >>> >>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>> >>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>> >>>> --Noah >>>> >>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>> >>>>> Hi all, >>>>> >>>>> it took longer than expected, but speed.python.org points now to a >>>>> proper Codespeed instance! >>>>> The admin media does not yet load properly, need to fix that yet. >>>>> >>>>> Anyway, for further configuring, we need to define an environment. I >>>>> looks like we are going to directly test on that big server, bare >>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>> >>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>> are still setting up thing, and only go live when we are finished and >>>>> want to announce. >>>>> >>>>> What do you think? >>>>> Miquel >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>> >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> >>> > > From tobami at googlemail.com Sun Sep 25 19:55:03 2011 From: tobami at googlemail.com (Miquel Torres) Date: Sun, 25 Sep 2011 19:55:03 +0200 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> Message-ID: So, is anyone working on the benchmark runner part? or should we "resign" that task, or look for other possibilities? Miquel 2011/9/14 Miquel Torres : > Ok, great! > > I can help out by giving you the rough recipe outline: > ============================================ > include_recipe "apache2::mod_wsgi" > > easy_install "codespeed" > > web_app "codespeed" do > ?server_name node['hostname'] > ?server_aliases [node['fqdn'], "speed.python.org"] > ?template "speed.conf.erb" > ?docroot "/home/tobami/speed/" ?# though we can change that > end > ============================================ > > As a base for the custom template you can take the current > /etc/apache2/sites-enables/codespeed > > Now this is were things get more complicated. The Django project is > under /home/tobami/speed/, with www-data permissions (so you can copy > anything). > The speed/templates/ contains the basic templates for the views. and > the content of sitestatic was created with "./manage.py > collectstatic". > > So this last part will need some execute block or similar. For > anything else you need just ask and I'll help! > > Miquel > > > PS: Python logo is up ;-) > > > 2011/9/14 Noah Kantrowitz : >> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >> >> --Noah >> >> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >> >>> Hi Noah, >>> >>> I didn't use any recipes for it, was more of a one-off. Would of >>> course like to have a cookbook and run_list for it all, but I am not >>> there yet. >>> >>> Miquel >>> >>> >>> 2011/9/13 Noah Kantrowitz : >>>> Just wanted to poke about this again post-weekend :-) >>>> >>>> --Noah >>>> >>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>> >>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>> >>>>> --Noah >>>>> >>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>> >>>>>> Hi all, >>>>>> >>>>>> it took longer than expected, but speed.python.org points now to a >>>>>> proper Codespeed instance! >>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>> >>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>> looks like we are going to directly test on that big server, bare >>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>> >>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>> are still setting up thing, and only go live when we are finished and >>>>>> want to announce. >>>>>> >>>>>> What do you think? >>>>>> Miquel >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>> >>>> >> >> > From jnoller at gmail.com Sun Sep 25 21:13:19 2011 From: jnoller at gmail.com (Jesse Noller) Date: Sun, 25 Sep 2011 15:13:19 -0400 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> Message-ID: <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> We need someone to do it. Are there instructions everywhere On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: > So, is anyone working on the benchmark runner part? or should we > "resign" that task, or look for other possibilities? > > Miquel > > > 2011/9/14 Miquel Torres : >> Ok, great! >> >> I can help out by giving you the rough recipe outline: >> ============================================ >> include_recipe "apache2::mod_wsgi" >> >> easy_install "codespeed" >> >> web_app "codespeed" do >> server_name node['hostname'] >> server_aliases [node['fqdn'], "speed.python.org"] >> template "speed.conf.erb" >> docroot "/home/tobami/speed/" # though we can change that >> end >> ============================================ >> >> As a base for the custom template you can take the current >> /etc/apache2/sites-enables/codespeed >> >> Now this is were things get more complicated. The Django project is >> under /home/tobami/speed/, with www-data permissions (so you can copy >> anything). >> The speed/templates/ contains the basic templates for the views. and >> the content of sitestatic was created with "./manage.py >> collectstatic". >> >> So this last part will need some execute block or similar. For >> anything else you need just ask and I'll help! >> >> Miquel >> >> >> PS: Python logo is up ;-) >> >> >> 2011/9/14 Noah Kantrowitz : >>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>> >>> --Noah >>> >>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>> >>>> Hi Noah, >>>> >>>> I didn't use any recipes for it, was more of a one-off. Would of >>>> course like to have a cookbook and run_list for it all, but I am not >>>> there yet. >>>> >>>> Miquel >>>> >>>> >>>> 2011/9/13 Noah Kantrowitz : >>>>> Just wanted to poke about this again post-weekend :-) >>>>> >>>>> --Noah >>>>> >>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>> >>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>> >>>>>> --Noah >>>>>> >>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>> >>>>>>> Hi all, >>>>>>> >>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>> proper Codespeed instance! >>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>> >>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>> looks like we are going to directly test on that big server, bare >>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>> >>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>> want to announce. >>>>>>> >>>>>>> What do you think? >>>>>>> Miquel >>>>>>> _______________________________________________ >>>>>>> Speed mailing list >>>>>>> Speed at python.org >>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>>> >>> >>> >> > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed From tleeuwenburg at gmail.com Mon Sep 26 01:30:33 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Mon, 26 Sep 2011 09:30:33 +1000 Subject: [Speed] Codespeed up and running In-Reply-To: <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> Message-ID: I am more than happy to do the work (still), but am idle waiting for instructions on how to do about it. It seemed like I needed to use Chef, and make some (hopefully easy) choices about how to do it. I'll dig out the email I sent round outlining a task list and with a few queries... On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: > We need someone to do it. Are there instructions everywhere > > On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: > >> So, is anyone working on the benchmark runner part? or should we >> "resign" that task, or look for other possibilities? >> >> Miquel >> >> >> 2011/9/14 Miquel Torres : >>> Ok, great! >>> >>> I can help out by giving you the rough recipe outline: >>> ============================================ >>> include_recipe "apache2::mod_wsgi" >>> >>> easy_install "codespeed" >>> >>> web_app "codespeed" do >>> ?server_name node['hostname'] >>> ?server_aliases [node['fqdn'], "speed.python.org"] >>> ?template "speed.conf.erb" >>> ?docroot "/home/tobami/speed/" ?# though we can change that >>> end >>> ============================================ >>> >>> As a base for the custom template you can take the current >>> /etc/apache2/sites-enables/codespeed >>> >>> Now this is were things get more complicated. The Django project is >>> under /home/tobami/speed/, with www-data permissions (so you can copy >>> anything). >>> The speed/templates/ contains the basic templates for the views. and >>> the content of sitestatic was created with "./manage.py >>> collectstatic". >>> >>> So this last part will need some execute block or similar. For >>> anything else you need just ask and I'll help! >>> >>> Miquel >>> >>> >>> PS: Python logo is up ;-) >>> >>> >>> 2011/9/14 Noah Kantrowitz : >>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>> >>>> --Noah >>>> >>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>> >>>>> Hi Noah, >>>>> >>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>> course like to have a cookbook and run_list for it all, but I am not >>>>> there yet. >>>>> >>>>> Miquel >>>>> >>>>> >>>>> 2011/9/13 Noah Kantrowitz : >>>>>> Just wanted to poke about this again post-weekend :-) >>>>>> >>>>>> --Noah >>>>>> >>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>> >>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>> >>>>>>> --Noah >>>>>>> >>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>> proper Codespeed instance! >>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>> >>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>> >>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>> want to announce. >>>>>>>> >>>>>>>> What do you think? >>>>>>>> Miquel >>>>>>>> _______________________________________________ >>>>>>>> Speed mailing list >>>>>>>> Speed at python.org >>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Speed mailing list >>>>>>> Speed at python.org >>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>>> >>>> >>>> >>> >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From tleeuwenburg at gmail.com Mon Sep 26 01:32:26 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Mon, 26 Sep 2011 09:32:26 +1000 Subject: [Speed] Codespeed up and running In-Reply-To: <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> Message-ID: Repost: Okay, so all of a sudden there seem to be a *lot* of people looking at this. This was a long thread quickly, and I only just got up to speed with it. There are a lot of new names, and I don't know what existing skills, interest and territories exist. Apologies for any faux pas. I would like to organise the list of tasks a bit more clearly if that is okay. I may be less familiar with the parts of this process than others, so I just want to get it down clearly. What I've done: -- Clone the Python repo into /home/speedracer/cpython/cpython (updated to 2.7) -- Installed os packages to support a reasonable build. -- Built and installed python2.7 into /home/speedraver/cpython/27_bin Presumably, people would like to be monitoring both PyPy and Cpython as they progress over time. This means some kind of auto runner which updates from the repo, re-runs the timings, and submits them to codespeed. I am unclear on whether there is a "clear winner" for this piece of technology. List of Required Infrastructure on speed.python.org: -- A home for the cpython repo (check) -- An installed and running codespeed server (pending) -- A buildbot / automation for keeping up to date with the PyPy and cpython repos (???) -- Automation to execute a process which must (???) 1) Run the benchmarks 2) Submit results to codespeed I would suggest that the codespeed server be installed into speedracer's home directory. This must all be installable and configurable from Chef (which appears to me like Fabric, i.e. an automation tool for deployment and management of systems). This is not yet accomplished. We also clearly need some kind of wiki documentation on what is going on, so that contributors (or just newbies like me) can figure out where things are at and what is going on. The bitbucket project is great, but the task titles are currently rather brief if someone isn't already totally up-to-speed on what is going on. There appear to me to be two unresolved questions: 1) What piece of technology should we use for a buildbot / build automation 2) What piece of technology should we use for the benchmark runner? I have no suggestions on (1), it's not a strong point for me. As regards (2), I am ignorant to what others might already be using, except to say the landscape seems unclear and fractured to me. My work, benchmarker.py, is likely to be adaptable to our needs and I am more than happy to support the package so it can be applied here. As I understand it, the GSOC project was about the actual benchmarking functions, not so much about automation and support for managing the results of benchmarking. If an already-working alternative to benchmarker.py exists and makes more sense to use, then that is fine by me. I would still like to help out to learn more about benchmarking. The main issue with me as a contributor will be time. I have a full plate as a result of Real Life, so I will sometimes go dark for a week or so. However, I'm motivated and interested, and can put in a few hours a week most weeks. Do I have this right? Is that a reasonable description of the work breakdown? Do we have clear names against tasks so that co-ordination can be done through those people (rather than via the whole list)? Regards, -Tennessee On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: > We need someone to do it. Are there instructions everywhere > > On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: > >> So, is anyone working on the benchmark runner part? or should we >> "resign" that task, or look for other possibilities? >> >> Miquel >> >> >> 2011/9/14 Miquel Torres : >>> Ok, great! >>> >>> I can help out by giving you the rough recipe outline: >>> ============================================ >>> include_recipe "apache2::mod_wsgi" >>> >>> easy_install "codespeed" >>> >>> web_app "codespeed" do >>> ?server_name node['hostname'] >>> ?server_aliases [node['fqdn'], "speed.python.org"] >>> ?template "speed.conf.erb" >>> ?docroot "/home/tobami/speed/" ?# though we can change that >>> end >>> ============================================ >>> >>> As a base for the custom template you can take the current >>> /etc/apache2/sites-enables/codespeed >>> >>> Now this is were things get more complicated. The Django project is >>> under /home/tobami/speed/, with www-data permissions (so you can copy >>> anything). >>> The speed/templates/ contains the basic templates for the views. and >>> the content of sitestatic was created with "./manage.py >>> collectstatic". >>> >>> So this last part will need some execute block or similar. For >>> anything else you need just ask and I'll help! >>> >>> Miquel >>> >>> >>> PS: Python logo is up ;-) >>> >>> >>> 2011/9/14 Noah Kantrowitz : >>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>> >>>> --Noah >>>> >>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>> >>>>> Hi Noah, >>>>> >>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>> course like to have a cookbook and run_list for it all, but I am not >>>>> there yet. >>>>> >>>>> Miquel >>>>> >>>>> >>>>> 2011/9/13 Noah Kantrowitz : >>>>>> Just wanted to poke about this again post-weekend :-) >>>>>> >>>>>> --Noah >>>>>> >>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>> >>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>> >>>>>>> --Noah >>>>>>> >>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>> proper Codespeed instance! >>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>> >>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>> >>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>> want to announce. >>>>>>>> >>>>>>>> What do you think? >>>>>>>> Miquel >>>>>>>> _______________________________________________ >>>>>>>> Speed mailing list >>>>>>>> Speed at python.org >>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Speed mailing list >>>>>>> Speed at python.org >>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>>> >>>> >>>> >>> >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From noah at coderanger.net Mon Sep 26 01:32:59 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Sun, 25 Sep 2011 16:32:59 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> Message-ID: <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. --Noah On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: > I am more than happy to do the work (still), but am idle waiting for > instructions on how to do about it. It seemed like I needed to use > Chef, and make some (hopefully easy) choices about how to do it. I'll > dig out the email I sent round outlining a task list and with a few > queries... > > On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >> We need someone to do it. Are there instructions everywhere >> >> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >> >>> So, is anyone working on the benchmark runner part? or should we >>> "resign" that task, or look for other possibilities? >>> >>> Miquel >>> >>> >>> 2011/9/14 Miquel Torres : >>>> Ok, great! >>>> >>>> I can help out by giving you the rough recipe outline: >>>> ============================================ >>>> include_recipe "apache2::mod_wsgi" >>>> >>>> easy_install "codespeed" >>>> >>>> web_app "codespeed" do >>>> server_name node['hostname'] >>>> server_aliases [node['fqdn'], "speed.python.org"] >>>> template "speed.conf.erb" >>>> docroot "/home/tobami/speed/" # though we can change that >>>> end >>>> ============================================ >>>> >>>> As a base for the custom template you can take the current >>>> /etc/apache2/sites-enables/codespeed >>>> >>>> Now this is were things get more complicated. The Django project is >>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>> anything). >>>> The speed/templates/ contains the basic templates for the views. and >>>> the content of sitestatic was created with "./manage.py >>>> collectstatic". >>>> >>>> So this last part will need some execute block or similar. For >>>> anything else you need just ask and I'll help! >>>> >>>> Miquel >>>> >>>> >>>> PS: Python logo is up ;-) >>>> >>>> >>>> 2011/9/14 Noah Kantrowitz : >>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>> >>>>> --Noah >>>>> >>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>> >>>>>> Hi Noah, >>>>>> >>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>> there yet. >>>>>> >>>>>> Miquel >>>>>> >>>>>> >>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>> >>>>>>> --Noah >>>>>>> >>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>> >>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>> >>>>>>>> --Noah >>>>>>>> >>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>> >>>>>>>>> Hi all, >>>>>>>>> >>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>> proper Codespeed instance! >>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>> >>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>> >>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>> want to announce. >>>>>>>>> >>>>>>>>> What do you think? >>>>>>>>> Miquel >>>>>>>>> _______________________________________________ >>>>>>>>> Speed mailing list >>>>>>>>> Speed at python.org >>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Speed mailing list >>>>>>>> Speed at python.org >>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>> >>>>>>> >>>>> >>>>> >>>> >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed >> > > > > -- > -------------------------------------------------- > Tennessee Leeuwenburg > http://myownhat.blogspot.com/ > "Don't believe everything you think" > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From tleeuwenburg at gmail.com Mon Sep 26 01:35:59 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Mon, 26 Sep 2011 09:35:59 +1000 Subject: [Speed] Codespeed up and running In-Reply-To: <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> Message-ID: Sweet. Well, that was the biggest obstacle. Now we're back to time being the bottleneck. I'll try to find some in the next day or two and get *something* going. Cheers, -T On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: > I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. > > --Noah > > On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: > >> I am more than happy to do the work (still), but am idle waiting for >> instructions on how to do about it. It seemed like I needed to use >> Chef, and make some (hopefully easy) choices about how to do it. I'll >> dig out the email I sent round outlining a task list and with a few >> queries... >> >> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>> We need someone to do it. Are there instructions everywhere >>> >>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>> >>>> So, is anyone working on the benchmark runner part? or should we >>>> "resign" that task, or look for other possibilities? >>>> >>>> Miquel >>>> >>>> >>>> 2011/9/14 Miquel Torres : >>>>> Ok, great! >>>>> >>>>> I can help out by giving you the rough recipe outline: >>>>> ============================================ >>>>> include_recipe "apache2::mod_wsgi" >>>>> >>>>> easy_install "codespeed" >>>>> >>>>> web_app "codespeed" do >>>>> ?server_name node['hostname'] >>>>> ?server_aliases [node['fqdn'], "speed.python.org"] >>>>> ?template "speed.conf.erb" >>>>> ?docroot "/home/tobami/speed/" ?# though we can change that >>>>> end >>>>> ============================================ >>>>> >>>>> As a base for the custom template you can take the current >>>>> /etc/apache2/sites-enables/codespeed >>>>> >>>>> Now this is were things get more complicated. The Django project is >>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>> anything). >>>>> The speed/templates/ contains the basic templates for the views. and >>>>> the content of sitestatic was created with "./manage.py >>>>> collectstatic". >>>>> >>>>> So this last part will need some execute block or similar. For >>>>> anything else you need just ask and I'll help! >>>>> >>>>> Miquel >>>>> >>>>> >>>>> PS: Python logo is up ;-) >>>>> >>>>> >>>>> 2011/9/14 Noah Kantrowitz : >>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>> >>>>>> --Noah >>>>>> >>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>> >>>>>>> Hi Noah, >>>>>>> >>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>> there yet. >>>>>>> >>>>>>> Miquel >>>>>>> >>>>>>> >>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>> >>>>>>>> --Noah >>>>>>>> >>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>> >>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>> >>>>>>>>> --Noah >>>>>>>>> >>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>> >>>>>>>>>> Hi all, >>>>>>>>>> >>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>> proper Codespeed instance! >>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>> >>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>> >>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>> want to announce. >>>>>>>>>> >>>>>>>>>> What do you think? >>>>>>>>>> Miquel >>>>>>>>>> _______________________________________________ >>>>>>>>>> Speed mailing list >>>>>>>>>> Speed at python.org >>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Speed mailing list >>>>>>>>> Speed at python.org >>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>> >>>>>>>> >>>>>> >>>>>> >>>>> >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >>> >> >> >> >> -- >> -------------------------------------------------- >> Tennessee Leeuwenburg >> http://myownhat.blogspot.com/ >> "Don't believe everything you think" >> _______________________________________________ >> Speed mailing list >> Speed at python.org >> http://mail.python.org/mailman/listinfo/speed > > > -----BEGIN PGP SIGNATURE----- > > iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd > VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ > =JlrA > -----END PGP SIGNATURE----- > > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From noah at coderanger.net Mon Sep 26 02:01:53 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Sun, 25 Sep 2011 17:01:53 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> Message-ID: <43627B25-5F20-4431-A7FE-7F0547051D2C@coderanger.net> If you could just keep track of what you do, it would greatly help the future automation though :-) --Noah On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote: > Sweet. Well, that was the biggest obstacle. Now we're back to time > being the bottleneck. I'll try to find some in the next day or two and > get *something* going. > > Cheers, > -T > > On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: >> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. >> >> --Noah >> >> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: >> >>> I am more than happy to do the work (still), but am idle waiting for >>> instructions on how to do about it. It seemed like I needed to use >>> Chef, and make some (hopefully easy) choices about how to do it. I'll >>> dig out the email I sent round outlining a task list and with a few >>> queries... >>> >>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>>> We need someone to do it. Are there instructions everywhere >>>> >>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>>> >>>>> So, is anyone working on the benchmark runner part? or should we >>>>> "resign" that task, or look for other possibilities? >>>>> >>>>> Miquel >>>>> >>>>> >>>>> 2011/9/14 Miquel Torres : >>>>>> Ok, great! >>>>>> >>>>>> I can help out by giving you the rough recipe outline: >>>>>> ============================================ >>>>>> include_recipe "apache2::mod_wsgi" >>>>>> >>>>>> easy_install "codespeed" >>>>>> >>>>>> web_app "codespeed" do >>>>>> server_name node['hostname'] >>>>>> server_aliases [node['fqdn'], "speed.python.org"] >>>>>> template "speed.conf.erb" >>>>>> docroot "/home/tobami/speed/" # though we can change that >>>>>> end >>>>>> ============================================ >>>>>> >>>>>> As a base for the custom template you can take the current >>>>>> /etc/apache2/sites-enables/codespeed >>>>>> >>>>>> Now this is were things get more complicated. The Django project is >>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>>> anything). >>>>>> The speed/templates/ contains the basic templates for the views. and >>>>>> the content of sitestatic was created with "./manage.py >>>>>> collectstatic". >>>>>> >>>>>> So this last part will need some execute block or similar. For >>>>>> anything else you need just ask and I'll help! >>>>>> >>>>>> Miquel >>>>>> >>>>>> >>>>>> PS: Python logo is up ;-) >>>>>> >>>>>> >>>>>> 2011/9/14 Noah Kantrowitz : >>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>>> >>>>>>> --Noah >>>>>>> >>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>>> >>>>>>>> Hi Noah, >>>>>>>> >>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>>> there yet. >>>>>>>> >>>>>>>> Miquel >>>>>>>> >>>>>>>> >>>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>>> >>>>>>>>> --Noah >>>>>>>>> >>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>>> >>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>>> >>>>>>>>>> --Noah >>>>>>>>>> >>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>>> >>>>>>>>>>> Hi all, >>>>>>>>>>> >>>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>>> proper Codespeed instance! >>>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>>> >>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>>> >>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>>> want to announce. >>>>>>>>>>> >>>>>>>>>>> What do you think? >>>>>>>>>>> Miquel >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Speed mailing list >>>>>>>>>>> Speed at python.org >>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Speed mailing list >>>>>>>>>> Speed at python.org >>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>> >>>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>>> >>> >>> >>> >>> -- >>> -------------------------------------------------- >>> Tennessee Leeuwenburg >>> http://myownhat.blogspot.com/ >>> "Don't believe everything you think" >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >> >> >> -----BEGIN PGP SIGNATURE----- >> >> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd >> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ >> =JlrA >> -----END PGP SIGNATURE----- >> >> > > > > -- > -------------------------------------------------- > Tennessee Leeuwenburg > http://myownhat.blogspot.com/ > "Don't believe everything you think" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From tleeuwenburg at gmail.com Mon Sep 26 02:04:28 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Mon, 26 Sep 2011 10:04:28 +1000 Subject: [Speed] Codespeed up and running In-Reply-To: <43627B25-5F20-4431-A7FE-7F0547051D2C@coderanger.net> References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> <43627B25-5F20-4431-A7FE-7F0547051D2C@coderanger.net> Message-ID: Yes, of course. And don't forget, I still might fall in a big heap and get nothing done, I'm just able to try now :) I'll make sure to keep some good notes for anyone else needing to clean up / improve / follow on / replicate later. Cheers, -T On Mon, Sep 26, 2011 at 10:01 AM, Noah Kantrowitz wrote: > If you could just keep track of what you do, it would greatly help the future automation though :-) > > --Noah > > On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote: > >> Sweet. Well, that was the biggest obstacle. Now we're back to time >> being the bottleneck. I'll try to find some in the next day or two and >> get *something* going. >> >> Cheers, >> -T >> >> On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: >>> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. >>> >>> --Noah >>> >>> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: >>> >>>> I am more than happy to do the work (still), but am idle waiting for >>>> instructions on how to do about it. It seemed like I needed to use >>>> Chef, and make some (hopefully easy) choices about how to do it. I'll >>>> dig out the email I sent round outlining a task list and with a few >>>> queries... >>>> >>>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>>>> We need someone to do it. Are there instructions everywhere >>>>> >>>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>>>> >>>>>> So, is anyone working on the benchmark runner part? or should we >>>>>> "resign" that task, or look for other possibilities? >>>>>> >>>>>> Miquel >>>>>> >>>>>> >>>>>> 2011/9/14 Miquel Torres : >>>>>>> Ok, great! >>>>>>> >>>>>>> I can help out by giving you the rough recipe outline: >>>>>>> ============================================ >>>>>>> include_recipe "apache2::mod_wsgi" >>>>>>> >>>>>>> easy_install "codespeed" >>>>>>> >>>>>>> web_app "codespeed" do >>>>>>> ?server_name node['hostname'] >>>>>>> ?server_aliases [node['fqdn'], "speed.python.org"] >>>>>>> ?template "speed.conf.erb" >>>>>>> ?docroot "/home/tobami/speed/" ?# though we can change that >>>>>>> end >>>>>>> ============================================ >>>>>>> >>>>>>> As a base for the custom template you can take the current >>>>>>> /etc/apache2/sites-enables/codespeed >>>>>>> >>>>>>> Now this is were things get more complicated. The Django project is >>>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>>>> anything). >>>>>>> The speed/templates/ contains the basic templates for the views. and >>>>>>> the content of sitestatic was created with "./manage.py >>>>>>> collectstatic". >>>>>>> >>>>>>> So this last part will need some execute block or similar. For >>>>>>> anything else you need just ask and I'll help! >>>>>>> >>>>>>> Miquel >>>>>>> >>>>>>> >>>>>>> PS: Python logo is up ;-) >>>>>>> >>>>>>> >>>>>>> 2011/9/14 Noah Kantrowitz : >>>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>>>> >>>>>>>> --Noah >>>>>>>> >>>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>>>> >>>>>>>>> Hi Noah, >>>>>>>>> >>>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>>>> there yet. >>>>>>>>> >>>>>>>>> Miquel >>>>>>>>> >>>>>>>>> >>>>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>>>> >>>>>>>>>> --Noah >>>>>>>>>> >>>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>>>> >>>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>>>> >>>>>>>>>>> --Noah >>>>>>>>>>> >>>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi all, >>>>>>>>>>>> >>>>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>>>> proper Codespeed instance! >>>>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>>>> >>>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>>>> >>>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>>>> want to announce. >>>>>>>>>>>> >>>>>>>>>>>> What do you think? >>>>>>>>>>>> Miquel >>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>> Speed mailing list >>>>>>>>>>>> Speed at python.org >>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>>> >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Speed mailing list >>>>>>>>>>> Speed at python.org >>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>> >>>> >>>> >>>> -- >>>> -------------------------------------------------- >>>> Tennessee Leeuwenburg >>>> http://myownhat.blogspot.com/ >>>> "Don't believe everything you think" >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> >>> >>> -----BEGIN PGP SIGNATURE----- >>> >>> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd >>> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ >>> =JlrA >>> -----END PGP SIGNATURE----- >>> >>> >> >> >> >> -- >> -------------------------------------------------- >> Tennessee Leeuwenburg >> http://myownhat.blogspot.com/ >> "Don't believe everything you think" > > > -----BEGIN PGP SIGNATURE----- > > iEYEARECAAYFAk5/wPMACgkQA9fEp2eRsU+JjgCglZth0OpBKiLoOkwWRZU/tPi9 > 0oMAniKVA1Mrb1cWvkqMGKtMXXWFoT1c > =D135 > -----END PGP SIGNATURE----- > > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From noah at coderanger.net Mon Sep 26 02:05:40 2011 From: noah at coderanger.net (Noah Kantrowitz) Date: Sun, 25 Sep 2011 17:05:40 -0700 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> Message-ID: I'm on IRC and XMPP (coderanger, coderanger at gmail.com) if you want another pair of eyes on anything. --Noah On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote: > Sweet. Well, that was the biggest obstacle. Now we're back to time > being the bottleneck. I'll try to find some in the next day or two and > get *something* going. > > Cheers, > -T > > On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: >> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. >> >> --Noah >> >> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: >> >>> I am more than happy to do the work (still), but am idle waiting for >>> instructions on how to do about it. It seemed like I needed to use >>> Chef, and make some (hopefully easy) choices about how to do it. I'll >>> dig out the email I sent round outlining a task list and with a few >>> queries... >>> >>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>>> We need someone to do it. Are there instructions everywhere >>>> >>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>>> >>>>> So, is anyone working on the benchmark runner part? or should we >>>>> "resign" that task, or look for other possibilities? >>>>> >>>>> Miquel >>>>> >>>>> >>>>> 2011/9/14 Miquel Torres : >>>>>> Ok, great! >>>>>> >>>>>> I can help out by giving you the rough recipe outline: >>>>>> ============================================ >>>>>> include_recipe "apache2::mod_wsgi" >>>>>> >>>>>> easy_install "codespeed" >>>>>> >>>>>> web_app "codespeed" do >>>>>> server_name node['hostname'] >>>>>> server_aliases [node['fqdn'], "speed.python.org"] >>>>>> template "speed.conf.erb" >>>>>> docroot "/home/tobami/speed/" # though we can change that >>>>>> end >>>>>> ============================================ >>>>>> >>>>>> As a base for the custom template you can take the current >>>>>> /etc/apache2/sites-enables/codespeed >>>>>> >>>>>> Now this is were things get more complicated. The Django project is >>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>>> anything). >>>>>> The speed/templates/ contains the basic templates for the views. and >>>>>> the content of sitestatic was created with "./manage.py >>>>>> collectstatic". >>>>>> >>>>>> So this last part will need some execute block or similar. For >>>>>> anything else you need just ask and I'll help! >>>>>> >>>>>> Miquel >>>>>> >>>>>> >>>>>> PS: Python logo is up ;-) >>>>>> >>>>>> >>>>>> 2011/9/14 Noah Kantrowitz : >>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>>> >>>>>>> --Noah >>>>>>> >>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>>> >>>>>>>> Hi Noah, >>>>>>>> >>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>>> there yet. >>>>>>>> >>>>>>>> Miquel >>>>>>>> >>>>>>>> >>>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>>> >>>>>>>>> --Noah >>>>>>>>> >>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>>> >>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>>> >>>>>>>>>> --Noah >>>>>>>>>> >>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>>> >>>>>>>>>>> Hi all, >>>>>>>>>>> >>>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>>> proper Codespeed instance! >>>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>>> >>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>>> >>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>>> want to announce. >>>>>>>>>>> >>>>>>>>>>> What do you think? >>>>>>>>>>> Miquel >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Speed mailing list >>>>>>>>>>> Speed at python.org >>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>> >>>>>>>>>> _______________________________________________ >>>>>>>>>> Speed mailing list >>>>>>>>>> Speed at python.org >>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>> >>>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>>> >>> >>> >>> >>> -- >>> -------------------------------------------------- >>> Tennessee Leeuwenburg >>> http://myownhat.blogspot.com/ >>> "Don't believe everything you think" >>> _______________________________________________ >>> Speed mailing list >>> Speed at python.org >>> http://mail.python.org/mailman/listinfo/speed >> >> >> -----BEGIN PGP SIGNATURE----- >> >> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd >> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ >> =JlrA >> -----END PGP SIGNATURE----- >> >> > > > > -- > -------------------------------------------------- > Tennessee Leeuwenburg > http://myownhat.blogspot.com/ > "Don't believe everything you think" -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 163 bytes Desc: Message signed with OpenPGP using GPGMail URL: From tleeuwenburg at gmail.com Mon Sep 26 02:10:39 2011 From: tleeuwenburg at gmail.com (Tennessee Leeuwenburg) Date: Mon, 26 Sep 2011 10:10:39 +1000 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> Message-ID: Thanks, at the point where I'm doing something, I'll remember I've got someone I can ask a few questions of... much appreciated! -T On Mon, Sep 26, 2011 at 10:05 AM, Noah Kantrowitz wrote: > I'm on IRC and XMPP (coderanger, coderanger at gmail.com) if you want another pair of eyes on anything. > > --Noah > > On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote: > >> Sweet. Well, that was the biggest obstacle. Now we're back to time >> being the bottleneck. I'll try to find some in the next day or two and >> get *something* going. >> >> Cheers, >> -T >> >> On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: >>> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. >>> >>> --Noah >>> >>> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: >>> >>>> I am more than happy to do the work (still), but am idle waiting for >>>> instructions on how to do about it. It seemed like I needed to use >>>> Chef, and make some (hopefully easy) choices about how to do it. I'll >>>> dig out the email I sent round outlining a task list and with a few >>>> queries... >>>> >>>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>>>> We need someone to do it. Are there instructions everywhere >>>>> >>>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>>>> >>>>>> So, is anyone working on the benchmark runner part? or should we >>>>>> "resign" that task, or look for other possibilities? >>>>>> >>>>>> Miquel >>>>>> >>>>>> >>>>>> 2011/9/14 Miquel Torres : >>>>>>> Ok, great! >>>>>>> >>>>>>> I can help out by giving you the rough recipe outline: >>>>>>> ============================================ >>>>>>> include_recipe "apache2::mod_wsgi" >>>>>>> >>>>>>> easy_install "codespeed" >>>>>>> >>>>>>> web_app "codespeed" do >>>>>>> ?server_name node['hostname'] >>>>>>> ?server_aliases [node['fqdn'], "speed.python.org"] >>>>>>> ?template "speed.conf.erb" >>>>>>> ?docroot "/home/tobami/speed/" ?# though we can change that >>>>>>> end >>>>>>> ============================================ >>>>>>> >>>>>>> As a base for the custom template you can take the current >>>>>>> /etc/apache2/sites-enables/codespeed >>>>>>> >>>>>>> Now this is were things get more complicated. The Django project is >>>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>>>> anything). >>>>>>> The speed/templates/ contains the basic templates for the views. and >>>>>>> the content of sitestatic was created with "./manage.py >>>>>>> collectstatic". >>>>>>> >>>>>>> So this last part will need some execute block or similar. For >>>>>>> anything else you need just ask and I'll help! >>>>>>> >>>>>>> Miquel >>>>>>> >>>>>>> >>>>>>> PS: Python logo is up ;-) >>>>>>> >>>>>>> >>>>>>> 2011/9/14 Noah Kantrowitz : >>>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>>>> >>>>>>>> --Noah >>>>>>>> >>>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>>>> >>>>>>>>> Hi Noah, >>>>>>>>> >>>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>>>> there yet. >>>>>>>>> >>>>>>>>> Miquel >>>>>>>>> >>>>>>>>> >>>>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>>>> >>>>>>>>>> --Noah >>>>>>>>>> >>>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>>>> >>>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>>>> >>>>>>>>>>> --Noah >>>>>>>>>>> >>>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi all, >>>>>>>>>>>> >>>>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>>>> proper Codespeed instance! >>>>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>>>> >>>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>>>> >>>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>>>> want to announce. >>>>>>>>>>>> >>>>>>>>>>>> What do you think? >>>>>>>>>>>> Miquel >>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>> Speed mailing list >>>>>>>>>>>> Speed at python.org >>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>>> >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Speed mailing list >>>>>>>>>>> Speed at python.org >>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>>> >>>> >>>> >>>> >>>> -- >>>> -------------------------------------------------- >>>> Tennessee Leeuwenburg >>>> http://myownhat.blogspot.com/ >>>> "Don't believe everything you think" >>>> _______________________________________________ >>>> Speed mailing list >>>> Speed at python.org >>>> http://mail.python.org/mailman/listinfo/speed >>> >>> >>> -----BEGIN PGP SIGNATURE----- >>> >>> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd >>> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ >>> =JlrA >>> -----END PGP SIGNATURE----- >>> >>> >> >> >> >> -- >> -------------------------------------------------- >> Tennessee Leeuwenburg >> http://myownhat.blogspot.com/ >> "Don't believe everything you think" > > > -----BEGIN PGP SIGNATURE----- > > iEYEARECAAYFAk5/wdQACgkQA9fEp2eRsU8HiACgj0YYa4Gd87G+2F0IsLek8tV5 > p+IAoLobJ2dBZnIvipB6FusJgqJSq3A/ > =+vkF > -----END PGP SIGNATURE----- > > -- -------------------------------------------------- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" From tobami at googlemail.com Mon Sep 26 20:33:47 2011 From: tobami at googlemail.com (Miquel Torres) Date: Mon, 26 Sep 2011 20:33:47 +0200 Subject: [Speed] Codespeed up and running In-Reply-To: References: <16C180CD-6443-4AE7-A14B-F307CB1A0C44@coderanger.net> <6BB71B94-0A39-4D0C-86D2-EACAE372D602@coderanger.net> <9844C15A-E68F-4A9B-8797-95A3EE66917F@gmail.com> <80C29BE2-2734-40D9-ACE0-D2D786CB4BCA@coderanger.net> Message-ID: Great Tennessee. Feel free to use your project to do the actual benchmarking. He Who Codes Decides. That is Open Source ;-) The tool used for PyPy (Unladen Swallow?s) does several runs and gets the average and standard deviation. That value is currently not used much (and a VM/JIT makes that number probably not very useful at all), but it does help sometimes to tell whether a strange result is caused by the infrastructure (measuring error) or it is a genuine change in performance. Does benchmarker.py cover that? The Codespeed instance is already working and accessible through http://speed.python.org I added user "tleeuwenburg" pass "speed" so that you can adjust environments and projects. Ready to save data! Anyway great to hear you are going to give it a try. Miquel 2011/9/26 Tennessee Leeuwenburg : > Thanks, at the point where I'm doing something, I'll remember I've got > someone I can ask a few questions of... much appreciated! > > -T > > On Mon, Sep 26, 2011 at 10:05 AM, Noah Kantrowitz wrote: >> I'm on IRC and XMPP (coderanger, coderanger at gmail.com) if you want another pair of eyes on anything. >> >> --Noah >> >> On Sep 25, 2011, at 4:35 PM, Tennessee Leeuwenburg wrote: >> >>> Sweet. Well, that was the biggest obstacle. Now we're back to time >>> being the bottleneck. I'll try to find some in the next day or two and >>> get *something* going. >>> >>> Cheers, >>> -T >>> >>> On Mon, Sep 26, 2011 at 9:32 AM, Noah Kantrowitz wrote: >>>> I think the plan is not to worry about Chef-izing things right now. The box can be wiped and rebuilt at a later date but right now getting something up and running is a higher priority. >>>> >>>> --Noah >>>> >>>> On Sep 25, 2011, at 4:30 PM, Tennessee Leeuwenburg wrote: >>>> >>>>> I am more than happy to do the work (still), but am idle waiting for >>>>> instructions on how to do about it. It seemed like I needed to use >>>>> Chef, and make some (hopefully easy) choices about how to do it. I'll >>>>> dig out the email I sent round outlining a task list and with a few >>>>> queries... >>>>> >>>>> On Mon, Sep 26, 2011 at 5:13 AM, Jesse Noller wrote: >>>>>> We need someone to do it. Are there instructions everywhere >>>>>> >>>>>> On Sep 25, 2011, at 1:55 PM, Miquel Torres wrote: >>>>>> >>>>>>> So, is anyone working on the benchmark runner part? or should we >>>>>>> "resign" that task, or look for other possibilities? >>>>>>> >>>>>>> Miquel >>>>>>> >>>>>>> >>>>>>> 2011/9/14 Miquel Torres : >>>>>>>> Ok, great! >>>>>>>> >>>>>>>> I can help out by giving you the rough recipe outline: >>>>>>>> ============================================ >>>>>>>> include_recipe "apache2::mod_wsgi" >>>>>>>> >>>>>>>> easy_install "codespeed" >>>>>>>> >>>>>>>> web_app "codespeed" do >>>>>>>> ?server_name node['hostname'] >>>>>>>> ?server_aliases [node['fqdn'], "speed.python.org"] >>>>>>>> ?template "speed.conf.erb" >>>>>>>> ?docroot "/home/tobami/speed/" ?# though we can change that >>>>>>>> end >>>>>>>> ============================================ >>>>>>>> >>>>>>>> As a base for the custom template you can take the current >>>>>>>> /etc/apache2/sites-enables/codespeed >>>>>>>> >>>>>>>> Now this is were things get more complicated. The Django project is >>>>>>>> under /home/tobami/speed/, with www-data permissions (so you can copy >>>>>>>> anything). >>>>>>>> The speed/templates/ contains the basic templates for the views. and >>>>>>>> the content of sitestatic was created with "./manage.py >>>>>>>> collectstatic". >>>>>>>> >>>>>>>> So this last part will need some execute block or similar. For >>>>>>>> anything else you need just ask and I'll help! >>>>>>>> >>>>>>>> Miquel >>>>>>>> >>>>>>>> >>>>>>>> PS: Python logo is up ;-) >>>>>>>> >>>>>>>> >>>>>>>> 2011/9/14 Noah Kantrowitz : >>>>>>>>> No worries, I'll just take a look at the box and document what you did into recipes as we are doing with the other PSF machines :-) Thanks for getting it up so quickly! >>>>>>>>> >>>>>>>>> --Noah >>>>>>>>> >>>>>>>>> On Sep 14, 2011, at 11:21 AM, Miquel Torres wrote: >>>>>>>>> >>>>>>>>>> Hi Noah, >>>>>>>>>> >>>>>>>>>> I didn't use any recipes for it, was more of a one-off. Would of >>>>>>>>>> course like to have a cookbook and run_list for it all, but I am not >>>>>>>>>> there yet. >>>>>>>>>> >>>>>>>>>> Miquel >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> 2011/9/13 Noah Kantrowitz : >>>>>>>>>>> Just wanted to poke about this again post-weekend :-) >>>>>>>>>>> >>>>>>>>>>> --Noah >>>>>>>>>>> >>>>>>>>>>> On Sep 11, 2011, at 3:39 PM, Noah Kantrowitz wrote: >>>>>>>>>>> >>>>>>>>>>>> Did the recipes for it get posted somewhere or was this a one-off by hand? I've started building some basic Chef infra for all PSF machines and can easily combine it with some more specific stuffs for codespeed :-) >>>>>>>>>>>> >>>>>>>>>>>> --Noah >>>>>>>>>>>> >>>>>>>>>>>> On Sep 11, 2011, at 2:15 AM, Miquel Torres wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi all, >>>>>>>>>>>>> >>>>>>>>>>>>> it took longer than expected, but speed.python.org points now to a >>>>>>>>>>>>> proper Codespeed instance! >>>>>>>>>>>>> The admin media does not yet load properly, need to fix that yet. >>>>>>>>>>>>> >>>>>>>>>>>>> Anyway, for further configuring, we need to define an environment. I >>>>>>>>>>>>> looks like we are going to directly test on that big server, bare >>>>>>>>>>>>> metal. Should we call it by a name? or just 24-Core-monster? >>>>>>>>>>>>> >>>>>>>>>>>>> As to the welcome page, if you prefer we can put it back in, with a >>>>>>>>>>>>> link to a subdomain or other URL were we keep Codespeed as long as we >>>>>>>>>>>>> are still setting up thing, and only go live when we are finished and >>>>>>>>>>>>> want to announce. >>>>>>>>>>>>> >>>>>>>>>>>>> What do you think? >>>>>>>>>>>>> Miquel >>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>> Speed mailing list >>>>>>>>>>>>> Speed at python.org >>>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>>>> >>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>> Speed mailing list >>>>>>>>>>>> Speed at python.org >>>>>>>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> _______________________________________________ >>>>>>> Speed mailing list >>>>>>> Speed at python.org >>>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> _______________________________________________ >>>>>> Speed mailing list >>>>>> Speed at python.org >>>>>> http://mail.python.org/mailman/listinfo/speed >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> -------------------------------------------------- >>>>> Tennessee Leeuwenburg >>>>> http://myownhat.blogspot.com/ >>>>> "Don't believe everything you think" >>>>> _______________________________________________ >>>>> Speed mailing list >>>>> Speed at python.org >>>>> http://mail.python.org/mailman/listinfo/speed >>>> >>>> >>>> -----BEGIN PGP SIGNATURE----- >>>> >>>> iEYEARECAAYFAk5/ui8ACgkQA9fEp2eRsU+h3ACgqZ/hbABNeaTaOF9KFgG74vMd >>>> VXUAoIdhQV/sCgLtLOP+/MLUEGGXk8zZ >>>> =JlrA >>>> -----END PGP SIGNATURE----- >>>> >>>> >>> >>> >>> >>> -- >>> -------------------------------------------------- >>> Tennessee Leeuwenburg >>> http://myownhat.blogspot.com/ >>> "Don't believe everything you think" >> >> >> -----BEGIN PGP SIGNATURE----- >> >> iEYEARECAAYFAk5/wdQACgkQA9fEp2eRsU8HiACgj0YYa4Gd87G+2F0IsLek8tV5 >> p+IAoLobJ2dBZnIvipB6FusJgqJSq3A/ >> =+vkF >> -----END PGP SIGNATURE----- >> >> > > > > -- > -------------------------------------------------- > Tennessee Leeuwenburg > http://myownhat.blogspot.com/ > "Don't believe everything you think" > _______________________________________________ > Speed mailing list > Speed at python.org > http://mail.python.org/mailman/listinfo/speed >