From greg at krypto.org  Fri May  4 17:57:55 2018
From: greg at krypto.org (Gregory P. Smith)
Date: Fri, 04 May 2018 21:57:55 +0000
Subject: [Python-buildbots] Add a config for a clang-ubsan buildbot
 please
In-Reply-To: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
References: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
Message-ID: <CAGE7PNL43+GdTzwGtCpcTsTFB8dZbWCv0ndWssLDkAONctSaWw@mail.gmail.com>

ping. +cc: Zachary as I believe they're a python buildmaster config person?

On Tue, Apr 24, 2018 at 5:50 PM Gregory P. Smith <greg at krypto.org> wrote:

> The configure command needs to be:
>
> CC=clang LD=clang CFLAGS="-fsanitize=undefined"
> LDFLAGS="-fsanitize=undefined" ./configure --with-pydebug
>
> I may be offline for a few days, but i'll get this running in the next
> week or two.
>
> thanks!
> -gps
>

From victor.stinner at gmail.com  Fri May  4 19:49:13 2018
From: victor.stinner at gmail.com (Victor Stinner)
Date: Sat, 5 May 2018 01:49:13 +0200
Subject: [Python-buildbots] Add a config for a clang-ubsan buildbot
 please
In-Reply-To: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
References: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
Message-ID: <CAMpsgwadS_NibTxLrTq0Pkn3O93M02h5afpxrGDX+BVDibtmaQ@mail.gmail.com>

The configuration can be found at:
https://github.com/python/buildmaster-config/blob/master/master/master.cfg

You may try to write a pull request.

Victor

2018-04-25 2:50 GMT+02:00 Gregory P. Smith <greg at krypto.org>:
> The configure command needs to be:
>
> CC=clang LD=clang CFLAGS="-fsanitize=undefined"
> LDFLAGS="-fsanitize=undefined" ./configure --with-pydebug
>
> I may be offline for a few days, but i'll get this running in the next week
> or two.
>
> thanks!
> -gps
> _______________________________________________
> Python-Buildbots mailing list
> Python-Buildbots at python.org
> https://mail.python.org/mailman/listinfo/python-buildbots

From greg at krypto.org  Fri May  4 20:05:08 2018
From: greg at krypto.org (Gregory P. Smith)
Date: Sat, 05 May 2018 00:05:08 +0000
Subject: [Python-buildbots] Add a config for a clang-ubsan buildbot
 please
In-Reply-To: <CAMpsgwadS_NibTxLrTq0Pkn3O93M02h5afpxrGDX+BVDibtmaQ@mail.gmail.com>
References: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
 <CAMpsgwadS_NibTxLrTq0Pkn3O93M02h5afpxrGDX+BVDibtmaQ@mail.gmail.com>
Message-ID: <CAGE7PNLZfri8AdLDisny+akcGRpuAMa-=aLSykatj=dZF7RLUg@mail.gmail.com>

Oh cool, I didn't realize I could do that myself. I've added a note to
https://wiki.python.org/moin/BuildBot which only suggested emailing
python-buildbots at .

-gps

On Fri, May 4, 2018 at 4:49 PM Victor Stinner <victor.stinner at gmail.com>
wrote:

> The configuration can be found at:
> https://github.com/python/buildmaster-config/blob/master/master/master.cfg
>
> You may try to write a pull request.
>
> Victor
>
> 2018-04-25 2:50 GMT+02:00 Gregory P. Smith <greg at krypto.org>:
> > The configure command needs to be:
> >
> > CC=clang LD=clang CFLAGS="-fsanitize=undefined"
> > LDFLAGS="-fsanitize=undefined" ./configure --with-pydebug
> >
> > I may be offline for a few days, but i'll get this running in the next
> week
> > or two.
> >
> > thanks!
> > -gps
> > _______________________________________________
> > Python-Buildbots mailing list
> > Python-Buildbots at python.org
> > https://mail.python.org/mailman/listinfo/python-buildbots
>

From greg at krypto.org  Wed May  9 14:14:52 2018
From: greg at krypto.org (Gregory P. Smith)
Date: Wed, 09 May 2018 18:14:52 +0000
Subject: [Python-buildbots] Add a config for a clang-ubsan buildbot
 please
In-Reply-To: <CAGE7PNLZfri8AdLDisny+akcGRpuAMa-=aLSykatj=dZF7RLUg@mail.gmail.com>
References: <CAGE7PNJ9YCBfahZ1=CYQ9QAoEQ7Y_Sh5rt23Wm59YspeB_7sXQ@mail.gmail.com>
 <CAMpsgwadS_NibTxLrTq0Pkn3O93M02h5afpxrGDX+BVDibtmaQ@mail.gmail.com>
 <CAGE7PNLZfri8AdLDisny+akcGRpuAMa-=aLSykatj=dZF7RLUg@mail.gmail.com>
Message-ID: <CAGE7PNL4-Xhg_S7btEt84kwRbXbP2S5Fc4mLOxyonf3R4qzrGA@mail.gmail.com>

https://github.com/python/buildmaster-config/pull/33

On Fri, May 4, 2018 at 8:05 PM Gregory P. Smith <greg at krypto.org> wrote:

> Oh cool, I didn't realize I could do that myself. I've added a note to
> https://wiki.python.org/moin/BuildBot which only suggested emailing
> python-buildbots at .
>
> -gps
>
> On Fri, May 4, 2018 at 4:49 PM Victor Stinner <victor.stinner at gmail.com>
> wrote:
>
>> The configuration can be found at:
>> https://github.com/python/buildmaster-config/blob/master/master/master.cfg
>>
>> You may try to write a pull request.
>>
>> Victor
>>
>> 2018-04-25 2:50 GMT+02:00 Gregory P. Smith <greg at krypto.org>:
>> > The configure command needs to be:
>> >
>> > CC=clang LD=clang CFLAGS="-fsanitize=undefined"
>> > LDFLAGS="-fsanitize=undefined" ./configure --with-pydebug
>> >
>> > I may be offline for a few days, but i'll get this running in the next
>> week
>> > or two.
>> >
>> > thanks!
>> > -gps
>> > _______________________________________________
>> > Python-Buildbots mailing list
>> > Python-Buildbots at python.org
>> > https://mail.python.org/mailman/listinfo/python-buildbots
>>
>

From nad at python.org  Sun May 27 04:57:01 2018
From: nad at python.org (Ned Deily)
Date: Sun, 27 May 2018 04:57:01 -0400
Subject: [Python-buildbots] OpenSSL and OS updates
Message-ID: <460D3401-92C1-4F41-A220-2856AB5659D7@python.org>

As we get close to the Python 3.7.0 release, I have been paying more attention to the buildbots and I have noticed that quite a few are currently skipping building some of the standard library modules due to version incompatibilities, i.e Python now needs a newer version than a older OS version provides.  This is particularly true for OpenSSL, which as of 3.7.0, now requires OpenSSL 1.0.2 or 1.1.x.  These days it's pretty critical that we be building and testing ssl support as network best practices have changed pretty rapidly and dramatically.

Along with that, there have been some major LTS support releases over the past year or so that provide these newer versions of OpenSSL.  In particular, Debian has released Debian 9 (stretch) as the current stable release.  And the latest Ubuntu LTS release is 18.04 (bionic beaver).  Both of these have suitable OpenSSL's and more.  If you are hosting a buildbot on a Debian or Ubuntu system, it would be great if you could consider upgrading.

And for all buildbot owners, if you do happen to notice that key modules are not getting built, like _ssl, let us know and we can try to resolve the problem.  (Depending on the release branch, there will be a few that are not expected to build on many platforms like "ossaudiodev" and "spwd".  These can be ignored.)

From the release team, a very big thank you for your generosity in hosting the Python buildbots in your environments!  The feedback they provide helps to ensure that Python continues to work on the amazingly broad range of platforms our users expect.

https://docs.python.org/3.7/whatsnew/3.7.html#ssl

--
  Ned Deily
  nad at python.org -- []


From matt at vazor.com  Tue May 29 15:58:08 2018
From: matt at vazor.com (Matt Billenstein)
Date: Tue, 29 May 2018 19:58:08 +0000
Subject: [Python-buildbots] OpenSSL and OS updates
In-Reply-To: <460D3401-92C1-4F41-A220-2856AB5659D7@python.org>
References: <460D3401-92C1-4F41-A220-2856AB5659D7@python.org>
Message-ID: <01010163ad7aaf1a-2e88db35-609f-4b7c-93f3-a0c9e6ced91d-000000@us-west-2.amazonses.com>

Hey Ned,

Noticed the OSX buildbot I'm running is linking to homebrew ssl 1.0.0 -- not
ideal -- the distributed python bundles openssl now does it not?

mattb-mbp2:build buildbot$ pwd
/Users/buildbot/buildarea/3.x.billenstein-sierra/build

mattb-mbp2:build buildbot$ otool -L build/lib.macosx-10.13-x86_64-3.8-pydebug/_ssl.cpython-38dm-darwin.so
build/lib.macosx-10.13-x86_64-3.8-pydebug/_ssl.cpython-38dm-darwin.so:
        /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
        /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
        /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1252.50.4)

m

On Sun, May 27, 2018 at 04:57:01AM -0400, Ned Deily wrote:
> As we get close to the Python 3.7.0 release, I have been paying more attention to the buildbots and I have noticed that quite a few are currently skipping building some of the standard library modules due to version incompatibilities, i.e Python now needs a newer version than a older OS version provides.  This is particularly true for OpenSSL, which as of 3.7.0, now requires OpenSSL 1.0.2 or 1.1.x.  These days it's pretty critical that we be building and testing ssl support as network best practices have changed pretty rapidly and dramatically.
> 
> Along with that, there have been some major LTS support releases over the past year or so that provide these newer versions of OpenSSL.  In particular, Debian has released Debian 9 (stretch) as the current stable release.  And the latest Ubuntu LTS release is 18.04 (bionic beaver).  Both of these have suitable OpenSSL's and more.  If you are hosting a buildbot on a Debian or Ubuntu system, it would be great if you could consider upgrading.
> 
> And for all buildbot owners, if you do happen to notice that key modules are not getting built, like _ssl, let us know and we can try to resolve the problem.  (Depending on the release branch, there will be a few that are not expected to build on many platforms like "ossaudiodev" and "spwd".  These can be ignored.)
> 
> From the release team, a very big thank you for your generosity in hosting the Python buildbots in your environments!  The feedback they provide helps to ensure that Python continues to work on the amazingly broad range of platforms our users expect.
> 
> https://docs.python.org/3.7/whatsnew/3.7.html#ssl
> 
> --
>   Ned Deily
>   nad at python.org -- []
> 
> _______________________________________________
> Python-Buildbots mailing list
> Python-Buildbots at python.org
> https://mail.python.org/mailman/listinfo/python-buildbots

-- 
Matt Billenstein
matt at vazor.com
http://www.vazor.com/

From nad at python.org  Tue May 29 16:07:31 2018
From: nad at python.org (Ned Deily)
Date: Tue, 29 May 2018 16:07:31 -0400
Subject: [Python-buildbots] OpenSSL and OS updates
In-Reply-To: <01010163ad7aaf1a-2e88db35-609f-4b7c-93f3-a0c9e6ced91d-000000@us-west-2.amazonses.com>
References: <460D3401-92C1-4F41-A220-2856AB5659D7@python.org>
 <01010163ad7aaf1a-2e88db35-609f-4b7c-93f3-a0c9e6ced91d-000000@us-west-2.amazonses.com>
Message-ID: <6FA57423-4F99-44F9-A77B-7E3DC68D16E8@python.org>

On May 29, 2018, at 15:58, Matt Billenstein <matt at vazor.com> wrote:
> Noticed the OSX buildbot I'm running is linking to homebrew ssl 1.0.0 -- not
> ideal -- the distributed python bundles openssl now does it not?
> 
> mattb-mbp2:build buildbot$ pwd
> /Users/buildbot/buildarea/3.x.billenstein-sierra/build
> 
> mattb-mbp2:build buildbot$ otool -L build/lib.macosx-10.13-x86_64-3.8-pydebug/_ssl.cpython-38dm-darwin.so
> build/lib.macosx-10.13-x86_64-3.8-pydebug/_ssl.cpython-38dm-darwin.so:
>        /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
>        /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
>        /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1252.50.4)

Matt,

In the OpenSSL case, the library file name does not tell you what version of OpenSSL is actually being used.  AFAIK, all recent versions use 1.0.0 in the file name I believe because they *may* be ABI compatible, not that I would bet the ranch on it.  A better way to tell is to look at the output of the relatively new (and cool - thank you, Victor!) "pythoninfo" buildbot build step which runs a script that records the values of various things including the OpenSSL version that the built Python links to.  For your macOS Sierra buildbots for 3.x and 3.7, I see:

ssl.OPENSSL_VERSION: OpenSSL 1.0.2o  27 Mar 2018
ssl.OPENSSL_VERSION_INFO: (1, 0, 2, 15, 15)

(for example, from http://buildbot.python.org/all/#/builders/14/builds/1056/steps/3/logs/stdio )

So all is cool by you :)

Thanks for checking!

--
  Ned Deily
  nad at python.org -- []


From db3l.net at gmail.com  Wed May 30 21:43:19 2018
From: db3l.net at gmail.com (David Bolen)
Date: Wed, 30 May 2018 21:43:19 -0400
Subject: [Python-buildbots] bolen-ubuntu worker updated to 18.04
Message-ID: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>

While on my near term to-do list, Ned's note helped give me a bit of a
nudge, so...

The bolen-ubuntu worker has been updated to Ubuntu 18.04 LTS.  This
restores the SSL test coverage, plus includes the libraries to pick up the
previously skipped uuid and ctypes modules.  At this point, of the possible
modules, it should just be tkinter that isn't covered.

This update also switches the worker from 32-bit to 64-bit - mostly due to
it being simpler, but probably also more useful at this point.

-- David

From nad at python.org  Wed May 30 21:52:33 2018
From: nad at python.org (Ned Deily)
Date: Wed, 30 May 2018 21:52:33 -0400
Subject: [Python-buildbots] bolen-ubuntu worker updated to 18.04
In-Reply-To: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>
References: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>
Message-ID: <7B76CB24-AFF2-4572-9AA5-70E363CB8FD8@python.org>

On May 30, 2018, at 21:43, David Bolen <db3l.net at gmail.com> wrote:
> While on my near term to-do list, Ned's note helped give me a bit of a
> nudge, so...
> 
> The bolen-ubuntu worker has been updated to Ubuntu 18.04 LTS.  This
> restores the SSL test coverage, plus includes the libraries to pick up the
> previously skipped uuid and ctypes modules.  At this point, of the possible
> modules, it should just be tkinter that isn't covered.
> 
> This update also switches the worker from 32-bit to 64-bit - mostly due to
> it being simpler, but probably also more useful at this point.

Excellent news, David!  Thank you so for much for your generous buildbot support over many years!  It is much appreciated.

--Ned

--
  Ned Deily
  nad at python.org -- []


From berker.peksag at gmail.com  Wed May 30 23:30:36 2018
From: berker.peksag at gmail.com (=?UTF-8?Q?Berker_Peksa=C4=9F?=)
Date: Thu, 31 May 2018 06:30:36 +0300
Subject: [Python-buildbots] bolen-ubuntu worker updated to 18.04
In-Reply-To: <7B76CB24-AFF2-4572-9AA5-70E363CB8FD8@python.org>
References: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>
 <7B76CB24-AFF2-4572-9AA5-70E363CB8FD8@python.org>
Message-ID: <CAF4280Ly+_ZWY0UTnVdcn3neoUXas_7kcB4hxrh+p9MYpdEdyA@mail.gmail.com>

On Thu, May 31, 2018 at 4:52 AM, Ned Deily <nad at python.org> wrote:
> Excellent news, David!  Thank you so for much for your generous buildbot support over many years!  It is much appreciated.

+1, thank you David!

--Berker

From zachary.ware+pydev at gmail.com  Wed May 30 23:55:58 2018
From: zachary.ware+pydev at gmail.com (Zachary Ware)
Date: Wed, 30 May 2018 22:55:58 -0500
Subject: [Python-buildbots] bolen-ubuntu worker updated to 18.04
In-Reply-To: <CAF4280Ly+_ZWY0UTnVdcn3neoUXas_7kcB4hxrh+p9MYpdEdyA@mail.gmail.com>
References: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>
 <7B76CB24-AFF2-4572-9AA5-70E363CB8FD8@python.org>
 <CAF4280Ly+_ZWY0UTnVdcn3neoUXas_7kcB4hxrh+p9MYpdEdyA@mail.gmail.com>
Message-ID: <CAKJDb-M4tp+7e7UveYYQxURiVewDGT6O9ug+Y+Hgu9fAz8GxRA@mail.gmail.com>

On Wed, May 30, 2018 at 10:30 PM, Berker Peksa? <berker.peksag at gmail.com> wrote:
> On Thu, May 31, 2018 at 4:52 AM, Ned Deily <nad at python.org> wrote:
>> Excellent news, David!  Thank you so for much for your generous buildbot support over many years!  It is much appreciated.
>
> +1, thank you David!

Agreed!

Also, I've now updated the builder name to "AMD64" rather than "x86".

By the way, I've had success with running Xvfb on my Gentoo bot for
tkinter testing.  If you're interested in setting that up, I'm happy
to share any relevant details to help :)

-- 
Zach

From db3l.net at gmail.com  Thu May 31 00:13:39 2018
From: db3l.net at gmail.com (David Bolen)
Date: Thu, 31 May 2018 00:13:39 -0400
Subject: [Python-buildbots] bolen-ubuntu worker updated to 18.04
In-Reply-To: <CAKJDb-M4tp+7e7UveYYQxURiVewDGT6O9ug+Y+Hgu9fAz8GxRA@mail.gmail.com>
References: <CAFirtYUWg4_AvLMDYjsuTyq9KZJeDXa7b4VQX+BdLUF0Ymzdfw@mail.gmail.com>
 <7B76CB24-AFF2-4572-9AA5-70E363CB8FD8@python.org>
 <CAF4280Ly+_ZWY0UTnVdcn3neoUXas_7kcB4hxrh+p9MYpdEdyA@mail.gmail.com>
 <CAKJDb-M4tp+7e7UveYYQxURiVewDGT6O9ug+Y+Hgu9fAz8GxRA@mail.gmail.com>
Message-ID: <CAFirtYVhOBq0yGhWXcruEZf_N1mxMxebAdBKdSPOvwAWaqFarA@mail.gmail.com>

Thanks - I hadn't even thought about the prefix.

I had an experimental Xvfb setup when first configuring the buildbot, but
something still broke during the tests.  Unfortunately at this point I
can't remember quite what it was and/or if it was platform/dist specific.
But yes, time permitting I'd like to try again, and will keep your offer in
mind.

-- David

On Wed, May 30, 2018 at 11:56 PM Zachary Ware <zachary.ware+pydev at gmail.com>
wrote:

> On Wed, May 30, 2018 at 10:30 PM, Berker Peksa? <berker.peksag at gmail.com>
> wrote:
> > On Thu, May 31, 2018 at 4:52 AM, Ned Deily <nad at python.org> wrote:
> >> Excellent news, David!  Thank you so for much for your generous
> buildbot support over many years!  It is much appreciated.
> >
> > +1, thank you David!
>
> Agreed!
>
> Also, I've now updated the builder name to "AMD64" rather than "x86".
>
> By the way, I've had success with running Xvfb on my Gentoo bot for
> tkinter testing.  If you're interested in setting that up, I'm happy
> to share any relevant details to help :)
>
> --
> Zach
> _______________________________________________
> Python-Buildbots mailing list
> Python-Buildbots at python.org
> https://mail.python.org/mailman/listinfo/python-buildbots
>