From safijari at isu.edu  Wed Oct 10 16:31:51 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Wed, 10 Oct 2018 13:31:51 -0700
Subject: [Wheel-builders] manylinux1 vm image
Message-ID: <CA+rw7THUxXCwUzr-eXQY0jZBv3JnopDEJAJcUHLgRX_9yA6hyQ@mail.gmail.com>

Hi,

Is there a prebuilt vmware or virtualbox image similar to the manylinux1
docker image? I need to do some experimentation to figure out how to get
all of my package's dependencies in place and having a VM would make the
discovery somewhat easier.

Thanks,

Jari
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181010/95c4b3c5/attachment.html>

From njs at pobox.com  Wed Oct 10 18:01:20 2018
From: njs at pobox.com (Nathaniel Smith)
Date: Wed, 10 Oct 2018 15:01:20 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CA+rw7THUxXCwUzr-eXQY0jZBv3JnopDEJAJcUHLgRX_9yA6hyQ@mail.gmail.com>
References: <CA+rw7THUxXCwUzr-eXQY0jZBv3JnopDEJAJcUHLgRX_9yA6hyQ@mail.gmail.com>
Message-ID: <CAPJVwBkT5cTqC2g-YyBwct-8zs0ziwE8A=hY=UBL1xf221pbkA@mail.gmail.com>

I'm not aware of such a thing, no. But... I guess you must be asking
because you want to work with the image on Windows or macOS? I believe both
of them have easy-to-install docker support, which will take care of
setting up a VM internally and then running any docker image you want on
that VM.

On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:

> Hi,
>
> Is there a prebuilt vmware or virtualbox image similar to the manylinux1
> docker image? I need to do some experimentation to figure out how to get
> all of my package's dependencies in place and having a VM would make the
> discovery somewhat easier.
>
> Thanks,
>
> Jari
> _______________________________________________
> Wheel-builders mailing list
> Wheel-builders at python.org
> https://mail.python.org/mailman/listinfo/wheel-builders
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181010/edbc67b0/attachment.html>

From safijari at isu.edu  Wed Oct 10 18:17:30 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Wed, 10 Oct 2018 15:17:30 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAPJVwBkT5cTqC2g-YyBwct-8zs0ziwE8A=hY=UBL1xf221pbkA@mail.gmail.com>
References: <CA+rw7THUxXCwUzr-eXQY0jZBv3JnopDEJAJcUHLgRX_9yA6hyQ@mail.gmail.com>
 <CAPJVwBkT5cTqC2g-YyBwct-8zs0ziwE8A=hY=UBL1xf221pbkA@mail.gmail.com>
Message-ID: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>

No I'm on Linux, just weary of docker interactive mode ?

On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:

> I'm not aware of such a thing, no. But... I guess you must be asking
> because you want to work with the image on Windows or macOS? I believe both
> of them have easy-to-install docker support, which will take care of
> setting up a VM internally and then running any docker image you want on
> that VM.
>
> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>
>> Hi,
>>
>> Is there a prebuilt vmware or virtualbox image similar to the manylinux1
>> docker image? I need to do some experimentation to figure out how to get
>> all of my package's dependencies in place and having a VM would make the
>> discovery somewhat easier.
>>
>> Thanks,
>>
>> Jari
>> _______________________________________________
>> Wheel-builders mailing list
>> Wheel-builders at python.org
>> https://mail.python.org/mailman/listinfo/wheel-builders
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181010/4df73605/attachment.html>

From elana at hashman.ca  Wed Oct 10 18:35:00 2018
From: elana at hashman.ca (Elana Hashman)
Date: Wed, 10 Oct 2018 18:35:00 -0400
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
Message-ID: <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>

An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181010/4be08e62/attachment.html>

From safijari at isu.edu  Thu Oct 11 11:07:39 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Thu, 11 Oct 2018 08:07:39 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
Message-ID: <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>

That's a fair point. I tried that a bit before but was getting too
befuddled. I'll give it another shot.

I've used Docker a fair aamount before but I'm brand new to CentOS 5 (which
feels very ironic given how old it is ?). I'm likely going to stumble a
fair amount trying to get all my dependencies in place and building. Is
this the best venue to ask for help during that process or is there a more
appropriate one? I'm worried about creating too much noise in the mailing
list.

On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:

> Why don't you put the build steps in your Dockerfile rather than trying to
> figure it out in interactive mode? That will let you cache layers, too.
>
> *From:* safijari at isu.edu
> *Sent:* October 10, 2018 6:23 PM
> *To:* njs at pobox.com
> *Cc:* wheel-builders at python.org
> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>
> No I'm on Linux, just weary of docker interactive mode ?
>
> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>
>> I'm not aware of such a thing, no. But... I guess you must be asking
>> because you want to work with the image on Windows or macOS? I believe both
>> of them have easy-to-install docker support, which will take care of
>> setting up a VM internally and then running any docker image you want on
>> that VM.
>>
>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>
>>> Hi,
>>>
>>> Is there a prebuilt vmware or virtualbox image similar to the manylinux1
>>> docker image? I need to do some experimentation to figure out how to get
>>> all of my package's dependencies in place and having a VM would make the
>>> discovery somewhat easier.
>>>
>>> Thanks,
>>>
>>> Jari
>>> _______________________________________________
>>> Wheel-builders mailing list
>>> Wheel-builders at python.org
>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/2121a95a/attachment-0001.html>

From safijari at isu.edu  Thu Oct 11 12:51:43 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Thu, 11 Oct 2018 09:51:43 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
 <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
Message-ID: <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>

So looks like I need to build boost as the version available in the centos
5 repos is too old, which is fine, but apparently there is no wget and I
can't for the life of me get curl to download the tar.gz of boost source
code. I'm currently cloning it but given the submodule nature of boost and
the large size of that source code it's taking a very long time.

Is there a way to get wget back? What's the recommended method of getting
dependencies like this into the container? Should I be copying them from my
filesystem?

On Thu, Oct 11, 2018 at 8:07 AM Jariullah Safi <safijari at isu.edu> wrote:

> That's a fair point. I tried that a bit before but was getting too
> befuddled. I'll give it another shot.
>
> I've used Docker a fair aamount before but I'm brand new to CentOS 5
> (which feels very ironic given how old it is ?). I'm likely going to
> stumble a fair amount trying to get all my dependencies in place and
> building. Is this the best venue to ask for help during that process or is
> there a more appropriate one? I'm worried about creating too much noise in
> the mailing list.
>
>
> On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:
>
>> Why don't you put the build steps in your Dockerfile rather than trying
>> to figure it out in interactive mode? That will let you cache layers, too.
>>
>> *From:* safijari at isu.edu
>> *Sent:* October 10, 2018 6:23 PM
>> *To:* njs at pobox.com
>> *Cc:* wheel-builders at python.org
>> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>>
>> No I'm on Linux, just weary of docker interactive mode ?
>>
>> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>>
>>> I'm not aware of such a thing, no. But... I guess you must be asking
>>> because you want to work with the image on Windows or macOS? I believe both
>>> of them have easy-to-install docker support, which will take care of
>>> setting up a VM internally and then running any docker image you want on
>>> that VM.
>>>
>>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>>
>>>> Hi,
>>>>
>>>> Is there a prebuilt vmware or virtualbox image similar to the
>>>> manylinux1 docker image? I need to do some experimentation to figure out
>>>> how to get all of my package's dependencies in place and having a VM would
>>>> make the discovery somewhat easier.
>>>>
>>>> Thanks,
>>>>
>>>> Jari
>>>> _______________________________________________
>>>> Wheel-builders mailing list
>>>> Wheel-builders at python.org
>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/1e1cce53/attachment.html>

From jcfr at kitware.com  Thu Oct 11 12:57:44 2018
From: jcfr at kitware.com (Jean-Christophe Fillion-Robin)
Date: Thu, 11 Oct 2018 12:57:44 -0400
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
 <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
 <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>
Message-ID: <CANLz8R52vGEbCa2qJWqaDhdXDFq_orXiKZ-D=mY2XO9LzZ9t-g@mail.gmail.com>

Hi Jariullah,

I confirm that running the following works:

docker pull quay.io/pypa/manylinux1_x86_64
docker run -ti --rm quay.io/pypa/manylinux1_x86_64 bash

Then run

  curl -#LO
https://dl.bintray.com/boostorg/release/1.68.0/source/boost_1_68_0.tar.gz


This means that integrated similar command in your dockerfile should also
work.



As a side note, if you would like to build software and ensure tools like
cmake, ninja, etc .. are available. You could look at dockcross/manylinux
images. See https://github.com/dockcross/dockcross#readme


Hth
Jc



On Thu, Oct 11, 2018 at 12:51 PM Jariullah Safi <safijari at isu.edu> wrote:

> So looks like I need to build boost as the version available in the centos
> 5 repos is too old, which is fine, but apparently there is no wget and I
> can't for the life of me get curl to download the tar.gz of boost source
> code. I'm currently cloning it but given the submodule nature of boost and
> the large size of that source code it's taking a very long time.
>
> Is there a way to get wget back? What's the recommended method of getting
> dependencies like this into the container? Should I be copying them from my
> filesystem?
>
> On Thu, Oct 11, 2018 at 8:07 AM Jariullah Safi <safijari at isu.edu> wrote:
>
>> That's a fair point. I tried that a bit before but was getting too
>> befuddled. I'll give it another shot.
>>
>> I've used Docker a fair aamount before but I'm brand new to CentOS 5
>> (which feels very ironic given how old it is ?). I'm likely going to
>> stumble a fair amount trying to get all my dependencies in place and
>> building. Is this the best venue to ask for help during that process or is
>> there a more appropriate one? I'm worried about creating too much noise in
>> the mailing list.
>>
>>
>> On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:
>>
>>> Why don't you put the build steps in your Dockerfile rather than trying
>>> to figure it out in interactive mode? That will let you cache layers, too.
>>>
>>> *From:* safijari at isu.edu
>>> *Sent:* October 10, 2018 6:23 PM
>>> *To:* njs at pobox.com
>>> *Cc:* wheel-builders at python.org
>>> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>>>
>>> No I'm on Linux, just weary of docker interactive mode ?
>>>
>>> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>>>
>>>> I'm not aware of such a thing, no. But... I guess you must be asking
>>>> because you want to work with the image on Windows or macOS? I believe both
>>>> of them have easy-to-install docker support, which will take care of
>>>> setting up a VM internally and then running any docker image you want on
>>>> that VM.
>>>>
>>>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Is there a prebuilt vmware or virtualbox image similar to the
>>>>> manylinux1 docker image? I need to do some experimentation to figure out
>>>>> how to get all of my package's dependencies in place and having a VM would
>>>>> make the discovery somewhat easier.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Jari
>>>>> _______________________________________________
>>>>> Wheel-builders mailing list
>>>>> Wheel-builders at python.org
>>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>>
>>>> _______________________________________________
> Wheel-builders mailing list
> Wheel-builders at python.org
> https://mail.python.org/mailman/listinfo/wheel-builders
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/e9598dfc/attachment-0001.html>

From safijari at isu.edu  Thu Oct 11 13:07:39 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Thu, 11 Oct 2018 10:07:39 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CANLz8R52vGEbCa2qJWqaDhdXDFq_orXiKZ-D=mY2XO9LzZ9t-g@mail.gmail.com>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
 <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
 <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>
 <CANLz8R52vGEbCa2qJWqaDhdXDFq_orXiKZ-D=mY2XO9LzZ9t-g@mail.gmail.com>
Message-ID: <CAJO9KCZp=daqL+UiGDWQKk=xaMMcX36MPjvGA5x8yAc8KZrspQ@mail.gmail.com>

Thanks for the tip. I ended up installing cmake using pip in the base
image. I also recognize my mistake with the -L flag in my current command
now.

Boost is building now, I see the light at the end of the tunnel. Could it
be? My first ever manylinux wheel ???

On Thu, Oct 11, 2018, 9:57 AM Jean-Christophe Fillion-Robin <
jcfr at kitware.com> wrote:

> Hi Jariullah,
>
> I confirm that running the following works:
>
> docker pull quay.io/pypa/manylinux1_x86_64
> docker run -ti --rm quay.io/pypa/manylinux1_x86_64 bash
>
> Then run
>
>   curl -#LO
> https://dl.bintray.com/boostorg/release/1.68.0/source/boost_1_68_0.tar.gz
>
>
> This means that integrated similar command in your dockerfile should also
> work.
>
>
>
> As a side note, if you would like to build software and ensure tools like
> cmake, ninja, etc .. are available. You could look at dockcross/manylinux
> images. See https://github.com/dockcross/dockcross#readme
>
>
> Hth
> Jc
>
>
>
> On Thu, Oct 11, 2018 at 12:51 PM Jariullah Safi <safijari at isu.edu> wrote:
>
>> So looks like I need to build boost as the version available in the
>> centos 5 repos is too old, which is fine, but apparently there is no wget
>> and I can't for the life of me get curl to download the tar.gz of boost
>> source code. I'm currently cloning it but given the submodule nature of
>> boost and the large size of that source code it's taking a very long time.
>>
>> Is there a way to get wget back? What's the recommended method of getting
>> dependencies like this into the container? Should I be copying them from my
>> filesystem?
>>
>> On Thu, Oct 11, 2018 at 8:07 AM Jariullah Safi <safijari at isu.edu> wrote:
>>
>>> That's a fair point. I tried that a bit before but was getting too
>>> befuddled. I'll give it another shot.
>>>
>>> I've used Docker a fair aamount before but I'm brand new to CentOS 5
>>> (which feels very ironic given how old it is ?). I'm likely going to
>>> stumble a fair amount trying to get all my dependencies in place and
>>> building. Is this the best venue to ask for help during that process or is
>>> there a more appropriate one? I'm worried about creating too much noise in
>>> the mailing list.
>>>
>>>
>>> On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:
>>>
>>>> Why don't you put the build steps in your Dockerfile rather than trying
>>>> to figure it out in interactive mode? That will let you cache layers, too.
>>>>
>>>> *From:* safijari at isu.edu
>>>> *Sent:* October 10, 2018 6:23 PM
>>>> *To:* njs at pobox.com
>>>> *Cc:* wheel-builders at python.org
>>>> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>>>>
>>>> No I'm on Linux, just weary of docker interactive mode ?
>>>>
>>>> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>>>>
>>>>> I'm not aware of such a thing, no. But... I guess you must be asking
>>>>> because you want to work with the image on Windows or macOS? I believe both
>>>>> of them have easy-to-install docker support, which will take care of
>>>>> setting up a VM internally and then running any docker image you want on
>>>>> that VM.
>>>>>
>>>>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Is there a prebuilt vmware or virtualbox image similar to the
>>>>>> manylinux1 docker image? I need to do some experimentation to figure out
>>>>>> how to get all of my package's dependencies in place and having a VM would
>>>>>> make the discovery somewhat easier.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Jari
>>>>>> _______________________________________________
>>>>>> Wheel-builders mailing list
>>>>>> Wheel-builders at python.org
>>>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>>>
>>>>> _______________________________________________
>> Wheel-builders mailing list
>> Wheel-builders at python.org
>> https://mail.python.org/mailman/listinfo/wheel-builders
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/7875a917/attachment.html>

From safijari at isu.edu  Thu Oct 11 14:36:16 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Thu, 11 Oct 2018 11:36:16 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAJO9KCZp=daqL+UiGDWQKk=xaMMcX36MPjvGA5x8yAc8KZrspQ@mail.gmail.com>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
 <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
 <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>
 <CANLz8R52vGEbCa2qJWqaDhdXDFq_orXiKZ-D=mY2XO9LzZ9t-g@mail.gmail.com>
 <CAJO9KCZp=daqL+UiGDWQKk=xaMMcX36MPjvGA5x8yAc8KZrspQ@mail.gmail.com>
Message-ID: <CAJO9KCaqSn1m_ckwsDYmaywph5vQt+YS5uu0guCsqmnTZa29eA@mail.gmail.com>

Are there any pre existing docker containers containing boost or pre built
versions of boost for manylinux?

On Thu, Oct 11, 2018 at 10:07 AM Jariullah Safi <safijari at isu.edu> wrote:

> Thanks for the tip. I ended up installing cmake using pip in the base
> image. I also recognize my mistake with the -L flag in my current command
> now.
>
> Boost is building now, I see the light at the end of the tunnel. Could it
> be? My first ever manylinux wheel ???
>
> On Thu, Oct 11, 2018, 9:57 AM Jean-Christophe Fillion-Robin <
> jcfr at kitware.com> wrote:
>
>> Hi Jariullah,
>>
>> I confirm that running the following works:
>>
>> docker pull quay.io/pypa/manylinux1_x86_64
>> docker run -ti --rm quay.io/pypa/manylinux1_x86_64 bash
>>
>> Then run
>>
>>   curl -#LO
>> https://dl.bintray.com/boostorg/release/1.68.0/source/boost_1_68_0.tar.gz
>>
>>
>> This means that integrated similar command in your dockerfile should also
>> work.
>>
>>
>>
>> As a side note, if you would like to build software and ensure tools like
>> cmake, ninja, etc .. are available. You could look at dockcross/manylinux
>> images. See https://github.com/dockcross/dockcross#readme
>>
>>
>> Hth
>> Jc
>>
>>
>>
>> On Thu, Oct 11, 2018 at 12:51 PM Jariullah Safi <safijari at isu.edu> wrote:
>>
>>> So looks like I need to build boost as the version available in the
>>> centos 5 repos is too old, which is fine, but apparently there is no wget
>>> and I can't for the life of me get curl to download the tar.gz of boost
>>> source code. I'm currently cloning it but given the submodule nature of
>>> boost and the large size of that source code it's taking a very long time.
>>>
>>> Is there a way to get wget back? What's the recommended method of
>>> getting dependencies like this into the container? Should I be copying them
>>> from my filesystem?
>>>
>>> On Thu, Oct 11, 2018 at 8:07 AM Jariullah Safi <safijari at isu.edu> wrote:
>>>
>>>> That's a fair point. I tried that a bit before but was getting too
>>>> befuddled. I'll give it another shot.
>>>>
>>>> I've used Docker a fair aamount before but I'm brand new to CentOS 5
>>>> (which feels very ironic given how old it is ?). I'm likely going to
>>>> stumble a fair amount trying to get all my dependencies in place and
>>>> building. Is this the best venue to ask for help during that process or is
>>>> there a more appropriate one? I'm worried about creating too much noise in
>>>> the mailing list.
>>>>
>>>>
>>>> On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:
>>>>
>>>>> Why don't you put the build steps in your Dockerfile rather than
>>>>> trying to figure it out in interactive mode? That will let you cache
>>>>> layers, too.
>>>>>
>>>>> *From:* safijari at isu.edu
>>>>> *Sent:* October 10, 2018 6:23 PM
>>>>> *To:* njs at pobox.com
>>>>> *Cc:* wheel-builders at python.org
>>>>> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>>>>>
>>>>> No I'm on Linux, just weary of docker interactive mode ?
>>>>>
>>>>> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>>>>>
>>>>>> I'm not aware of such a thing, no. But... I guess you must be asking
>>>>>> because you want to work with the image on Windows or macOS? I believe both
>>>>>> of them have easy-to-install docker support, which will take care of
>>>>>> setting up a VM internally and then running any docker image you want on
>>>>>> that VM.
>>>>>>
>>>>>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Is there a prebuilt vmware or virtualbox image similar to the
>>>>>>> manylinux1 docker image? I need to do some experimentation to figure out
>>>>>>> how to get all of my package's dependencies in place and having a VM would
>>>>>>> make the discovery somewhat easier.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Jari
>>>>>>> _______________________________________________
>>>>>>> Wheel-builders mailing list
>>>>>>> Wheel-builders at python.org
>>>>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>>>>
>>>>>> _______________________________________________
>>> Wheel-builders mailing list
>>> Wheel-builders at python.org
>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/63bf7165/attachment-0001.html>

From safijari at isu.edu  Thu Oct 11 16:34:20 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Thu, 11 Oct 2018 13:34:20 -0700
Subject: [Wheel-builders] manylinux1 vm image
In-Reply-To: <CAJO9KCaqSn1m_ckwsDYmaywph5vQt+YS5uu0guCsqmnTZa29eA@mail.gmail.com>
References: <CAJO9KCZsPtZefFadbLD0cv8R6FUdLXxSb1uroAFL-twgPkQLVw@mail.gmail.com>
 <vac83ftnhpqsve8i1aobnjc3.1539210900594@hashman.ca>
 <CAJO9KCZUXX3Zm2dARF8nOsT0Hk7NW=qDqviupRXnW8OnxVLrtw@mail.gmail.com>
 <CAJO9KCZC-iQswk8Z4cBZT3pSS6o5MZVk0TGVDYEGRpAvcKAZHg@mail.gmail.com>
 <CANLz8R52vGEbCa2qJWqaDhdXDFq_orXiKZ-D=mY2XO9LzZ9t-g@mail.gmail.com>
 <CAJO9KCZp=daqL+UiGDWQKk=xaMMcX36MPjvGA5x8yAc8KZrspQ@mail.gmail.com>
 <CAJO9KCaqSn1m_ckwsDYmaywph5vQt+YS5uu0guCsqmnTZa29eA@mail.gmail.com>
Message-ID: <CAJO9KCYSMpUzeD1aDka47ksHPWNLzu0pU_xqsfO1=XW9OnTvMQ@mail.gmail.com>

IT WOOORRRRRKKKKSSSSS!!! https://pypi.org/project/py-openkarto/

Thank you everyone for your help/encouragement. I gotta go automate this
now and add info :)



On Thu, Oct 11, 2018 at 11:36 AM Jariullah Safi <safijari at isu.edu> wrote:

> Are there any pre existing docker containers containing boost or pre built
> versions of boost for manylinux?
>
> On Thu, Oct 11, 2018 at 10:07 AM Jariullah Safi <safijari at isu.edu> wrote:
>
>> Thanks for the tip. I ended up installing cmake using pip in the base
>> image. I also recognize my mistake with the -L flag in my current command
>> now.
>>
>> Boost is building now, I see the light at the end of the tunnel. Could it
>> be? My first ever manylinux wheel ???
>>
>> On Thu, Oct 11, 2018, 9:57 AM Jean-Christophe Fillion-Robin <
>> jcfr at kitware.com> wrote:
>>
>>> Hi Jariullah,
>>>
>>> I confirm that running the following works:
>>>
>>> docker pull quay.io/pypa/manylinux1_x86_64
>>> docker run -ti --rm quay.io/pypa/manylinux1_x86_64 bash
>>>
>>> Then run
>>>
>>>   curl -#LO
>>> https://dl.bintray.com/boostorg/release/1.68.0/source/boost_1_68_0.tar.gz
>>>
>>>
>>> This means that integrated similar command in your dockerfile should
>>> also work.
>>>
>>>
>>>
>>> As a side note, if you would like to build software and ensure tools
>>> like cmake, ninja, etc .. are available. You could look at
>>> dockcross/manylinux images. See
>>> https://github.com/dockcross/dockcross#readme
>>>
>>>
>>> Hth
>>> Jc
>>>
>>>
>>>
>>> On Thu, Oct 11, 2018 at 12:51 PM Jariullah Safi <safijari at isu.edu>
>>> wrote:
>>>
>>>> So looks like I need to build boost as the version available in the
>>>> centos 5 repos is too old, which is fine, but apparently there is no wget
>>>> and I can't for the life of me get curl to download the tar.gz of boost
>>>> source code. I'm currently cloning it but given the submodule nature of
>>>> boost and the large size of that source code it's taking a very long time.
>>>>
>>>> Is there a way to get wget back? What's the recommended method of
>>>> getting dependencies like this into the container? Should I be copying them
>>>> from my filesystem?
>>>>
>>>> On Thu, Oct 11, 2018 at 8:07 AM Jariullah Safi <safijari at isu.edu>
>>>> wrote:
>>>>
>>>>> That's a fair point. I tried that a bit before but was getting too
>>>>> befuddled. I'll give it another shot.
>>>>>
>>>>> I've used Docker a fair aamount before but I'm brand new to CentOS 5
>>>>> (which feels very ironic given how old it is ?). I'm likely going to
>>>>> stumble a fair amount trying to get all my dependencies in place and
>>>>> building. Is this the best venue to ask for help during that process or is
>>>>> there a more appropriate one? I'm worried about creating too much noise in
>>>>> the mailing list.
>>>>>
>>>>>
>>>>> On Wed, Oct 10, 2018, 3:35 PM Elana Hashman <elana at hashman.ca> wrote:
>>>>>
>>>>>> Why don't you put the build steps in your Dockerfile rather than
>>>>>> trying to figure it out in interactive mode? That will let you cache
>>>>>> layers, too.
>>>>>>
>>>>>> *From:* safijari at isu.edu
>>>>>> *Sent:* October 10, 2018 6:23 PM
>>>>>> *To:* njs at pobox.com
>>>>>> *Cc:* wheel-builders at python.org
>>>>>> *Subject:* Re: [Wheel-builders] manylinux1 vm image
>>>>>>
>>>>>> No I'm on Linux, just weary of docker interactive mode ?
>>>>>>
>>>>>> On Wed, Oct 10, 2018, 3:01 PM Nathaniel Smith <njs at pobox.com> wrote:
>>>>>>
>>>>>>> I'm not aware of such a thing, no. But... I guess you must be asking
>>>>>>> because you want to work with the image on Windows or macOS? I believe both
>>>>>>> of them have easy-to-install docker support, which will take care of
>>>>>>> setting up a VM internally and then running any docker image you want on
>>>>>>> that VM.
>>>>>>>
>>>>>>> On Wed, Oct 10, 2018, 14:43 Jariullah Safi <safijari at isu.edu> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> Is there a prebuilt vmware or virtualbox image similar to the
>>>>>>>> manylinux1 docker image? I need to do some experimentation to figure out
>>>>>>>> how to get all of my package's dependencies in place and having a VM would
>>>>>>>> make the discovery somewhat easier.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Jari
>>>>>>>> _______________________________________________
>>>>>>>> Wheel-builders mailing list
>>>>>>>> Wheel-builders at python.org
>>>>>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>>>>>
>>>>>>> _______________________________________________
>>>> Wheel-builders mailing list
>>>> Wheel-builders at python.org
>>>> https://mail.python.org/mailman/listinfo/wheel-builders
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181011/915b7c41/attachment.html>

From safijari at isu.edu  Fri Oct 12 13:44:13 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Fri, 12 Oct 2018 10:44:13 -0700
Subject: [Wheel-builders] pyconfig.h when building boost in manylinux1
 container
Message-ID: <CAJO9KCaSnNUM=A9P1n2q8_vGgB_pHuhJF0fZY6B=hu=j8Nv=cQ@mail.gmail.com>

So, I'm trying to put together a base container I can use to build
manylinux1 containers for a number of my projects. To do this I need to
ensure it contains the dependencies I commonly encounter (e.g. eigen,
boost, opencv).

I can build specific parts of boost just fine, but to create a general
purpose container I'd like to build all libraries. Doing so leads me to
this error:

./boost/python/detail/wrap_python.hpp:50:23: fatal error: pyconfig.h: No
such file or directory
 # include <pyconfig.h>

when building Boost.Python. Now, I know I can fix that by doing something
like

CPLUS_INCLUDE_PATH="$CPLUS_INCLUDE_PATH:/opt/_internal/cpython-2.7.15-ucs4/include/python2.7/"

before running the build, but this leaves me a bit confused. Will this
cause issues with building python3 wheels? Is there a python-dev type
package I should install (for both python2 and 3?).

My instinct right now is to leave boost python out since none of my
projects currently use it, but I could certainly run into something in the
future that would use it, so any advice on the matter here would be well
appreciated.

Thank you all.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181012/2a6ea7fd/attachment.html>

From njs at pobox.com  Fri Oct 12 19:19:58 2018
From: njs at pobox.com (Nathaniel Smith)
Date: Fri, 12 Oct 2018 16:19:58 -0700
Subject: [Wheel-builders] pyconfig.h when building boost in manylinux1
 container
In-Reply-To: <CAJO9KCaSnNUM=A9P1n2q8_vGgB_pHuhJF0fZY6B=hu=j8Nv=cQ@mail.gmail.com>
References: <CAJO9KCaSnNUM=A9P1n2q8_vGgB_pHuhJF0fZY6B=hu=j8Nv=cQ@mail.gmail.com>
Message-ID: <CAPJVwB=ZcgRnJyoDQMu-3L5F_14GCbOQZ8ieYJr-SaHSMxS1jA@mail.gmail.com>

I guess boost-python uses the Python C API, which means that you can't
just build it once, but rather have to build is separately for each
version of Python you want to use it with. Normally when you build a
Python extension module, distutils/setuptools take care of setting up
the compiler include path to find pyconfig.h for whichever version of
Python you're building against.

I guess you could find some way of calling python to query distutils
to ask it which include path to use, but if you don't actually need
boost-python now, I would just skip it for now...

On Fri, Oct 12, 2018 at 10:44 AM, Jariullah Safi <safijari at isu.edu> wrote:
> So, I'm trying to put together a base container I can use to build
> manylinux1 containers for a number of my projects. To do this I need to
> ensure it contains the dependencies I commonly encounter (e.g. eigen, boost,
> opencv).
>
> I can build specific parts of boost just fine, but to create a general
> purpose container I'd like to build all libraries. Doing so leads me to this
> error:
>
> ./boost/python/detail/wrap_python.hpp:50:23: fatal error: pyconfig.h: No
> such file or directory
>  # include <pyconfig.h>
>
> when building Boost.Python. Now, I know I can fix that by doing something
> like
>
> CPLUS_INCLUDE_PATH="$CPLUS_INCLUDE_PATH:/opt/_internal/cpython-2.7.15-ucs4/include/python2.7/"
>
> before running the build, but this leaves me a bit confused. Will this cause
> issues with building python3 wheels? Is there a python-dev type package I
> should install (for both python2 and 3?).
>
> My instinct right now is to leave boost python out since none of my projects
> currently use it, but I could certainly run into something in the future
> that would use it, so any advice on the matter here would be well
> appreciated.
>
> Thank you all.
>
> _______________________________________________
> Wheel-builders mailing list
> Wheel-builders at python.org
> https://mail.python.org/mailman/listinfo/wheel-builders
>



-- 
Nathaniel J. Smith -- https://vorpus.org

From safijari at isu.edu  Fri Oct 12 19:46:54 2018
From: safijari at isu.edu (Jariullah Safi)
Date: Fri, 12 Oct 2018 16:46:54 -0700
Subject: [Wheel-builders] pyconfig.h when building boost in manylinux1
 container
In-Reply-To: <CAPJVwB=ZcgRnJyoDQMu-3L5F_14GCbOQZ8ieYJr-SaHSMxS1jA@mail.gmail.com>
References: <CAJO9KCaSnNUM=A9P1n2q8_vGgB_pHuhJF0fZY6B=hu=j8Nv=cQ@mail.gmail.com>
 <CAPJVwB=ZcgRnJyoDQMu-3L5F_14GCbOQZ8ieYJr-SaHSMxS1jA@mail.gmail.com>
Message-ID: <CAJO9KCbNoMyx_5b=UGCMRozQ9EFCsa6dQUjvD4SZPqoMtWusxQ@mail.gmail.com>

Sweet. I find Pybind11 to be infinitely superior so no tears will be she'd
for not building Boost.Python.

Thanks.

On Fri, Oct 12, 2018, 4:20 PM Nathaniel Smith <njs at pobox.com> wrote:

> I guess boost-python uses the Python C API, which means that you can't
> just build it once, but rather have to build is separately for each
> version of Python you want to use it with. Normally when you build a
> Python extension module, distutils/setuptools take care of setting up
> the compiler include path to find pyconfig.h for whichever version of
> Python you're building against.
>
> I guess you could find some way of calling python to query distutils
> to ask it which include path to use, but if you don't actually need
> boost-python now, I would just skip it for now...
>
> On Fri, Oct 12, 2018 at 10:44 AM, Jariullah Safi <safijari at isu.edu> wrote:
> > So, I'm trying to put together a base container I can use to build
> > manylinux1 containers for a number of my projects. To do this I need to
> > ensure it contains the dependencies I commonly encounter (e.g. eigen,
> boost,
> > opencv).
> >
> > I can build specific parts of boost just fine, but to create a general
> > purpose container I'd like to build all libraries. Doing so leads me to
> this
> > error:
> >
> > ./boost/python/detail/wrap_python.hpp:50:23: fatal error: pyconfig.h: No
> > such file or directory
> >  # include <pyconfig.h>
> >
> > when building Boost.Python. Now, I know I can fix that by doing something
> > like
> >
> >
> CPLUS_INCLUDE_PATH="$CPLUS_INCLUDE_PATH:/opt/_internal/cpython-2.7.15-ucs4/include/python2.7/"
> >
> > before running the build, but this leaves me a bit confused. Will this
> cause
> > issues with building python3 wheels? Is there a python-dev type package I
> > should install (for both python2 and 3?).
> >
> > My instinct right now is to leave boost python out since none of my
> projects
> > currently use it, but I could certainly run into something in the future
> > that would use it, so any advice on the matter here would be well
> > appreciated.
> >
> > Thank you all.
> >
> > _______________________________________________
> > Wheel-builders mailing list
> > Wheel-builders at python.org
> > https://mail.python.org/mailman/listinfo/wheel-builders
> >
>
>
>
> --
> Nathaniel J. Smith -- https://vorpus.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181012/afc3e53e/attachment.html>

From elana at hashman.ca  Thu Oct 18 23:24:42 2018
From: elana at hashman.ca (Elana Hashman)
Date: Thu, 18 Oct 2018 23:24:42 -0400
Subject: [Wheel-builders] "Pure" python wheels with binary dependencies --
 how to process?
Message-ID: <670c7e22b4a86fdb06366cfb5f6a9fec@hashman.ca>

I'm trying to fix a regression introduced by a PR to auditwheel[1] that 
attempted to add support for repairing wheels that are not Python 
extensions but still contain binary dependencies (e.g. [2]). This seems 
like a reasonable thing to support so I'd like to avoid a hard revert of 
the PR if possible, but I'm not 100% sure how to proceed. I've fixed the 
first bug locally but that only seems to have revealed more.

Since such a wheel is not a Python extension, it is (perhaps 
incorrectly) identified as a purelib when built. I imagine that we 
should avoid putting binary things into purelib, so it sounds like I 
should repair such a wheel to set Root-Is-Purelib to false, which should 
cause it to install into platlib if I'm reading the spec[3] right?

As for platform compatibility flags for such a wheel, I will set it to 
py3-none-manylinux1 (or whatever Python it needs).

Does this sound reasonable? I'm hoping if wheels like this start to 
circulate it won't catch anyone by surprise.

Cheers,

- e


[1]: https://github.com/pypa/auditwheel/issues/107
[2]: 
https://github.com/pypa/auditwheel/pull/95/files#diff-01628eaed8ff1de796a126b6e752ea91
[3]: https://www.python.org/dev/peps/pep-0427/#file-contents

From njs at pobox.com  Thu Oct 18 23:36:27 2018
From: njs at pobox.com (Nathaniel Smith)
Date: Thu, 18 Oct 2018 20:36:27 -0700
Subject: [Wheel-builders] "Pure" python wheels with binary dependencies
 -- how to process?
In-Reply-To: <670c7e22b4a86fdb06366cfb5f6a9fec@hashman.ca>
References: <670c7e22b4a86fdb06366cfb5f6a9fec@hashman.ca>
Message-ID: <CAPJVwBm772HqKEGOk9fkXRax6X-y3=-YKwnL+kX2NHw3FNGX=g@mail.gmail.com>

That all makes sense to me!

On Thu, Oct 18, 2018 at 8:24 PM, Elana Hashman <elana at hashman.ca> wrote:
> I'm trying to fix a regression introduced by a PR to auditwheel[1] that
> attempted to add support for repairing wheels that are not Python extensions
> but still contain binary dependencies (e.g. [2]). This seems like a
> reasonable thing to support so I'd like to avoid a hard revert of the PR if
> possible, but I'm not 100% sure how to proceed. I've fixed the first bug
> locally but that only seems to have revealed more.
>
> Since such a wheel is not a Python extension, it is (perhaps incorrectly)
> identified as a purelib when built. I imagine that we should avoid putting
> binary things into purelib, so it sounds like I should repair such a wheel
> to set Root-Is-Purelib to false, which should cause it to install into
> platlib if I'm reading the spec[3] right?
>
> As for platform compatibility flags for such a wheel, I will set it to
> py3-none-manylinux1 (or whatever Python it needs).
>
> Does this sound reasonable? I'm hoping if wheels like this start to
> circulate it won't catch anyone by surprise.
>
> Cheers,
>
> - e
>
>
> [1]: https://github.com/pypa/auditwheel/issues/107
> [2]:
> https://github.com/pypa/auditwheel/pull/95/files#diff-01628eaed8ff1de796a126b6e752ea91
> [3]: https://www.python.org/dev/peps/pep-0427/#file-contents
> _______________________________________________
> Wheel-builders mailing list
> Wheel-builders at python.org
> https://mail.python.org/mailman/listinfo/wheel-builders



-- 
Nathaniel J. Smith -- https://vorpus.org

From ehashman at debian.org  Sat Oct 27 17:27:07 2018
From: ehashman at debian.org (Elana Hashman)
Date: Sat, 27 Oct 2018 17:27:07 -0400
Subject: [Wheel-builders] auditwheel 1.10.0rc1 is now available
Message-ID: <20181027212707.GA13071@feralas>

Hello from the PyPA sprints in NYC!

I am pleased to announce the 1.10.0rc1 release of auditwheel.[0] The
release notes can be found on GitHub.[1]

This release is particularly exciting as I have submitted changes to
ensure that auditwheel should correctly process non-extension wheels
that contain binary dependencies.[2] As a result, auditwheel can now
detect and correctly handle binaries in pure wheels.

Please do test it out and file bugs or send me a note as necessary. If I
don't hear anything I will proceed with a real release in a week or so.

Now that CI is working again, I plan on trying to get the manylinux2010
changes working, tested, and released next. I promise it will happen
before the end of the year!!

Looking forward to your feedback,

- e

PS: If you are interested in helping out with auditwheel maintenance,
I'd love to hear from you.

[0]: https://pypi.org/project/auditwheel/1.10.0rc1/
[1]: https://github.com/pypa/auditwheel/releases/tag/1.10rc1
[2]: https://github.com/pypa/auditwheel/pull/110
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 949 bytes
Desc: Digital signature
URL: <http://mail.python.org/pipermail/wheel-builders/attachments/20181027/ac909566/attachment.sig>