From sasharaud at gmail.com  Fri Jul  2 16:19:57 2021
From: sasharaud at gmail.com (=?UTF-8?B?0JDQu9C10LrRgdCw0L3QtNGAINCg0LDRg9C0?=)
Date: Fri, 2 Jul 2021 13:19:57 -0700
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
Message-ID: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>

Hi!

I am looking for support to make Pandas working in PyPy3 under Ubuntu.
Is there a BKM for this?

pypy3 -m pip install pandas

fails with:

/build_src.py", line 377, in generate_sources

          source = func(extension, build_dir)

        File "numpy/core/setup.py", line 422, in generate_config_h

          moredefs, ignored = cocache.check_types(config_cmd, ext,
build_dir)

        File "numpy/core/setup.py", line 48, in check_types

          out = check_types(*a, **kw)

        File "numpy/core/setup.py", line 281, in check_types

          "install {0}-dev|{0}-devel.".format(python))

      SystemError: Cannot compile 'Python.h'. Perhaps you need to install
pypy-dev|pypy-devel.

the python-dev is installed:

~# locate Python.h

/usr/include/python2.7/Python.h

/usr/include/python3.8/Python.h
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210702/aa71134f/attachment.html>

From yury at shurup.com  Sat Jul  3 04:06:23 2021
From: yury at shurup.com (Yury V. Zaytsev)
Date: Sat, 3 Jul 2021 10:06:23 +0200
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
In-Reply-To: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
References: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
Message-ID: <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>

Did you install pypy-dev, as the error message says, and not python-dev?

Sent from my iPad

> On 3. Jul 2021, at 09:38, ????????? ???? <sasharaud at gmail.com> wrote:
> 
> ?
> Hi!
> 
> I am looking for support to make Pandas working in PyPy3 under Ubuntu.
> Is there a BKM for this?
> 
> pypy3 -m pip install pandas
> 
> fails with:
> 
> /build_src.py", line 377, in generate_sources
>           source = func(extension, build_dir)
>         File "numpy/core/setup.py", line 422, in generate_config_h
>           moredefs, ignored = cocache.check_types(config_cmd, ext, build_dir)
>         File "numpy/core/setup.py", line 48, in check_types
>           out = check_types(*a, **kw)
>         File "numpy/core/setup.py", line 281, in check_types
>           "install {0}-dev|{0}-devel.".format(python))
>       SystemError: Cannot compile 'Python.h'. Perhaps you need to install pypy-dev|pypy-devel.
> 
> the python-dev is installed:
> 
> ~# locate Python.h
> /usr/include/python2.7/Python.h
> /usr/include/python3.8/Python.h
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210703/101d2d43/attachment.html>

From sasharaud at gmail.com  Sat Jul  3 15:04:12 2021
From: sasharaud at gmail.com (=?UTF-8?B?0JDQu9C10LrRgdCw0L3QtNGAINCg0LDRg9C0?=)
Date: Sat, 3 Jul 2021 12:04:12 -0700
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
In-Reply-To: <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>
References: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
 <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>
Message-ID: <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>

Yes, please read my original message entirely :)

On Sat, Jul 3, 2021, 1:06 AM Yury V. Zaytsev <yury at shurup.com> wrote:

> Did you install pypy-dev, as the error message says, and not python-dev?
>
> Sent from my iPad
>
> On 3. Jul 2021, at 09:38, ????????? ???? <sasharaud at gmail.com> wrote:
>
> ?
> Hi!
>
> I am looking for support to make Pandas working in PyPy3 under Ubuntu.
> Is there a BKM for this?
>
> pypy3 -m pip install pandas
>
> fails with:
>
> /build_src.py", line 377, in generate_sources
>
>           source = func(extension, build_dir)
>
>         File "numpy/core/setup.py", line 422, in generate_config_h
>
>           moredefs, ignored = cocache.check_types(config_cmd, ext,
> build_dir)
>
>         File "numpy/core/setup.py", line 48, in check_types
>
>           out = check_types(*a, **kw)
>
>         File "numpy/core/setup.py", line 281, in check_types
>
>           "install {0}-dev|{0}-devel.".format(python))
>
>       SystemError: Cannot compile 'Python.h'. Perhaps you need to install
> pypy-dev|pypy-devel.
>
> the python-dev is installed:
>
> ~# locate Python.h
>
> /usr/include/python2.7/Python.h
>
> /usr/include/python3.8/Python.h
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210703/46ff1773/attachment.html>

From Tobias_Pape at gmx.de  Sat Jul  3 15:12:39 2021
From: Tobias_Pape at gmx.de (Tobias Pape)
Date: Sat, 3 Jul 2021 21:12:39 +0200
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
In-Reply-To: <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>
References: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
 <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>
 <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>
Message-ID: <69335A23-6458-4918-9196-622593BDDB62@gmx.de>

Hi


> On 3. Jul 2021, at 21:04, ????????? ???? <sasharaud at gmail.com> wrote:
> 
> Yes, please read my original message entirely :)

In your message your said

	"the python-dev is installed"

But you need to install
	
	pypy-dev 

as Yury (and the error message) point out.

Best regards
	-Tobias

> 
> On Sat, Jul 3, 2021, 1:06 AM Yury V. Zaytsev <yury at shurup.com> wrote:
> Did you install pypy-dev, as the error message says, and not python-dev?
> 
> Sent from my iPad
> 
>> On 3. Jul 2021, at 09:38, ????????? ???? <sasharaud at gmail.com> wrote:
>> 
>> ?
>> Hi!
>> 
>> I am looking for support to make Pandas working in PyPy3 under Ubuntu.
>> Is there a BKM for this?
>> 
>> pypy3 -m pip install pandas
>> 
>> fails with:
>> 
>> /build_src.py", line 377, in generate_sources
>>           source = func(extension, build_dir)
>>         File "numpy/core/setup.py", line 422, in generate_config_h
>>           moredefs, ignored = cocache.check_types(config_cmd, ext, build_dir)
>>         File "numpy/core/setup.py", line 48, in check_types
>>           out = check_types(*a, **kw)
>>         File "numpy/core/setup.py", line 281, in check_types
>>           "install {0}-dev|{0}-devel.".format(python))
>>       SystemError: Cannot compile 'Python.h'. Perhaps you need to install pypy-dev|pypy-devel.
>> 
>> the python-dev is installed:
>> 
>> ~# locate Python.h
>> /usr/include/python2.7/Python.h
>> /usr/include/python3.8/Python.h
>> _______________________________________________
>> pypy-dev mailing list
>> pypy-dev at python.org
>> https://mail.python.org/mailman/listinfo/pypy-dev
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev



From matti.picus at gmail.com  Sat Jul  3 15:14:51 2021
From: matti.picus at gmail.com (Matti Picus)
Date: Sat, 3 Jul 2021 22:14:51 +0300
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
In-Reply-To: <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>
References: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
 <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>
 <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>
Message-ID: <45735450-2cca-24bd-d826-1757c61b71ec@gmail.com>


On 3/7/21 10:04 pm, ????????? ???? wrote:
> the python-dev is installed:
>
> ~# locate Python.h
>
> /usr/include/python2.7/Python.h
>
> /usr/include/python3.8/Python.h
>

This is insufficient. You need to follow the instructions and install 
*pypy3-dev*, not python3-dev. This will install header files in 
/usr/lib/pypy3.


Unless you are interested in compiling the entire scientific python 
stack from source I would recommend you use conda. They provide 
pre-compiled binary packages.


conda create -n pypy3.7 -c conda-forge pypy

conda activate pypy3.7

# now your prompt should show (pypy3.7)$

conda install -c conda-forge pandas


Matti


From arigo at tunes.org  Tue Jul  6 05:01:58 2021
From: arigo at tunes.org (Armin Rigo)
Date: Tue, 6 Jul 2021 11:01:58 +0200
Subject: [pypy-dev] Subscribed to mailing list,
 but don't see how to submit a question
In-Reply-To: <SN7PR18MB38403140759A5082AB229362B21B9@SN7PR18MB3840.namprd18.prod.outlook.com>
References: <SN7PR18MB38403140759A5082AB229362B21B9@SN7PR18MB3840.namprd18.prod.outlook.com>
Message-ID: <CAMSv6X2wzWar0FOyb9vwZRd-15No2m5DKeR2Uz6z1_TO-QP2rQ@mail.gmail.com>

Hi,

You write to the mailing list by writing to pypy-dev at python.org.

Your question: How do you break into running pypy3 code, to stop execution?

Like CPython, it's supposed to be ctrl-c or Ctrl-break. Maybe it didn't
work on some older versions on windows. If you are using windows, try
upgrading to the latest version.

A bient?t,
Armin

>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210706/2fd028e7/attachment.html>

From matti.picus at gmail.com  Tue Jul  6 05:13:23 2021
From: matti.picus at gmail.com (Matti Picus)
Date: Tue, 6 Jul 2021 12:13:23 +0300
Subject: [pypy-dev] Subscribed to mailing list,
 but don't see how to submit a question
In-Reply-To: <CAMSv6X2wzWar0FOyb9vwZRd-15No2m5DKeR2Uz6z1_TO-QP2rQ@mail.gmail.com>
References: <SN7PR18MB38403140759A5082AB229362B21B9@SN7PR18MB3840.namprd18.prod.outlook.com>
 <CAMSv6X2wzWar0FOyb9vwZRd-15No2m5DKeR2Uz6z1_TO-QP2rQ@mail.gmail.com>
Message-ID: <9d43c22b-c54b-b61a-ad4e-71adda0ce645@gmail.com>

On 6/7/21 12:01 pm, Armin Rigo wrote:

> Hi,
>
> You write to the mailing list by writing to pypy-dev at python.org 
> <mailto:pypy-dev at python.org>.
>
> Your question: How do you break into running pypy3 code, to stop 
> execution?
>
> Like CPython, it's supposed to be ctrl-c or Ctrl-break. Maybe it 
> didn't work on some older versions on windows. If you are using 
> windows, try upgrading to the latest version.
>
> A bient?t,
> Armin
>
>

Maybe relevant https://foss.heptapod.net/pypy/pypy/-/issues/3454 where 
ctrl-c does not work sometimes on windows

A small reproducer would be nice - it is difficult to determine what is 
going on in the scenario mentioned in the issue.

Matti


From neothreeeight at hotmail.com  Tue Jul  6 09:43:02 2021
From: neothreeeight at hotmail.com (G Connor)
Date: Tue, 6 Jul 2021 13:43:02 +0000
Subject: [pypy-dev] Subscribed to mailing list,
 but don't see how to submit a question
In-Reply-To: <CAMSv6X2wzWar0FOyb9vwZRd-15No2m5DKeR2Uz6z1_TO-QP2rQ@mail.gmail.com>
References: <SN7PR18MB38403140759A5082AB229362B21B9@SN7PR18MB3840.namprd18.prod.outlook.com>,
 <CAMSv6X2wzWar0FOyb9vwZRd-15No2m5DKeR2Uz6z1_TO-QP2rQ@mail.gmail.com>
Message-ID: <SN7PR18MB384041A755A626870E0D9401B21B9@SN7PR18MB3840.namprd18.prod.outlook.com>


Got it.  Ctrl+C works, but Ctrl+Break doesn?t.

Running Win10

$ pypy3 --version
Python 3.7.10 (77787b8f4c49, May 15 2021, 11:51:36)
[PyPy 7.3.5 with MSC v.1927 64 bit (AMD64)] on win32



Thanks






From: Armin Rigo<mailto:arigo at tunes.org>
Sent: Tuesday, July 6, 2021 5:02 AM
To: G Connor<mailto:neothreeeight at hotmail.com>; PyPy Developer Mailing List<mailto:pypy-dev at python.org>
Subject: Re: Subscribed to mailing list, but don't see how to submit a question

Hi,

You write to the mailing list by writing to pypy-dev at python.org<mailto:pypy-dev at python.org>.

Your question: How do you break into running pypy3 code, to stop execution?

Like CPython, it's supposed to be ctrl-c or Ctrl-break. Maybe it didn't work on some older versions on windows. If you are using windows, try upgrading to the latest version.

A bient?t,
Armin

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210706/cc96578a/attachment.html>

From rlutz at hedmen.org  Sat Jul 10 09:44:35 2021
From: rlutz at hedmen.org (Roland Lutz)
Date: Sat, 10 Jul 2021 15:44:35 +0200 (CEST)
Subject: [pypy-dev] Autotools integration / How to determine .so filename
 extension
Message-ID: <alpine.DEB.2.21.2107101503420.25590@nimbus>

Hi,

I am currently using CPython 2 extensions and code in a project that's 
mostly written in C.  I've been moving the extensions from the CPython API 
to PyPy/CFFI; but now I'm struggling with integrating the CFFI extensions 
into the Autotools build process.

With CPython, there is the autoconf macro `AM_PATH_PYTHON' for determining 
the interpreter path and module directories[0].  Is there anything similar 
for PyPy?

In order to build and install the extension modules correctly, I need to 
find out the appropriate

   (1) .so filename extension,
   (2) compiler flags,
   (3) linker flags, and
   (4) installation directory.

Finding out the flags works the same as it does in CPython 3,

   >>>> from distutils.ccompiler import new_compiler
   >>>> from distutils.sysconfig import customize_compiler
   >>>> c = new_compiler()
   >>>> customize_compiler(c)
   >>>> c.compiler_so[1:]
   ['-pthread', '-DNDEBUG', '-O2', '-fPIC']
   >>>> c.linker_so[1:]
   ['-pthread', '-shared']

but finding out the .so filename

   >>> import _imp
   >>> _imp.extension_suffixes()[0]
   '.cpython-37m-x86_64-linux-gnu.so'

doesn't work with PyPy:

   >>>> import _imp
   Traceback (most recent call last):
     File "<stdin>", line 1, in <module>
   ImportError: No module named _imp

How do I determine the correct filename extension for PyPy extension 
modules?

Roland


[0] https://www.gnu.org/software/automake/manual/html_node/Python.html


From drsalists at gmail.com  Sat Jul 10 12:50:25 2021
From: drsalists at gmail.com (Dan Stromberg)
Date: Sat, 10 Jul 2021 09:50:25 -0700
Subject: [pypy-dev] Autotools integration / How to determine .so
 filename extension
In-Reply-To: <alpine.DEB.2.21.2107101503420.25590@nimbus>
References: <alpine.DEB.2.21.2107101503420.25590@nimbus>
Message-ID: <CAGGBd_o_OLmFNYmZ8Cp=FRc+rcuu8GPogBYCKYs0o=_eYyP1vQ@mail.gmail.com>

On Sat, Jul 10, 2021 at 7:18 AM Roland Lutz <rlutz at hedmen.org> wrote:

> Hi,
>
Hi.

I am currently using CPython 2 extensions and code in a project that's
> mostly written in C.  I've been moving the extensions from the CPython API
> to PyPy/CFFI;

CFFI is probably good, but did you evaluate HPY?

In order to build and install the extension modules correctly, I need to
> find out the appropriate
>
>    (1) .so filename extension,
>    (2) compiler flags,
>    (3) linker flags, and
>    (4) installation directory.
>
Does libtool handle some of this for you?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210710/25ff2410/attachment.html>

From matti.picus at gmail.com  Sat Jul 10 13:51:09 2021
From: matti.picus at gmail.com (Matti Picus)
Date: Sat, 10 Jul 2021 20:51:09 +0300
Subject: [pypy-dev] Autotools integration / How to determine .so
 filename extension
In-Reply-To: <alpine.DEB.2.21.2107101503420.25590@nimbus>
References: <alpine.DEB.2.21.2107101503420.25590@nimbus>
Message-ID: <b438860a-c798-67e6-a284-d3411cc8e977@gmail.com>


On 10/7/21 4:44 pm, Roland Lutz wrote:
> How do I determine the correct filename extension for PyPy extension 
> modules?
>

The canonical way is to use sysconfig


pypy -c "import sysconfig;print(sysconfig.get_config_var('EXT_SUFFIX'))"

.pypy37-pp73-x86_64-linux-gnu.so


On python2.7 use 'SO'

~/oss/pypy2.7-HEAD/bin/pypy -c "import 
sysconfig;print(sysconfig.get_config_var('SO'))"

.pypy-73.so


If you wish to cross-compile or do not want to run python to find the 
values, pypy7.3.5+ on linux now ship a CPython compatible file with all 
the values pre-computed. The file is

<pypy-directory>/lib_pypy/_sysconfigdata__linux*.py

Matti


From rlutz at hedmen.org  Mon Jul 12 11:33:36 2021
From: rlutz at hedmen.org (Roland Lutz)
Date: Mon, 12 Jul 2021 17:33:36 +0200 (CEST)
Subject: [pypy-dev] Autotools integration / How to determine .so
 filename extension
In-Reply-To: <b438860a-c798-67e6-a284-d3411cc8e977@gmail.com>
References: <alpine.DEB.2.21.2107101503420.25590@nimbus>
 <b438860a-c798-67e6-a284-d3411cc8e977@gmail.com>
Message-ID: <alpine.DEB.2.21.2107121711010.16673@nimbus>

On Sat, 10 Jul 2021, Matti Picus wrote:
> The canonical way is to use sysconfig
>
> pypy -c "import sysconfig;print(sysconfig.get_config_var('EXT_SUFFIX'))"
>
> .pypy37-pp73-x86_64-linux-gnu.so
>
>
> On python2.7 use 'SO'
>
> ~/oss/pypy2.7-HEAD/bin/pypy -c "import 
> sysconfig;print(sysconfig.get_config_var('SO'))"
>
> .pypy-73.so


This is exactly what I have been looking for.  Thenk you very much!


In case anyone is interested, here is my resulting autoconf macro:

     https://gist.github.com/rlutz/334b995462e8d52ae2ae102334b45170

This is an extended version of the standard `AM_PATH_PYTHON' macro.  It 
takes two arguments: a minimum Python 2 version, and a minimum Python 3 
version.

     AM_PATH_PYTHON_EXT([2.7], [3.5])

In case your package supports either only Python 2 or only Python 3, leave 
the other argument blank.

     AM_PATH_PYTHON_EXT([2.7], [])
     AM_PATH_PYTHON_EXT([], [3.5])

This macro chooses the newest available version of PyPy matching the 
arguments, falling back to CPython if PyPy isn't available.  It defines 
the following output values:

     PYTHON - the name of the Python executable
     PYTHON_VERSION - the Python version in the form MAJOR.MINOR
     PYTHON_PLATFORM - the value of sys.platform

     PYTHON_EXT_SUFFIX - filename extension for extension modules
     PYTHON_CFLAGS - CFLAGS for compiling extension modules
     PYTHON_LDFLAGS - LDFLAGS for compiling extension modules

     PYTHON_PREFIX, PYTHON_EXEC_PREFIX - the correct prefixes
     pythondir, pkgpythondir - where to install pure-Python packages
     pyexecdir, pkgpyexecdir - where to install packages that contain
                               extension modules

The macro can be used as a drop-in replacement for AM_PATH_PYTHON (but 
beware of the changed arguments).  If you are using Autotools for building 
Python extensions, you are probably also calling PKG_CHECK_MODULES for 
obtaining the PYTHON_CFLAGS; this call isn't necessary any more and should 
be removed.

Roland


From sasharaud at gmail.com  Mon Jul 12 13:18:28 2021
From: sasharaud at gmail.com (=?UTF-8?B?0JDQu9C10LrRgdCw0L3QtNGAINCg0LDRg9C0?=)
Date: Mon, 12 Jul 2021 10:18:28 -0700
Subject: [pypy-dev] Pandas/Numpy in Ubuntu
In-Reply-To: <69335A23-6458-4918-9196-622593BDDB62@gmx.de>
References: <CAK8=F1w=imC9m7Yhyyzt5HqV2NLDDO-4k7C88_V2o2Un+NjHtg@mail.gmail.com>
 <58709DCE-610B-4FB6-B534-5DACEF8AE24F@shurup.com>
 <CAK8=F1y=ck3Npr+kME=Gkc41fgrp_iAAHOP7jO7sYRi56AfS8Q@mail.gmail.com>
 <69335A23-6458-4918-9196-622593BDDB62@gmx.de>
Message-ID: <CAK8=F1ws2GUf60iXb4QyB+L_R6Pa=pO0aq0VyL-0L9pajgknBg@mail.gmail.com>

Ah, my bad guys, thank you!

With this change I was able to build Pandas.

Thank you so very much!

On Sat, Jul 3, 2021 at 12:12 PM Tobias Pape <Tobias_Pape at gmx.de> wrote:

> Hi
>
>
> > On 3. Jul 2021, at 21:04, ????????? ???? <sasharaud at gmail.com> wrote:
> >
> > Yes, please read my original message entirely :)
>
> In your message your said
>
>         "the python-dev is installed"
>
> But you need to install
>
>         pypy-dev
>
> as Yury (and the error message) point out.
>
> Best regards
>         -Tobias
>
> >
> > On Sat, Jul 3, 2021, 1:06 AM Yury V. Zaytsev <yury at shurup.com> wrote:
> > Did you install pypy-dev, as the error message says, and not python-dev?
> >
> > Sent from my iPad
> >
> >> On 3. Jul 2021, at 09:38, ????????? ???? <sasharaud at gmail.com> wrote:
> >>
> >> ?
> >> Hi!
> >>
> >> I am looking for support to make Pandas working in PyPy3 under Ubuntu.
> >> Is there a BKM for this?
> >>
> >> pypy3 -m pip install pandas
> >>
> >> fails with:
> >>
> >> /build_src.py", line 377, in generate_sources
> >>           source = func(extension, build_dir)
> >>         File "numpy/core/setup.py", line 422, in generate_config_h
> >>           moredefs, ignored = cocache.check_types(config_cmd, ext,
> build_dir)
> >>         File "numpy/core/setup.py", line 48, in check_types
> >>           out = check_types(*a, **kw)
> >>         File "numpy/core/setup.py", line 281, in check_types
> >>           "install {0}-dev|{0}-devel.".format(python))
> >>       SystemError: Cannot compile 'Python.h'. Perhaps you need to
> install pypy-dev|pypy-devel.
> >>
> >> the python-dev is installed:
> >>
> >> ~# locate Python.h
> >> /usr/include/python2.7/Python.h
> >> /usr/include/python3.8/Python.h
> >> _______________________________________________
> >> pypy-dev mailing list
> >> pypy-dev at python.org
> >> https://mail.python.org/mailman/listinfo/pypy-dev
> > _______________________________________________
> > pypy-dev mailing list
> > pypy-dev at python.org
> > https://mail.python.org/mailman/listinfo/pypy-dev
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.python.org/pipermail/pypy-dev/attachments/20210712/7e6c7566/attachment.html>

From rlutz at hedmen.org  Tue Jul 13 12:19:44 2021
From: rlutz at hedmen.org (Roland Lutz)
Date: Tue, 13 Jul 2021 18:19:44 +0200 (CEST)
Subject: [pypy-dev] Autotools integration / How to determine .so
 filename extension
In-Reply-To: <CAGGBd_o_OLmFNYmZ8Cp=FRc+rcuu8GPogBYCKYs0o=_eYyP1vQ@mail.gmail.com>
References: <alpine.DEB.2.21.2107101503420.25590@nimbus>
 <CAGGBd_o_OLmFNYmZ8Cp=FRc+rcuu8GPogBYCKYs0o=_eYyP1vQ@mail.gmail.com>
Message-ID: <alpine.DEB.2.21.2107131803490.11413@nimbus>

On Sat, 10 Jul 2021, Dan Stromberg wrote:
> On Sat, Jul 10, 2021 at 7:18 AM Roland Lutz <rlutz at hedmen.org> wrote:
> I've been moving the extensions from the CPython API to PyPy/CFFI
> 
> CFFI is probably good, but did you evaluate HPY?

HPy looks like it may be exactly what I've been looking for, but 
unfortunately, according to the website, "is still in an early stage of 
development and there is no official release yet"[0].


[0] https://hpyproject.org/


From amirouche at hyper.dev  Sun Jul 18 04:34:34 2021
From: amirouche at hyper.dev (Amirouche)
Date: Sun, 18 Jul 2021 10:34:34 +0200
Subject: [pypy-dev] Python 3.7.10[pypy-7.3.5-final] OperationError in
 multiprocessing
Message-ID: <27e3739bc6f159716dc10db7fa9d6317@hyper.dev>

I met the following traceback:


Traceback (most recent call last):
   File "/usr/lib/pypy3/lib-python/3/concurrent/futures/process.py", line 
102, in _python_exit
     thread_wakeup.wakeup()
   File "/usr/lib/pypy3/lib-python/3/concurrent/futures/process.py", line 
90, in wakeup
     self._writer.send_bytes(b"")
   File "/usr/lib/pypy3/lib-python/3/multiprocessing/connection.py", line 
183, in send_bytes
     self._check_closed()
   File "/usr/lib/pypy3/lib-python/3/multiprocessing/connection.py", line 
136, in _check_closed
     raise OSError("handle is closed")
OSError: handle is closed
debug: OperationError:
debug:  operror-type: OSError
debug:  operror-value: handle is closed


The code is:


@pytest.mark.asyncio
async def test_peace_search_store():
     import multiprocessing
     from found import pstore
     from concurrent import futures

     db = await open()

     with 
futures.ProcessPoolExecutor(max_workers=multiprocessing.cpu_count()) as 
pool:
         store = pstore.make('test-pstore', (42,), pool)

         DOC0 = dict(
             foundationdb=1,
             okvs=2,
             database=42,
         )
         DOC1 = dict(
             sqlite=1,
             sql=2,
             database=3
         )
         DOC2 = dict(
             spam=42,
         )
         for uid, doc in enumerate((DOC0, DOC1, DOC2)):
             await found.transactional(db, pstore.index, store, uid, doc)

         expected = [(0, 1)]
         out = await found.transactional(db, pstore.search, store, 
["foundationdb"], 10)
         assert out == expected

         expected = [(2, 42)]
         out = await found.transactional(db, pstore.search, store, 
["spam"], 10)
         assert out == expected

         expected = [(0, 42), (1, 3)]
         out = await found.transactional(db, pstore.search, store, 
["database"], 10)
         assert out == expected


Also pstore.search will call the following pool_for_each_par_map:

from aiostream import pipe, stream
import asyncio


async def pool_for_each_par_map(loop, pool, f, p, iterator):
     zx = stream.iterate(iterator)
     zx = zx | pipe.map(lambda x: loop.run_in_executor(pool, p, x))
     async with zx.stream() as streamer:
         limit = pool._max_workers
         unfinished = []
         while True:
             tasks = []
             for i in range(limit):
                 try:
                     task = await streamer.__anext__()
                 except StopAsyncIteration:
                     limit = 0
                 else:
                     tasks.append(task)
             tasks = tasks + list(unfinished)
             assert len(tasks) <= pool._max_workers
             if not tasks:
                 break
             finished, unfinished = await asyncio.wait(
                 tasks, return_when=asyncio.FIRST_COMPLETED
             )
             for finish in finished:
                 out = finish.result()
                 f(out)
             limit = len(finished)


You can reproduce with the following cli dance:

   git clone --branch=rework 
https://github.com/amirouche/asyncio-foundationdb/
   cd asyncio-founndationdb
   make init
   poetry run make check

I am not sure how to proceed I can try nightly builds but which ones? 
py3.7 oor py3.8?

Feedback welcome.

From amirouche at hyper.dev  Sun Jul 18 04:43:02 2021
From: amirouche at hyper.dev (Amirouche)
Date: Sun, 18 Jul 2021 10:43:02 +0200
Subject: [pypy-dev] Python 3.7.10[pypy-7.3.5-final] OperationError in
 multiprocessing
In-Reply-To: <27e3739bc6f159716dc10db7fa9d6317@hyper.dev>
References: <27e3739bc6f159716dc10db7fa9d6317@hyper.dev>
Message-ID: <a0a19f8210089bcaf0509136bde3009d@hyper.dev>

Same behavior with recent 3.7 and 3.8 nightly builds:

- pypy-c-jit-102762-cfc38b565a4e-linux64.tar.bz2 (3.7)

- pypy-c-jit-102728-ace3d170113d-linux64.tar.bz2 (3.8)

By the way the same code runs fine with CPython 3.9.2

From matti.picus at gmail.com  Sun Jul 18 06:35:59 2021
From: matti.picus at gmail.com (Matti Picus)
Date: Sun, 18 Jul 2021 13:35:59 +0300
Subject: [pypy-dev] Python 3.7.10[pypy-7.3.5-final] OperationError in
 multiprocessing
In-Reply-To: <a0a19f8210089bcaf0509136bde3009d@hyper.dev>
References: <27e3739bc6f159716dc10db7fa9d6317@hyper.dev>
 <a0a19f8210089bcaf0509136bde3009d@hyper.dev>
Message-ID: <632a8157-118a-8050-34ad-1408f2262c56@gmail.com>


On 18/7/21 11:43 am, Amirouche wrote:
> Same behavior with recent 3.7 and 3.8 nightly builds:
>
> - pypy-c-jit-102762-cfc38b565a4e-linux64.tar.bz2 (3.7)
>
> - pypy-c-jit-102728-ace3d170113d-linux64.tar.bz2 (3.8)
>
> By the way the same code runs fine with CPython 3.9.2
>

Our issue tracker is at https://foss.heptapod.net/pypy/pypy/-/issues.

There is issue https://foss.heptapod.net/pypy/pypy/-/issues/3317, is 
that similar?

The nightly py3.7 branch is probably better to test against than the 
as-yet-unreleased py3.8.

Does the code run without erroring on CPython 3.7.10


Matti


From amirouche at hyper.dev  Sun Jul 18 10:28:10 2021
From: amirouche at hyper.dev (Amirouche)
Date: Sun, 18 Jul 2021 16:28:10 +0200
Subject: [pypy-dev] Python 3.7.10[pypy-7.3.5-final] OperationError in
 multiprocessing
In-Reply-To: <632a8157-118a-8050-34ad-1408f2262c56@gmail.com>
References: <27e3739bc6f159716dc10db7fa9d6317@hyper.dev>
 <a0a19f8210089bcaf0509136bde3009d@hyper.dev>
 <632a8157-118a-8050-34ad-1408f2262c56@gmail.com>
Message-ID: <578b58e1920ea432835ab9104c6d649a@hyper.dev>

On 2021-07-18 12:35, Matti Picus wrote:
> On 18/7/21 11:43 am, Amirouche wrote:
>> Same behavior with recent 3.7 and 3.8 nightly builds:
>> 
>> - pypy-c-jit-102762-cfc38b565a4e-linux64.tar.bz2 (3.7)
>> 
>> - pypy-c-jit-102728-ace3d170113d-linux64.tar.bz2 (3.8)
>> 
>> By the way the same code runs fine with CPython 3.9.2
>> 
> 
> Our issue tracker is at https://foss.heptapod.net/pypy/pypy/-/issues.
> 
> There is issue https://foss.heptapod.net/pypy/pypy/-/issues/3317, is
> that similar?

Yes it is similar.

> 
> The nightly py3.7 branch is probably better to test against than the
> as-yet-unreleased py3.8.
> 
> Does the code run without erroring on CPython 3.7.10
> 

There is no error with cpython 3.7.10