From armin.rigo at gmail.com  Fri Jun  1 04:37:42 2018
From: armin.rigo at gmail.com (Armin Rigo)
Date: Fri, 1 Jun 2018 10:37:42 +0200
Subject: [pypy-dev] Mysterious IndexError in service running with PyPy
In-Reply-To: <5b03c396.1c69fb81.99fb1.a809SMTPIN_ADDED_BROKEN@mx.google.com>
References: <5a37757a.4a98500a.ba397.d553SMTPIN_ADDED_BROKEN@mx.google.com>
 <CAHgd1hFAL8M4Ccv8nrFrzrpXWgsWkhSBgZkmTJrMk_2yGipj=A@mail.gmail.com>
 <5A3C662E.9070506@jiedaibao.com>
 <5b0384c5.1c69fb81.d8569.2e54SMTPIN_ADDED_BROKEN@mx.google.com>
 <CAMSv6X267NW-QDH2WaNhj80wQEF2g-n0JV4YKqLEw4Bca6LpYQ@mail.gmail.com>
 <5b03c396.1c69fb81.99fb1.a809SMTPIN_ADDED_BROKEN@mx.google.com>
Message-ID: <CAMSv6X2guDxgCctsfKoJ3Y=UMwnJWdWmGULKBcxCXqSQ-ZFdZA@mail.gmail.com>

Hi,

On 22 May 2018 at 09:15, hubo <hubo at jiedaibao.com> wrote:
> One more thing I would like to confirm: looks like in PyPy3, a "yield from
> my_generator()" expression delegates all exceptions inside, so the finalizer
> in my_generator() is always executed. Am I right?

I think so.  PyPy3 should behave just like CPython3.5 in that respect.


A bient?t,

Armin.

From me at manueljacob.de  Fri Jun  1 19:24:50 2018
From: me at manueljacob.de (Manuel Jacob)
Date: Sat, 02 Jun 2018 01:24:50 +0200
Subject: [pypy-dev] Hash compatibility between PyPy and CPython
Message-ID: <c4f8e2433e776d7dad28802b2700a391@manueljacob.de>

Hi,

Do we in general try to stay compatible with the hashes of CPython?

I'm currently debugging a failure in lib-python's test_hash on linux32 
in the py3.5 branch [1].  The test fails because currently on PyPy3.5, 
hash(int(-2**31)) == -2147483648 while hash(float(-2**31)) == -2.  On 
CPython 3.6.5, both are -2.

It seems like our float hashes are 100% compatible with CPython, but our 
int hashes are different in some cases (like the one above).  In any 
case, i think that the invariant hash(i) == hash(float(i)) should hold 
for any int i that can be represented exactly by a float.  Now the 
question is: should we change our int hash to be compatible with 
CPython?

-Manuel

[1] 
http://buildbot.pypy.org/summary/longrepr?testname=unmodified&builder=pypy-c-jit-linux-x86-32&build=4661&mod=lib-python.3.test.test_hash

From armin.rigo at gmail.com  Sat Jun  2 01:07:56 2018
From: armin.rigo at gmail.com (Armin Rigo)
Date: Sat, 2 Jun 2018 07:07:56 +0200
Subject: [pypy-dev] Hash compatibility between PyPy and CPython
In-Reply-To: <c4f8e2433e776d7dad28802b2700a391@manueljacob.de>
References: <c4f8e2433e776d7dad28802b2700a391@manueljacob.de>
Message-ID: <CAMSv6X3OPUdruYp-QO3fe_jryG-=hdCDFYo8XAAChtV5MWZKqg@mail.gmail.com>

Hi Manuel,

On 2 June 2018 at 01:24, Manuel Jacob <me at manueljacob.de> wrote:
> that can be represented exactly by a float.  Now the question is: should we
> change our int hash to be compatible with CPython?

Yes, I think so.  We already jump through hoops to make the int hash
compatible with CPython.  Apparently, we fail on 32-bit.  We should
just fix it.


Armin

From tinchester at gmail.com  Thu Jun  7 12:38:28 2018
From: tinchester at gmail.com (=?UTF-8?Q?Tin_Tvrtkovi=C4=87?=)
Date: Thu, 7 Jun 2018 18:38:28 +0200
Subject: [pypy-dev] Adding support for PEP526: variable annotations
Message-ID: <CAEJ-mUpiPTh1KjTO-bJ3FR0wW5mfgwkXbkQmiAE=mg_QifoWBQ@mail.gmail.com>

Hi,

it'd be great if we could get variable annotations in PyPy even before PyPy
3.6 comes out. There's predecent with f-strings. I'm asking because it's a
major chore to strip out variable annotations while trying out PyPy,
(mostly) everything else can be worked around with imports etc.

Thanks for your efforts on PyPy ;)

Tin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180607/bf17daa3/attachment.html>

From armin.rigo at gmail.com  Thu Jun  7 18:22:35 2018
From: armin.rigo at gmail.com (Armin Rigo)
Date: Fri, 8 Jun 2018 00:22:35 +0200
Subject: [pypy-dev] Adding support for PEP526: variable annotations
In-Reply-To: <CAEJ-mUpiPTh1KjTO-bJ3FR0wW5mfgwkXbkQmiAE=mg_QifoWBQ@mail.gmail.com>
References: <CAEJ-mUpiPTh1KjTO-bJ3FR0wW5mfgwkXbkQmiAE=mg_QifoWBQ@mail.gmail.com>
Message-ID: <CAMSv6X2ZoA_Y8r43cTQPt4oM6_NWQzeMhobrOG2gh0X+FKONDg@mail.gmail.com>

Hi Tin,

On 7 June 2018 at 18:38, Tin Tvrtkovi? <tinchester at gmail.com> wrote:
> it'd be great if we could get variable annotations in PyPy even before PyPy
> 3.6 comes out. There's predecent with f-strings. I'm asking because it's a
> major chore to strip out variable annotations while trying out PyPy,
> (mostly) everything else can be worked around with imports etc.

Look at tools that do the stripping automatically.  Maybe
https://pypi.org/project/strip-hints/ with the option
--only-assigns-and-defs ?


A bient?t,

Armin.

From tkadm30 at yandex.com  Thu Jun  7 21:29:47 2018
From: tkadm30 at yandex.com (Etienne Robillard)
Date: Thu, 7 Jun 2018 21:29:47 -0400
Subject: [pypy-dev] Django-hotsauce/ZODB 5.4.0/PyPy nightly sprint!!
Message-ID: <cb284812-3600-5277-151c-0f1093b29ddb@yandex.com>

Yo people I'm doing a nightly hacking sprint for django-hotsauce on pypy 
and got some cool bugs I would like to share:

Traceback (most recent call last):
 ? File "/usr/local/bin/schevo", line 11, in <module>
 ??? load_entry_point('libschevo', 'console_scripts', 'schevo')()
 ? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 
32, in __call__
 ??? return self.main(arg0, args)
 ? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 
74, in main
 ??? return command()(*args)
 ? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 
32, in __call__
 ??? return self.main(arg0, args)
 ? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 
74, in main
 ??? return command()(*args)
 ? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 
32, in __call__
 ??? return self.main(arg0, args)
 ? File "/home/erob/src/libschevo/lib/schevo/script/db_evolve.py", line 
86, in main
 ??? db = schevo.database.open(url)
 ? File "/home/erob/src/libschevo/lib/schevo/database.py", line 371, in open
 ??? db = Database(backend)
 ? File "/home/erob/src/libschevo/lib/schevo/database2.py", line 95, in 
__init__
 ??? self._update_extent_maps_by_name()
 ? File "/home/erob/src/libschevo/lib/schevo/database2.py", line 1633, 
in _update_extent_maps_by_name
 ??? for extent in self._extent_maps_by_id.itervalues():
 ? File "/usr/local/lib/python2.7/dist-packages/ZODB/Connection.py", 
line 791, in setstate
 ??? p, serial = self._storage.load(oid)
 ? File "/usr/local/lib/python2.7/dist-packages/ZODB/mvccadapter.py", 
line 143, in load
 ??? r = self._storage.loadBefore(oid, self._start)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/ClientStorage.py", line 520, 
in loadBefore
 ??? return self._server.load_before(oid, tid)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 783, 
in load_before
 ??? return self.__call(self.client.load_before_threadsafe, oid, tid)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 748, 
in call
 ??? return self.wait_for_result(result, self.timeout)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 756, 
in wait_for_result
 ??? return future.result(timeout)
 ? File 
"/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py", 
line 405, in result
 ??? return self.__get_result()
 ? File 
"/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py", 
line 357, in __get_result
 ??? raise type(self._exception), self._exception, self._traceback
ZEO.Exceptions.ClientDisconnected: connection lost
erob at marina:/home/www/isotopesoftware.ca/trunk$


Not sure about this first one! :)

The command I'm trying to run is:

% schevo db evolve --app blogengine2 zodb://127.0.0.1:4545 31

The ZODB 5.4.0 server then produce the following traceback:

2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
------
2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
------
2018-06-07T21:14:55 ERROR ZEO.asyncio.marshal can't decode message: 
'((ccopy_reg\n_reconstructor\n(czodbpickle\nbinary\nc__b...'
------
2018-06-07T21:14:55 ERROR ZEO.asyncio.server Can't deserialize message
Traceback (most recent call last):
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 89, 
in message_received
 ??? message_id, async, name, args = self.decode(message)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line 
114, in pickle_server_decode
 ??? return unpickler.load() # msgid, flags, name, args
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line 
164, in server_find_global
 ??? raise ImportError("import error %s: %s" % (module, msg))
ImportError: import error copy_reg:
------
2018-06-07T21:14:55 ERROR ZEO.asyncio.base data_received 4 0 True
Traceback (most recent call last):
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/base.py", line 128, 
in data_received
 ??? self.message_received(collected)
 ? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 94, 
in message_received
 ??? if message_id == -1:
UnboundLocalError: local variable 'message_id' referenced before assignment
------
2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected
------
2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
------
2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
------
2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected

Please hit me up if you know how to fix theses errors! :)

I'm using PyPy 5.9 and 5.10 for dev and Python 2.7.13 for production 
with Cython bindings!


Cheers,

Etienne




From tkadm30 at yandex.com  Fri Jun  8 04:30:47 2018
From: tkadm30 at yandex.com (Etienne Robillard)
Date: Fri, 8 Jun 2018 04:30:47 -0400
Subject: [pypy-dev] [ZODB] Django-hotsauce/ZODB 5.4.0/PyPy nightly
 sprint!!
In-Reply-To: <CALH=kcjAK_Lf0pgS4U9V=jfj7FVJthBTEiRk6Haz_hwgVEVh4g@mail.gmail.com>
References: <cb284812-3600-5277-151c-0f1093b29ddb@yandex.com>
 <CALH=kcjAK_Lf0pgS4U9V=jfj7FVJthBTEiRk6Haz_hwgVEVh4g@mail.gmail.com>
Message-ID: <3dcdf6de-a3c4-ad9c-4826-656f682593b4@yandex.com>



Le 2018-06-08 ? 02:25, Mauro Amico a ?crit?:
> seems to me really similar to 
> https://github.com/zopefoundation/ZEO/pull/96 try to upgrade to ZEO 5.1.2
>
> mauro.

Hey man!

Thanks for the heads up!

Looks like I messed up again... :)

That error was caused because my zodb database file was out of sync with 
the schema definition.

peace,

Etienne

>
> Il Ven 8 Giu 2018, 03:29 Etienne Robillard <tkadm30 at yandex.com 
> <mailto:tkadm30 at yandex.com>> ha scritto:
>
>     Yo people I'm doing a nightly hacking sprint for django-hotsauce
>     on pypy
>     and got some cool bugs I would like to share:
>
>     Traceback (most recent call last):
>     ?? File "/usr/local/bin/schevo", line 11, in <module>
>     ???? load_entry_point('libschevo', 'console_scripts', 'schevo')()
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     74, in main
>     ???? return command()(*args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     74, in main
>     ???? return command()(*args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/db_evolve.py",
>     line
>     86, in main
>     ???? db = schevo.database.open(url)
>     ?? File "/home/erob/src/libschevo/lib/schevo/database.py", line
>     371, in open
>     ???? db = Database(backend)
>     ?? File "/home/erob/src/libschevo/lib/schevo/database2.py", line
>     95, in
>     __init__
>     ???? self._update_extent_maps_by_name()
>     ?? File "/home/erob/src/libschevo/lib/schevo/database2.py", line
>     1633,
>     in _update_extent_maps_by_name
>     ???? for extent in self._extent_maps_by_id.itervalues():
>     ?? File "/usr/local/lib/python2.7/dist-packages/ZODB/Connection.py",
>     line 791, in setstate
>     ???? p, serial = self._storage.load(oid)
>     ?? File "/usr/local/lib/python2.7/dist-packages/ZODB/mvccadapter.py",
>     line 143, in load
>     ???? r = self._storage.loadBefore(oid, self._start)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/ClientStorage.py", line
>     520,
>     in loadBefore
>     ???? return self._server.load_before(oid, tid)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 783,
>     in load_before
>     ???? return self.__call(self.client.load_before_threadsafe, oid, tid)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 748,
>     in call
>     ???? return self.wait_for_result(result, self.timeout)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 756,
>     in wait_for_result
>     ???? return future.result(timeout)
>     ?? File
>     "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
>     line 405, in result
>     ???? return self.__get_result()
>     ?? File
>     "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
>     line 357, in __get_result
>     ???? raise type(self._exception), self._exception, self._traceback
>     ZEO.Exceptions.ClientDisconnected: connection lost
>     erob at marina:/home/www/isotopesoftware.ca/trunk$
>     <http://isotopesoftware.ca/trunk$>
>
>
>     Not sure about this first one! :)
>
>     The command I'm trying to run is:
>
>     % schevo db evolve --app blogengine2 zodb://127.0.0.1:4545
>     <http://127.0.0.1:4545> 31
>
>     The ZODB 5.4.0 server then produce the following traceback:
>
>     2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.marshal can't decode message:
>     '((ccopy_reg\n_reconstructor\n(czodbpickle\nbinary\nc__b...'
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.server Can't deserialize message
>     Traceback (most recent call last):
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py",
>     line 89,
>     in message_received
>     ???? message_id, async, name, args = self.decode(message)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
>     114, in pickle_server_decode
>     ???? return unpickler.load() # msgid, flags, name, args
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
>     164, in server_find_global
>     ???? raise ImportError("import error %s: %s" % (module, msg))
>     ImportError: import error copy_reg:
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.base data_received 4 0 True
>     Traceback (most recent call last):
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/base.py", line
>     128,
>     in data_received
>     ???? self.message_received(collected)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py",
>     line 94,
>     in message_received
>     ???? if message_id == -1:
>     UnboundLocalError: local variable 'message_id' referenced before
>     assignment
>     ------
>     2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545
>     <http://127.0.0.1:4545>) disconnected
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
>     ------
>     2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545
>     <http://127.0.0.1:4545>) disconnected
>
>     Please hit me up if you know how to fix theses errors! :)
>
>     I'm using PyPy 5.9 and 5.10 for dev and Python 2.7.13 for production
>     with Cython bindings!
>
>
>     Cheers,
>
>     Etienne
>
>
>
>     -- 
>     You received this message because you are subscribed to the Google
>     Groups "zodb" group.
>     To unsubscribe from this group and stop receiving emails from it,
>     send an email to zodb+unsubscribe at googlegroups.com
>     <mailto:zodb%2Bunsubscribe at googlegroups.com>.
>     For more options, visit https://groups.google.com/d/optout.
>
> -- 
> You received this message because you are subscribed to the Google 
> Groups "zodb" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to zodb+unsubscribe at googlegroups.com 
> <mailto:zodb+unsubscribe at googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.

-- 
Etienne Robillard
tkadm30 at yandex.com
https://www.isotopesoftware.ca/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/284a21f4/attachment-0001.html>

From tkadm30 at yandex.com  Fri Jun  8 04:30:58 2018
From: tkadm30 at yandex.com (Etienne Robillard)
Date: Fri, 8 Jun 2018 04:30:58 -0400
Subject: [pypy-dev] [ZODB] Django-hotsauce/ZODB 5.4.0/PyPy nightly
 sprint!!
In-Reply-To: <CALH=kcjAK_Lf0pgS4U9V=jfj7FVJthBTEiRk6Haz_hwgVEVh4g@mail.gmail.com>
References: <cb284812-3600-5277-151c-0f1093b29ddb@yandex.com>
 <CALH=kcjAK_Lf0pgS4U9V=jfj7FVJthBTEiRk6Haz_hwgVEVh4g@mail.gmail.com>
Message-ID: <fa486bce-f6ef-73d5-2c37-59615f069b9c@yandex.com>



Le 2018-06-08 ? 02:25, Mauro Amico a ?crit?:
> seems to me really similar to 
> https://github.com/zopefoundation/ZEO/pull/96 try to upgrade to ZEO 5.1.2
>
> mauro.

Hey man!

Thanks for the heads up!

Looks like I messed up again... :)

That error was caused because my zodb database file was out of sync with 
the schema definition.

peace,

Etienne

>
> Il Ven 8 Giu 2018, 03:29 Etienne Robillard <tkadm30 at yandex.com 
> <mailto:tkadm30 at yandex.com>> ha scritto:
>
>     Yo people I'm doing a nightly hacking sprint for django-hotsauce
>     on pypy
>     and got some cool bugs I would like to share:
>
>     Traceback (most recent call last):
>     ?? File "/usr/local/bin/schevo", line 11, in <module>
>     ???? load_entry_point('libschevo', 'console_scripts', 'schevo')()
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     74, in main
>     ???? return command()(*args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     74, in main
>     ???? return command()(*args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
>     32, in __call__
>     ???? return self.main(arg0, args)
>     ?? File "/home/erob/src/libschevo/lib/schevo/script/db_evolve.py",
>     line
>     86, in main
>     ???? db = schevo.database.open(url)
>     ?? File "/home/erob/src/libschevo/lib/schevo/database.py", line
>     371, in open
>     ???? db = Database(backend)
>     ?? File "/home/erob/src/libschevo/lib/schevo/database2.py", line
>     95, in
>     __init__
>     ???? self._update_extent_maps_by_name()
>     ?? File "/home/erob/src/libschevo/lib/schevo/database2.py", line
>     1633,
>     in _update_extent_maps_by_name
>     ???? for extent in self._extent_maps_by_id.itervalues():
>     ?? File "/usr/local/lib/python2.7/dist-packages/ZODB/Connection.py",
>     line 791, in setstate
>     ???? p, serial = self._storage.load(oid)
>     ?? File "/usr/local/lib/python2.7/dist-packages/ZODB/mvccadapter.py",
>     line 143, in load
>     ???? r = self._storage.loadBefore(oid, self._start)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/ClientStorage.py", line
>     520,
>     in loadBefore
>     ???? return self._server.load_before(oid, tid)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 783,
>     in load_before
>     ???? return self.__call(self.client.load_before_threadsafe, oid, tid)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 748,
>     in call
>     ???? return self.wait_for_result(result, self.timeout)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py",
>     line 756,
>     in wait_for_result
>     ???? return future.result(timeout)
>     ?? File
>     "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
>     line 405, in result
>     ???? return self.__get_result()
>     ?? File
>     "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
>     line 357, in __get_result
>     ???? raise type(self._exception), self._exception, self._traceback
>     ZEO.Exceptions.ClientDisconnected: connection lost
>     erob at marina:/home/www/isotopesoftware.ca/trunk$
>     <http://isotopesoftware.ca/trunk$>
>
>
>     Not sure about this first one! :)
>
>     The command I'm trying to run is:
>
>     % schevo db evolve --app blogengine2 zodb://127.0.0.1:4545
>     <http://127.0.0.1:4545> 31
>
>     The ZODB 5.4.0 server then produce the following traceback:
>
>     2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.marshal can't decode message:
>     '((ccopy_reg\n_reconstructor\n(czodbpickle\nbinary\nc__b...'
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.server Can't deserialize message
>     Traceback (most recent call last):
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py",
>     line 89,
>     in message_received
>     ???? message_id, async, name, args = self.decode(message)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
>     114, in pickle_server_decode
>     ???? return unpickler.load() # msgid, flags, name, args
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
>     164, in server_find_global
>     ???? raise ImportError("import error %s: %s" % (module, msg))
>     ImportError: import error copy_reg:
>     ------
>     2018-06-07T21:14:55 ERROR ZEO.asyncio.base data_received 4 0 True
>     Traceback (most recent call last):
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/base.py", line
>     128,
>     in data_received
>     ???? self.message_received(collected)
>     ?? File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py",
>     line 94,
>     in message_received
>     ???? if message_id == -1:
>     UnboundLocalError: local variable 'message_id' referenced before
>     assignment
>     ------
>     2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545
>     <http://127.0.0.1:4545>) disconnected
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
>     ------
>     2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
>     ------
>     2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545
>     <http://127.0.0.1:4545>) disconnected
>
>     Please hit me up if you know how to fix theses errors! :)
>
>     I'm using PyPy 5.9 and 5.10 for dev and Python 2.7.13 for production
>     with Cython bindings!
>
>
>     Cheers,
>
>     Etienne
>
>
>
>     -- 
>     You received this message because you are subscribed to the Google
>     Groups "zodb" group.
>     To unsubscribe from this group and stop receiving emails from it,
>     send an email to zodb+unsubscribe at googlegroups.com
>     <mailto:zodb%2Bunsubscribe at googlegroups.com>.
>     For more options, visit https://groups.google.com/d/optout.
>
> -- 
> You received this message because you are subscribed to the Google 
> Groups "zodb" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to zodb+unsubscribe at googlegroups.com 
> <mailto:zodb+unsubscribe at googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.

-- 
Etienne Robillard
tkadm30 at yandex.com
https://www.isotopesoftware.ca/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/9a8cac20/attachment.html>

From tinchester at gmail.com  Fri Jun  8 10:18:16 2018
From: tinchester at gmail.com (=?UTF-8?Q?Tin_Tvrtkovi=C4=87?=)
Date: Fri, 8 Jun 2018 16:18:16 +0200
Subject: [pypy-dev] Adding support for PEP526: variable annotations
In-Reply-To: <CAMSv6X2ZoA_Y8r43cTQPt4oM6_NWQzeMhobrOG2gh0X+FKONDg@mail.gmail.com>
References: <CAEJ-mUpiPTh1KjTO-bJ3FR0wW5mfgwkXbkQmiAE=mg_QifoWBQ@mail.gmail.com>
 <CAMSv6X2ZoA_Y8r43cTQPt4oM6_NWQzeMhobrOG2gh0X+FKONDg@mail.gmail.com>
Message-ID: <CAEJ-mUoioRb7OMEA1SicBVuPg5N9aQH=gR+CHiLZNSbqJ79bDw@mail.gmail.com>

Hi Armin,

thanks for the tip. I actually need the annotations in runtime to do
serialization / deserialization (using two my libraries, cattrs and another
one for which I haven't written the docs yet). I use annotated attrs
classes. Usually I just move the type annotations from the annotation
syntax to "attr.ib(type=...)" using sed so it's not that big of a deal, but
it's still a chore.

Cheers :)

On Fri, Jun 8, 2018 at 12:23 AM Armin Rigo <armin.rigo at gmail.com> wrote:

> Hi Tin,
>
> On 7 June 2018 at 18:38, Tin Tvrtkovi? <tinchester at gmail.com> wrote:
> > it'd be great if we could get variable annotations in PyPy even before
> PyPy
> > 3.6 comes out. There's predecent with f-strings. I'm asking because it's
> a
> > major chore to strip out variable annotations while trying out PyPy,
> > (mostly) everything else can be worked around with imports etc.
>
> Look at tools that do the stripping automatically.  Maybe
> https://pypi.org/project/strip-hints/ with the option
> --only-assigns-and-defs ?
>
>
> A bient?t,
>
> Armin.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/bbd776fd/attachment-0001.html>

From armin.rigo at gmail.com  Fri Jun  8 13:02:18 2018
From: armin.rigo at gmail.com (Armin Rigo)
Date: Fri, 8 Jun 2018 19:02:18 +0200
Subject: [pypy-dev] https pypy.org has got an invalid certificate now
Message-ID: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>

Hi,

Who knows how to fix this?  https://pypy.org/ complains that it has
got an invalid certificate.


Armin

From alex.gaynor at gmail.com  Fri Jun  8 13:07:51 2018
From: alex.gaynor at gmail.com (Alex Gaynor)
Date: Fri, 8 Jun 2018 13:07:51 -0400
Subject: [pypy-dev] https pypy.org has got an invalid certificate now
In-Reply-To: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
Message-ID: <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>

Adding the PSF infra group.

Alex

On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:

> Hi,
>
> Who knows how to fix this?  https://pypy.org/ complains that it has
> got an invalid certificate.
>
>
> Armin
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/17cbf42d/attachment.html>

From matt at vazor.com  Fri Jun  8 16:28:34 2018
From: matt at vazor.com (Matt Billenstein)
Date: Fri, 8 Jun 2018 20:28:34 +0000
Subject: [pypy-dev] https pypy.org has got an invalid certificate now
In-Reply-To: <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
 <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
Message-ID: <01010163e1162291-cc0be047-070c-49c9-98b8-e56c6d6b5903-000000@us-west-2.amazonses.com>

A very simple tool i built a couple years ago - it?ll send you an email if the cert on a given domain is less than 10 days from expiring:

https://ismycertexpired.com/check?domain=Pypy.org

M

--
Matt Billenstein
matt at vazor.com

> On Jun 8, 2018, at 1:07 PM, Alex Gaynor <alex.gaynor at gmail.com> wrote:
> 
> Adding the PSF infra group.
> 
> Alex
> 
>> On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:
>> Hi,
>> 
>> Who knows how to fix this?  https://pypy.org/ complains that it has
>> got an invalid certificate.
>> 
>> 
>> Armin
>> _______________________________________________
>> pypy-dev mailing list
>> pypy-dev at python.org
>> https://mail.python.org/mailman/listinfo/pypy-dev
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/62d5c474/attachment.html>

From matti.picus at gmail.com  Fri Jun  8 17:57:50 2018
From: matti.picus at gmail.com (Matti Picus)
Date: Fri, 8 Jun 2018 14:57:50 -0700
Subject: [pypy-dev] https pypy.org has got an invalid certificate now
In-Reply-To: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
Message-ID: <2e18e81e-7f2d-e081-44b9-16cedc335972@gmail.com>

An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/375320eb/attachment.html>

From mauro.amico at gmail.com  Fri Jun  8 02:25:56 2018
From: mauro.amico at gmail.com (Mauro Amico)
Date: Fri, 8 Jun 2018 08:25:56 +0200
Subject: [pypy-dev] [ZODB] Django-hotsauce/ZODB 5.4.0/PyPy nightly
 sprint!!
In-Reply-To: <cb284812-3600-5277-151c-0f1093b29ddb@yandex.com>
References: <cb284812-3600-5277-151c-0f1093b29ddb@yandex.com>
Message-ID: <CALH=kcjAK_Lf0pgS4U9V=jfj7FVJthBTEiRk6Haz_hwgVEVh4g@mail.gmail.com>

seems to me really similar to https://github.com/zopefoundation/ZEO/pull/96
try to upgrade to ZEO 5.1.2

mauro.

Il Ven 8 Giu 2018, 03:29 Etienne Robillard <tkadm30 at yandex.com> ha scritto:

> Yo people I'm doing a nightly hacking sprint for django-hotsauce on pypy
> and got some cool bugs I would like to share:
>
> Traceback (most recent call last):
>    File "/usr/local/bin/schevo", line 11, in <module>
>      load_entry_point('libschevo', 'console_scripts', 'schevo')()
>    File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
> 32, in __call__
>      return self.main(arg0, args)
>    File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
> 74, in main
>      return command()(*args)
>    File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
> 32, in __call__
>      return self.main(arg0, args)
>    File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
> 74, in main
>      return command()(*args)
>    File "/home/erob/src/libschevo/lib/schevo/script/command.py", line
> 32, in __call__
>      return self.main(arg0, args)
>    File "/home/erob/src/libschevo/lib/schevo/script/db_evolve.py", line
> 86, in main
>      db = schevo.database.open(url)
>    File "/home/erob/src/libschevo/lib/schevo/database.py", line 371, in
> open
>      db = Database(backend)
>    File "/home/erob/src/libschevo/lib/schevo/database2.py", line 95, in
> __init__
>      self._update_extent_maps_by_name()
>    File "/home/erob/src/libschevo/lib/schevo/database2.py", line 1633,
> in _update_extent_maps_by_name
>      for extent in self._extent_maps_by_id.itervalues():
>    File "/usr/local/lib/python2.7/dist-packages/ZODB/Connection.py",
> line 791, in setstate
>      p, serial = self._storage.load(oid)
>    File "/usr/local/lib/python2.7/dist-packages/ZODB/mvccadapter.py",
> line 143, in load
>      r = self._storage.loadBefore(oid, self._start)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/ClientStorage.py", line 520,
> in loadBefore
>      return self._server.load_before(oid, tid)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 783,
> in load_before
>      return self.__call(self.client.load_before_threadsafe, oid, tid)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 748,
> in call
>      return self.wait_for_result(result, self.timeout)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 756,
> in wait_for_result
>      return future.result(timeout)
>    File
> "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
> line 405, in result
>      return self.__get_result()
>    File
> "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py",
>
> line 357, in __get_result
>      raise type(self._exception), self._exception, self._traceback
> ZEO.Exceptions.ClientDisconnected: connection lost
> erob at marina:/home/www/isotopesoftware.ca/trunk$
>
>
> Not sure about this first one! :)
>
> The command I'm trying to run is:
>
> % schevo db evolve --app blogengine2 zodb://127.0.0.1:4545 31
>
> The ZODB 5.4.0 server then produce the following traceback:
>
> 2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
> ------
> 2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
> ------
> 2018-06-07T21:14:55 ERROR ZEO.asyncio.marshal can't decode message:
> '((ccopy_reg\n_reconstructor\n(czodbpickle\nbinary\nc__b...'
> ------
> 2018-06-07T21:14:55 ERROR ZEO.asyncio.server Can't deserialize message
> Traceback (most recent call last):
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 89,
> in message_received
>      message_id, async, name, args = self.decode(message)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
> 114, in pickle_server_decode
>      return unpickler.load() # msgid, flags, name, args
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line
> 164, in server_find_global
>      raise ImportError("import error %s: %s" % (module, msg))
> ImportError: import error copy_reg:
> ------
> 2018-06-07T21:14:55 ERROR ZEO.asyncio.base data_received 4 0 True
> Traceback (most recent call last):
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/base.py", line 128,
> in data_received
>      self.message_received(collected)
>    File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 94,
> in message_received
>      if message_id == -1:
> UnboundLocalError: local variable 'message_id' referenced before assignment
> ------
> 2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected
> ------
> 2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol
> ------
> 2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5'
> ------
> 2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected
>
> Please hit me up if you know how to fix theses errors! :)
>
> I'm using PyPy 5.9 and 5.10 for dev and Python 2.7.13 for production
> with Cython bindings!
>
>
> Cheers,
>
> Etienne
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "zodb" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to zodb+unsubscribe at googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/ae7a0112/attachment-0001.html>

From mal at egenix.com  Fri Jun  8 13:44:56 2018
From: mal at egenix.com (M.-A. Lemburg)
Date: Fri, 8 Jun 2018 19:44:56 +0200
Subject: [pypy-dev] [Infrastructure] https pypy.org has got an invalid
 certificate now
In-Reply-To: <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
 <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
Message-ID: <71078be5-4115-981f-281e-3e82e0dd2b0b@egenix.com>

It looks like pypy.org is run on PSF infrastructure:

virt-y8pzvf.psf.osuosl.org.

We'd have to get a new certificate for it.

I am a bit surprised that we have a wildcard certificate on
one of the OSU VM. Shouldn't this only be installed
on front.python.org ?

Thanks.


On 08.06.2018 19:07, Alex Gaynor wrote:
> Adding the PSF infra group.
> 
> Alex
> 
> On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:
> 
>> Hi,
>>
>> Who knows how to fix this?  https://pypy.org/ complains that it has
>> got an invalid certificate.
>>
>>
>> Armin
>> _______________________________________________
>> pypy-dev mailing list
>> pypy-dev at python.org
>> https://mail.python.org/mailman/listinfo/pypy-dev
>>
> 
> 
> 
> ________________________________________________
> Infrastructure mailing list
> Infrastructure at python.org
> https://mail.python.org/mailman/listinfo/infrastructure
> Unsubscribe: https://mail.python.org/mailman/options/infrastructure/mal%40egenix.com
> 

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Jun 08 2018)
>>> Python Projects, Coaching and Consulting ...  http://www.egenix.com/
>>> Python Database Interfaces ...           http://products.egenix.com/
>>> Plone/Zope Database Interfaces ...           http://zope.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               http://www.egenix.com/company/contact/
                      http://www.malemburg.com/


From ewdurbin at gmail.com  Fri Jun  8 14:25:13 2018
From: ewdurbin at gmail.com (Ernest W. Durbin III)
Date: Fri, 8 Jun 2018 14:25:13 -0400
Subject: [pypy-dev] [Infrastructure] https pypy.org has got an invalid
 certificate now
In-Reply-To: <71078be5-4115-981f-281e-3e82e0dd2b0b@egenix.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
 <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
 <71078be5-4115-981f-281e-3e82e0dd2b0b@egenix.com>
Message-ID: <CAD1Aak2ft6R8r6XzZSanRY8KkiR7kaA381ar30_B0mw6TFxBng@mail.gmail.com>

On June 8, 2018 at 1:45:58 PM, M.-A. Lemburg (mal at egenix.com) wrote:

It looks like pypy.org is run on PSF infrastructure:

virt-y8pzvf.psf.osuosl.org.


That?s correct.

We'd have to get a new certificate for it.

I am a bit surprised that we have a wildcard certificate on
one of the OSU VM. Shouldn't this only be installed
on front.python.org ?


The DNS for pypy.org is set to the load balancer at OSUOSL, the wildcard
cert is hosted there.

This appears to be a misconfiguration in the load balancer, though I?m not
sure why. Investigating now.

Thanks.


On 08.06.2018 19:07, Alex Gaynor wrote:
> Adding the PSF infra group.
>
> Alex
>
> On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:
>
>> Hi,
>>
>> Who knows how to fix this? https://pypy.org/ complains that it has
>> got an invalid certificate.
>>
>>
>> Armin
>> _______________________________________________
>> pypy-dev mailing list
>> pypy-dev at python.org
>> https://mail.python.org/mailman/listinfo/pypy-dev
>>
>
>
>
> ________________________________________________
> Infrastructure mailing list
> Infrastructure at python.org
> https://mail.python.org/mailman/listinfo/infrastructure
> Unsubscribe:
https://mail.python.org/mailman/options/infrastructure/mal%40egenix.com
>

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Jun 08 2018)
>>> Python Projects, Coaching and Consulting ... http://www.egenix.com/
>>> Python Database Interfaces ... http://products.egenix.com/
>>> Plone/Zope Database Interfaces ... http://zope.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48
D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
Registered at Amtsgericht Duesseldorf: HRB 46611
http://www.egenix.com/company/contact/
http://www.malemburg.com/

________________________________________________
Infrastructure mailing list
Infrastructure at python.org
https://mail.python.org/mailman/listinfo/infrastructure
Unsubscribe:
https://mail.python.org/mailman/options/infrastructure/ewdurbin%40gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/09da038f/attachment-0001.html>

From ewdurbin at gmail.com  Fri Jun  8 15:00:03 2018
From: ewdurbin at gmail.com (Ernest W. Durbin III)
Date: Fri, 8 Jun 2018 15:00:03 -0400
Subject: [pypy-dev] [Infrastructure] https pypy.org has got an invalid
 certificate now
In-Reply-To: <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
 <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
Message-ID: <CAD1Aak3OEQWrhW1huAp61_fkyCgimerhkpa0Lx7bh3jmSyuwqA@mail.gmail.com>

This is resolved.

The certificate provided for pypy.org was ?forgotten? by the chef
configuration on the load balancers in our OSUOSL infrastructure. It
appears that some tidy up work I performed in removing old hosts
inadvertently disrupted the delicate balance.

I?ve rerun chef a couple times to ensure that the changes are stable and it
seems TLS is back in action for pypy.org and www.pypy.org.

-Ernest


On June 8, 2018 at 1:08:11 PM, Alex Gaynor (alex.gaynor at gmail.com) wrote:

Adding the PSF infra group.

Alex

On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:

> Hi,
>
> Who knows how to fix this?  https://pypy.org/ complains that it has
> got an invalid certificate.
>
>
> Armin
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
>
________________________________________________
Infrastructure mailing list
Infrastructure at python.org
https://mail.python.org/mailman/listinfo/infrastructure
Unsubscribe:
https://mail.python.org/mailman/options/infrastructure/ewdurbin%40gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180608/b90f91db/attachment-0001.html>

From mal at egenix.com  Fri Jun  8 16:13:15 2018
From: mal at egenix.com (M.-A. Lemburg)
Date: Fri, 8 Jun 2018 22:13:15 +0200
Subject: [pypy-dev] [Infrastructure] https pypy.org has got an invalid
 certificate now
In-Reply-To: <CAD1Aak3OEQWrhW1huAp61_fkyCgimerhkpa0Lx7bh3jmSyuwqA@mail.gmail.com>
References: <CAMSv6X2OmBLOLX5058YSF2JBh13B=BkMH=pf7nKU-bsN6Yvp4A@mail.gmail.com>
 <CAFRnB2Ut9ZRXk+0nRf2Bj-5q0FTHMBHcoyNpPUYH0_gop-uJ=Q@mail.gmail.com>
 <CAD1Aak3OEQWrhW1huAp61_fkyCgimerhkpa0Lx7bh3jmSyuwqA@mail.gmail.com>
Message-ID: <717796fc-a5d6-ae22-1feb-62439f6258cb@egenix.com>

Thanks, Ernest.

On 08.06.2018 21:00, Ernest W. Durbin III wrote:
> This is resolved.
> 
> The certificate provided for pypy.org was ?forgotten? by the chef
> configuration on the load balancers in our OSUOSL infrastructure. It
> appears that some tidy up work I performed in removing old hosts
> inadvertently disrupted the delicate balance.
> 
> I?ve rerun chef a couple times to ensure that the changes are stable and it
> seems TLS is back in action for pypy.org and www.pypy.org.
> 
> -Ernest
> 
> 
> On June 8, 2018 at 1:08:11 PM, Alex Gaynor (alex.gaynor at gmail.com) wrote:
> 
> Adding the PSF infra group.
> 
> Alex
> 
> On Fri, Jun 8, 2018, 1:03 PM Armin Rigo <armin.rigo at gmail.com> wrote:
> 
>> Hi,
>>
>> Who knows how to fix this?  https://pypy.org/ complains that it has
>> got an invalid certificate.
>>
>>
>> Armin
>> _______________________________________________
>> pypy-dev mailing list
>> pypy-dev at python.org
>> https://mail.python.org/mailman/listinfo/pypy-dev
>>
> ________________________________________________
> Infrastructure mailing list
> Infrastructure at python.org
> https://mail.python.org/mailman/listinfo/infrastructure
> Unsubscribe:
> https://mail.python.org/mailman/options/infrastructure/ewdurbin%40gmail.com
> 
> 
> 
> ________________________________________________
> Infrastructure mailing list
> Infrastructure at python.org
> https://mail.python.org/mailman/listinfo/infrastructure
> Unsubscribe: https://mail.python.org/mailman/options/infrastructure/mal%40egenix.com
> 

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Jun 08 2018)
>>> Python Projects, Coaching and Consulting ...  http://www.egenix.com/
>>> Python Database Interfaces ...           http://products.egenix.com/
>>> Plone/Zope Database Interfaces ...           http://zope.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               http://www.egenix.com/company/contact/
                      http://www.malemburg.com/


From kwfchan2016 at gmail.com  Mon Jun 11 23:41:36 2018
From: kwfchan2016 at gmail.com (Frankie Chan)
Date: Tue, 12 Jun 2018 11:41:36 +0800
Subject: [pypy-dev] Can you please help?
Message-ID: <CAJq38EO1FnCOLU8TsHZn0BTTZ-Xgv4D9HDYJC4DmRbdO1RRoPg@mail.gmail.com>

Dear sir/ madam,

This is Frankie from Hong Kong.

I am interested in Pypy for its high-speed processing.

I am now using Python 3.6.

I would like to install Pypy  to my 64-bit Windows 10.

First, I downloaded the zip file from

   - Windows binary (32bit)
   <https://bitbucket.org/pypy/pypy/downloads/pypy3-v6.0.0-win32.zip> *BETA*


Second, I downloaded and installed Build Tools for Visual Studio 2017 and
Team Explorer.

Then, I ran:

"C:\Program Files (x86)\Microsoft Visual
Studio\2017\Community\VC\Auxiliary\Build\vcvars64.bat"

editbin /largeaddressaware "C:\Program
Files\Python36\pypy3-v6.0.0-win32\pypy3.exe"

So far so good.

Then, I typed:

"C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe"
numpy

"C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe"
pandas

In both cases, an error appeared:

SystemError: Cannot compile 'Python.h'. Perhaps you need to install
pypy-dev|pypy-devel.

Can you please help?

Thank you very much.

Regards,
Frankie
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180612/73cfee63/attachment.html>

From rymg19 at gmail.com  Tue Jun 12 09:51:17 2018
From: rymg19 at gmail.com (Ryan Gonzalez)
Date: Tue, 12 Jun 2018 08:51:17 -0500
Subject: [pypy-dev] Can you please help?
In-Reply-To: <CAJq38EO1FnCOLU8TsHZn0BTTZ-Xgv4D9HDYJC4DmRbdO1RRoPg@mail.gmail.com>
References: <CAJq38EO1FnCOLU8TsHZn0BTTZ-Xgv4D9HDYJC4DmRbdO1RRoPg@mail.gmail.com>
Message-ID: <163f443d808.27a3.db5b03704c129196a4e9415e55413ce6@gmail.com>

First off: don't bother with easy_install. Use pip instead, like the 
official directions use (http://pypy.org/download.html#installing-numpy):

"C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\pypy" -m ensurepip
"C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\pip" install numpy


On June 12, 2018 1:23:04 AM Frankie Chan <kwfchan2016 at gmail.com> wrote:

> Dear sir/ madam,
>
> This is Frankie from Hong Kong.
>
> I am interested in Pypy for its high-speed processing.
>
> I am now using Python 3.6.
>
> I would like to install Pypy  to my 64-bit Windows 10.
>
> First, I downloaded the zip file from
>
>    - Windows binary (32bit)
>    <https://bitbucket.org/pypy/pypy/downloads/pypy3-v6.0.0-win32.zip> *BETA*
>
>
> Second, I downloaded and installed Build Tools for Visual Studio 2017 and
> Team Explorer.
>
> Then, I ran:
>
> "C:\Program Files (x86)\Microsoft Visual
> Studio\2017\Community\VC\Auxiliary\Build\vcvars64.bat"
>
> editbin /largeaddressaware "C:\Program
> Files\Python36\pypy3-v6.0.0-win32\pypy3.exe"
>
> So far so good.
>
> Then, I typed:
>
> "C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe"
> numpy
>
> "C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe"
> pandas
>
> In both cases, an error appeared:
>
> SystemError: Cannot compile 'Python.h'. Perhaps you need to install
> pypy-dev|pypy-devel.
>
> Can you please help?
>
> Thank you very much.
>
> Regards,
> Frankie
>
>
>
> ----------
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> https://mail.python.org/mailman/listinfo/pypy-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180612/6857e7fe/attachment.html>

From william.leslie.ttg at gmail.com  Fri Jun 15 02:05:16 2018
From: william.leslie.ttg at gmail.com (William ML Leslie)
Date: Fri, 15 Jun 2018 16:05:16 +1000
Subject: [pypy-dev] =?utf-8?q?=5BCFP=5D_Workshop_on_Virtual_Machines_and_?=
	=?utf-8?q?Language_Implementations_=28VMIL=E2=80=9918=29?=
Message-ID: <CAHgd1hFk+YWK_1=7UZvefmATJzvncVZFesCJaaqr4Lh_WcFJAQ@mail.gmail.com>

Stefan Marr had sent this on some JVM lists; but it's super relevant
for those of us doing research on or with pypy, too.


========================================================================
                           Call for Papers

   Workshop on Virtual Machines and Language Implementations (VMIL?18)

                     Co-located with SPLASH 2018
                    November 4, 2018, Boston, USA

               https://2018.splashcon.org/track/vmil-2018
                     Follow us on twitter @vmil18
========================================================================

The concept of virtual machines is pervasive in the design and
implementation of programming systems. Virtual machines and the
languages they implement are crucial in the specification,
implementation and/or user-facing deployment of most programming
technologies.

The VMIL workshop is a forum for researchers and cutting-edge
practitioners in language virtual machines, the intermediate
languages they use, and related issues.

The workshop is intended to be welcoming to a wide range of
topics and perspectives, covering all areas relevant to the
workshop?s theme. Aspects of interest include, but are not limited to:

- design issues in VMs and IRs (e.g. IR design,
  VM modularity, polyglotism)

- compilation (static and dynamic compilation strategies,
  optimizations, data representations)

- memory management

- concurrency (both internal and user-facing)

- tool support and related infrastructure (profiling,
  debugging, liveness, persistence)

- the experience of VM development (use of high-level languages,
  bootstrapping and self-hosting, reusability, portability,
  developer tooling, etc)

- empirical studies on related topics, such as usage patterns,
  the usability of languages or tools, experimental methodology,
  or benchmark design

#### Submission Guidelines

We invite high-quality papers in the following two categories:

Research and experience papers:

These submissions should describe work that advances the
current state of the art in the above or related areas.
The suggested length of these submissions
is 6-10 pages (maximum 10pp).

Work-in-progress or position papers:

These papers should document ongoing efforts in an area of
interest which have not yet yielded final results, and/or
should present and defend the authors' position on a topic
related to the broad area of the workshop.
The suggested length of these submissions
is 4-6 pages (maximum 6pp).

For the first submission deadline, all paper types are considered
for publication in the ACM Digital Library, except if the authors
prefer not to be included.
Publication of work-in-progress and position papers at VMIL is not
intended to preclude later publication elsewhere.

Submissions will be judged on novelty, clarity, timeliness,
relevance, and potential to stimulate discussion during the workshop.

For the second deadline, we will consider only work-in-progress
and position papers. These will not be published in the ACM DL,
and will only appear on the web site.

The address of the submission site is: https://vmil18.hotcrp.com/

#### Important Dates

All deadlines are Anywhere on Earth (AoE), i.e. GMT/UTC?12:00 hour

Abstract Submission         07 August 2018
Paper Submission            17 August 2018
Paper Notification          14 September 2018
ACM Camera Ready Deadline   28 September 2018

?Late submission? deadline      07 September 2018  (WIP/position papers only)
?Late submission? notification  30 September 2018

Workshop Date               04 November 2018

#### Format Instructions

Please use the SIGPLAN acmart style for all papers:
http://www.sigplan.org/Resources/Author/.
The provided double-column template is available for Latex and Word.

#### Program Committee

Stephen Kell, University of Cambridge
Stefan Marr, University of Kent
Leif Andersen, Northeastern University
Steve Blackburn, Australian National University
Stephen Dolan, University of Cambridge
Apala Guha, Simon Fraser University
Christine H. Flood, Red Hat
Roberto Ierusalimschy, PUC-Rio
Tomas Kalibera, Czech Technical University
Christos Kotselidis, The University of Manchester
Doug Lea, State University of New York (SUNY) Oswego
Sanhong Li, Alibaba Inc.
Mark Marron, Microsoft Research
Erez Petrank, Technion
Julien Ponge, INSA Lyon, CITI Laboratory / Red Hat
Richard Roberts, Victoria University of Wellington
Jeremy Singer, University of Glasgow
Sam Tobin-Hochstadt, Indiana University

--
Stefan Marr
School of Computing, University of Kent
http://stefan-marr.de/research/


_______________________________________________
mlvm-dev mailing list
mlvm-dev at openjdk.java.net
http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev


-- 
William Leslie

Notice:
Likely much of this email is, by the nature of copyright, covered
under copyright law.  You absolutely MAY reproduce any part of it in
accordance with the copyright law of the nation you are reading this
in.  Any attempt to DENY YOU THOSE RIGHTS would be illegal without
prior contractual agreement.

From cfbolz at gmx.de  Sun Jun 17 03:48:28 2018
From: cfbolz at gmx.de (Carl Friedrich Bolz-Tereick)
Date: Sun, 17 Jun 2018 09:48:28 +0200
Subject: [pypy-dev] state of pypy 3.6 support
Message-ID: <776302ba-1155-dea2-72c4-8299bcd6f2dc@gmx.de>

Hi all,

Matti asked in an issue what the state of PyPy 3.6 support is, and
whether we're close to an alpha:

https://bitbucket.org/pypy/pypy/issues/2849/syntax-bug-for-keyword-only-arguments-in

Since that's a strange place to have this discussion, I thought I'd move
it here.

Armin replied:

"what I fear is that we didn't start seriously on the infinite list of
small new things in 3.6. If that's true, then not close at all. It makes
me wonder if we shouldn't do a "3.(5+1/2)" where we take the few major
new things from 3.6 (which are already implemented in the 3.6 branch as
far as I can tell) and release that. I guess they're all syntax tricks
so they could all be backported without trouble."

I am not quite so pessimistic. I agree that we implemented most of the 
big visible features and also I agree that there are quite a few details 
left. However, I think if a few people pushed for a couple for days, we 
could end up in a pretty decent state. I tried to classify the remaining 
problems here:

https://bitbucket.org/pypy/pypy/wiki/Status%20of%20PyPy3%20support%20for%203.6

I will try to slowly chip away at some of these, but given my still
limited time to work right now I'd need some help. Maybe we should have
a dedicated "finish 3.6 virtual sprint" or something?

What do others think?

Cheers,

Carl Friedrich

From matti.picus at gmail.com  Sun Jun 17 20:34:31 2018
From: matti.picus at gmail.com (Matti Picus)
Date: Sun, 17 Jun 2018 17:34:31 -0700
Subject: [pypy-dev] state of pypy 3.6 support
In-Reply-To: <776302ba-1155-dea2-72c4-8299bcd6f2dc@gmx.de>
References: <776302ba-1155-dea2-72c4-8299bcd6f2dc@gmx.de>
Message-ID: <ebbc5543-7bba-0cdb-c97b-de336631f352@gmail.com>

On 17/06/18 00:48, Carl Friedrich Bolz-Tereick wrote:
> Maybe we should have
> a dedicated "finish 3.6 virtual sprint" or something?
Thanks for shepherding this forward. A virtual sprint sounds like a good 
idea to get some momentum going. Would August be a good time or are 
people on holiday?

Another thing to thnk about is that we target 3.6.1 right now, I don't 
know if there is a strong reason to already target a more advanced 3.6 
for an alpha release.

Matti

From tkadm30 at yandex.com  Mon Jun 18 08:18:13 2018
From: tkadm30 at yandex.com (Etienne Robillard)
Date: Mon, 18 Jun 2018 08:18:13 -0400
Subject: [pypy-dev] A quick question for you!
Message-ID: <6060aa7a-7b2a-94cb-228e-d40c974a597e@yandex.com>

Hi,

Quick question: Does anyone of you know what is the effect of enabling 
gc.enable() in sitecustomize.py when using PyPy? Can it reduce latency 
for long-lived WSGI applications?

Thanks,

Etienne

-- 

Etienne Robillard
tkadm30 at yandex.com
https://www.isotopesoftware.ca/


From william.leslie.ttg at gmail.com  Mon Jun 18 22:47:19 2018
From: william.leslie.ttg at gmail.com (William ML Leslie)
Date: Tue, 19 Jun 2018 12:47:19 +1000
Subject: [pypy-dev] A quick question for you!
In-Reply-To: <6060aa7a-7b2a-94cb-228e-d40c974a597e@yandex.com>
References: <6060aa7a-7b2a-94cb-228e-d40c974a597e@yandex.com>
Message-ID: <CAHgd1hGHGMrQ1k6Dcu86Aft_taZPRpzWB5=Dn-sVOztg_Hr30A@mail.gmail.com>

On 18 June 2018 at 22:18, Etienne Robillard <tkadm30 at yandex.com> wrote:
> Hi,
>
> Quick question: Does anyone of you know what is the effect of enabling
> gc.enable() in sitecustomize.py when using PyPy? Can it reduce latency for
> long-lived WSGI applications?
>

gc is enabled by default.  you only need to use gc.enable() if you
have earlier run gc.disable().

-- 
William Leslie

Notice:
Likely much of this email is, by the nature of copyright, covered
under copyright law.  You absolutely MAY reproduce any part of it in
accordance with the copyright law of the nation you are reading this
in.  Any attempt to DENY YOU THOSE RIGHTS would be illegal without
prior contractual agreement.

From tkadm30 at yandex.com  Tue Jun 19 04:06:33 2018
From: tkadm30 at yandex.com (Etienne Robillard)
Date: Tue, 19 Jun 2018 04:06:33 -0400
Subject: [pypy-dev] A quick question for you!
In-Reply-To: <CAHgd1hGHGMrQ1k6Dcu86Aft_taZPRpzWB5=Dn-sVOztg_Hr30A@mail.gmail.com>
References: <6060aa7a-7b2a-94cb-228e-d40c974a597e@yandex.com>
 <CAHgd1hGHGMrQ1k6Dcu86Aft_taZPRpzWB5=Dn-sVOztg_Hr30A@mail.gmail.com>
Message-ID: <6dffebe7-cd18-8b81-dac3-32a51466deef@yandex.com>



Le 2018-06-18 ? 22:47, William ML Leslie a ?crit?:
> On 18 June 2018 at 22:18, Etienne Robillard <tkadm30 at yandex.com> wrote:
>> Hi,
>>
>> Quick question: Does anyone of you know what is the effect of enabling
>> gc.enable() in sitecustomize.py when using PyPy? Can it reduce latency for
>> long-lived WSGI applications?
>>
> gc is enabled by default.  you only need to use gc.enable() if you
> have earlier run gc.disable().

Good to know man! I didn't knew that.

Thanks for sharing.

Etienne

-- 
Etienne Robillard
tkadm30 at yandex.com
https://www.isotopesoftware.ca/


From hubo at jiedaibao.com  Thu Jun 28 01:06:31 2018
From: hubo at jiedaibao.com (hubo)
Date: Thu, 28 Jun 2018 13:06:31 +0800
Subject: [pypy-dev] Memory leaking with iterator.close() in PyPy3
Message-ID: <5B346CD5.9050006@jiedaibao.com>+2CB7EA09D973C92F

In PyPy3, when an iterator is closed with "close()" method, the iterator leaks and cannot be collected.

Execute the following script in PyPy3, the memory usage is increasing very fast, and gc.collect() cannot collect the memory


def test():
    yield 1

while True:
    t = test()
    t.close()


The tested version:

Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:10:04)
[PyPy 6.0.0 with GCC 6.2.0 20160901]

This is not reproduced in CPython 3.5 and PyPy2.

2018-06-28


hubo 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180628/46f82b2d/attachment.html>

From hubo at jiedaibao.com  Thu Jun 28 01:51:58 2018
From: hubo at jiedaibao.com (hubo)
Date: Thu, 28 Jun 2018 13:51:58 +0800
Subject: [pypy-dev] Memory leaking with iterator.close() in PyPy3
In-Reply-To: <5B346CD5.9050006@jiedaibao.com>
References: <5B346CD5.9050006@jiedaibao.com>
Message-ID: <5B34777D.7040707@jiedaibao.com>+74DB179B1EFD5EC0

This problem is caused by caching GeneratorExit exception:

https://bitbucket.org/pypy/pypy/src/8b43b50fbf61f46701d398bf514cf540201ffd03/pypy/interpreter/generator.py?at=py3.5&fileviewer=file-view-default#generator.py-454:457

In Python 3, an exception saves its traceback in __traceback__ attribute. When an exception object with __traceback__ is raised again, current frame is appended to the __traceback__. When the GeneratorExit is raised inside a iterator, the __traceback__ attribute of this object saves the frame, which prevents the iterator from been collected by GC.

Since __traceback__ attribute is mutable, it is generally a dangerous idea to reuse an exception object in Python 3, the problem includes: creating memory leaks with frames, wrong traceback, etc. I think remove the caching will solve the problem.

It's quite easy to be validated with the following script:

?def test():
    try:
        yield 1
    except BaseException as e:
        global ex
        ex = e

for _ in range(10):
    t = test()
    next(t)
    t.close()

import traceback
traceback.print_tb(ex.__traceback__)

You will see many frames in the traceback.

Removing the __traceback__ attribute before each usage is not acceptable, because the exception may be used concurrently in different threads, or nested in a finalizer when GC is triggered inside the generator close.

2018-06-28 

hubo 



????"hubo" <hubo at jiedaibao.com>
?????2018-06-28 13:06
???[pypy-dev] Memory leaking with iterator.close() in PyPy3
????"PyPy Developer Mailing List"<pypy-dev at python.org>
???

In PyPy3, when an iterator is closed with "close()" method, the iterator leaks and cannot be collected.

Execute the following script in PyPy3, the memory usage is increasing very fast, and gc.collect() cannot collect the memory


def test():
    yield 1

while True:
    t = test()
    t.close()


The tested version:

Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:10:04)
[PyPy 6.0.0 with GCC 6.2.0 20160901]

This is not reproduced in CPython 3.5 and PyPy2.

2018-06-28


hubo 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180628/d9695e0c/attachment.html>

From cfbolz at gmx.de  Thu Jun 28 04:48:55 2018
From: cfbolz at gmx.de (Carl Friedrich Bolz-Tereick)
Date: Thu, 28 Jun 2018 10:48:55 +0200
Subject: [pypy-dev] Memory leaking with iterator.close() in PyPy3
In-Reply-To: <5B34777D.7040707@jiedaibao.com>+74DB179B1EFD5EC0
References: <5B346CD5.9050006@jiedaibao.com>
 <5B34777D.7040707@jiedaibao.com>+74DB179B1EFD5EC0
Message-ID: <16A26B23-9887-4069-A3A0-363F6E45CDFE@gmx.de>

Hi hubo,

Wow, that was a very good analysis, thanks a lot for finding that out! Armin is working on fixing the bug. 

Cheers, 
Carl Friedrich

On June 28, 2018 7:51:58 AM GMT+02:00, hubo <hubo at jiedaibao.com> wrote:
>This problem is caused by caching GeneratorExit exception:
>
>https://bitbucket.org/pypy/pypy/src/8b43b50fbf61f46701d398bf514cf540201ffd03/pypy/interpreter/generator.py?at=py3.5&fileviewer=file-view-default#generator.py-454:457
>
>In Python 3, an exception saves its traceback in __traceback__
>attribute. When an exception object with __traceback__ is raised again,
>current frame is appended to the __traceback__. When the GeneratorExit
>is raised inside a iterator, the __traceback__ attribute of this object
>saves the frame, which prevents the iterator from been collected by GC.
>
>Since __traceback__ attribute is mutable, it is generally a dangerous
>idea to reuse an exception object in Python 3, the problem includes:
>creating memory leaks with frames, wrong traceback, etc. I think remove
>the caching will solve the problem.
>
>It's quite easy to be validated with the following script:
>
>?def test():
>    try:
>        yield 1
>    except BaseException as e:
>        global ex
>        ex = e
>
>for _ in range(10):
>    t = test()
>    next(t)
>    t.close()
>
>import traceback
>traceback.print_tb(ex.__traceback__)
>
>You will see many frames in the traceback.
>
>Removing the __traceback__ attribute before each usage is not
>acceptable, because the exception may be used concurrently in different
>threads, or nested in a finalizer when GC is triggered inside the
>generator close.
>
>2018-06-28 
>
>hubo 
>
>
>
>????"hubo" <hubo at jiedaibao.com>
>?????2018-06-28 13:06
>???[pypy-dev] Memory leaking with iterator.close() in PyPy3
>????"PyPy Developer Mailing List"<pypy-dev at python.org>
>???
>
>In PyPy3, when an iterator is closed with "close()" method, the
>iterator leaks and cannot be collected.
>
>Execute the following script in PyPy3, the memory usage is increasing
>very fast, and gc.collect() cannot collect the memory
>
>
>def test():
>    yield 1
>
>while True:
>    t = test()
>    t.close()
>
>
>The tested version:
>
>Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:10:04)
>[PyPy 6.0.0 with GCC 6.2.0 20160901]
>
>This is not reproduced in CPython 3.5 and PyPy2.
>
>2018-06-28
>
>
>hubo 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180628/a0af4cc2/attachment-0001.html>

From armin.rigo at gmail.com  Thu Jun 28 04:55:57 2018
From: armin.rigo at gmail.com (Armin Rigo)
Date: Thu, 28 Jun 2018 10:55:57 +0200
Subject: [pypy-dev] Memory leaking with iterator.close() in PyPy3
In-Reply-To: <16A26B23-9887-4069-A3A0-363F6E45CDFE@gmx.de>
References: <5B346CD5.9050006@jiedaibao.com> <5B34777D.7040707@jiedaibao.com>
 <16A26B23-9887-4069-A3A0-363F6E45CDFE@gmx.de>
Message-ID: <CAMSv6X3NZVXfUU_ZmEwAjLKb3ZP5bfEeDXHR-kPAAfd=peLHSg@mail.gmail.com>

Hi Hubo,

The bug is fixed now in 0017e9688738.  It was apparently the only
place in the source that made a prebuilt W_BaseException instance.

Thanks a lot!

Armin

From hubo at jiedaibao.com  Thu Jun 28 06:17:51 2018
From: hubo at jiedaibao.com (hubo)
Date: Thu, 28 Jun 2018 18:17:51 +0800
Subject: [pypy-dev] Memory leaking with iterator.close() in PyPy3
In-Reply-To: <CAMSv6X3NZVXfUU_ZmEwAjLKb3ZP5bfEeDXHR-kPAAfd=peLHSg@mail.gmail.com>
References: <5B346CD5.9050006@jiedaibao.com> <5B34777D.7040707@jiedaibao.com>
 <16A26B23-9887-4069-A3A0-363F6E45CDFE@gmx.de>
 <CAMSv6X3NZVXfUU_ZmEwAjLKb3ZP5bfEeDXHR-kPAAfd=peLHSg@mail.gmail.com>
Message-ID: <5B34B5CD.4030802@jiedaibao.com>+50D1FE5ABDEB6921

Thanks a lot. How long will the next release be ready? In the mean while I can try the nightly build.

2018-06-28 

hubo 



????Armin Rigo <armin.rigo at gmail.com>
?????2018-06-28 16:55
???Re: [pypy-dev] Memory leaking with iterator.close() in PyPy3
????"Carl Friedrich Bolz-Tereick"<cfbolz at gmx.de>
???"hubo"<hubo at jiedaibao.com>,"PyPy Developer Mailing List"<pypy-dev at python.org>

Hi Hubo, 

The bug is fixed now in 0017e9688738.  It was apparently the only 
place in the source that made a prebuilt W_BaseException instance. 

Thanks a lot! 

Armin 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180628/8d016b81/attachment.html>

From naylor.b.david at gmail.com  Sat Jun 30 17:53:53 2018
From: naylor.b.david at gmail.com (David Naylor)
Date: Sat, 30 Jun 2018 23:53:53 +0200
Subject: [pypy-dev] Translating of FreeBSD fails for v6.0.0
Message-ID: <2473504.SxEM7qku3R@dragon.local>

Hi

When trying to translate the latest version of PyPy on FreeBSD I get the following error:
[translation:info] Error:
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/goal/translate.py", line 318, in main
    drv.proceed(goals)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 554, in proceed
    result = self._execute(goals, task_skip = self._maybe_skip())
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/tool/taskengine.py", line 114, in _execute
    res = self._do(goal, taskcallable, *args, **kwds)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 278, in _do
    res = func()
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 315, in task_annotate
    s = annotator.build_types(self.entry_point, self.inputtypes)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 92, in build_types
    return self.build_graph_types(flowgraph, inputs_s, complete_now=complete_now)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 140, in build_graph_types
    self.complete()
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 229, in complete
    self.complete_pending_blocks()
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 224, in complete_pending_blocks
    self.processblock(graph, block)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 398, in processblock
    self.flowin(graph, block)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 501, in flowin
    self.consider_op(op)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 653, in consider_op
    resultcell = op.consider(self)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/flowspace/operation.py", line 104, in consider
    return spec(annotator, *self.args)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/unaryop.py", line 118, in simple_call_SomeObject
    return s_func.call(argspec)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/unaryop.py", line 978, in call
    return bookkeeper.pbc_call(self, args)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/bookkeeper.py", line 535, in pbc_call
    results.append(desc.pycall(whence, args, s_previous_result, op))
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/description.py", line 398, in pycall
    s_result = self.specialize(inputcells, op)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/description.py", line 281, in specialize
    return self.specializer(self, inputcells)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/specialize.py", line 303, in memo
    _, _, memotable = memotables.find(firstvalues)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/tool/algo/unionfind.py", line 48, in find
    info = self.info_factory(obj)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/specialize.py", line 293, in compute_one_result
    value = func(*args)
   File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/rlib/rarithmetic.py", line 154, in _should_widen_type
    r_class = rffi.platform.numbertype_to_rclass[tp]
[translation:ERROR] KeyError: <Void>
Processing block:
 block at 28[n_1] is a <class 'rpython.flowspace.flowcontext.SpamBlock'> 
 in (rpython.rlib.rarithmetic:139)widen__NoneType 
 containing the following operations: 
       v630 = simple_call((function typeOf), n_1) 
       v631 = simple_call((function _should_widen_type), v630) 
       v632 = bool(v631) 
 --end--

My best guess is a call to `widen` with a None value is being specialized.  But, how does one see more information about the translation back trace (i.e. the context of the specialization of `widen`)?  Any, any idea why this is triggering on FreeBSD?

Regards
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 963 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20180630/d15b1f98/attachment.sig>