From report at bugs.python.org  Sat Jun  1 00:07:01 2019
From: report at bugs.python.org (=?utf-8?b?5p6X6Ieq5Z2H?=)
Date: Sat, 01 Jun 2019 04:07:01 +0000
Subject: [issue37119] Equality on dict.values() are inconsistent between 2 and
 3
Message-ID: <1559362021.42.0.783299654915.issue37119@roundup.psfhosted.org>


New submission from ??? <johnlinp at gmail.com>:

When I create 2 different dicts with the same literal, their dict.values() are equal in python2 but not equal in python3.

Here is an example in python2:

    $ python2
    Python 2.7.16 (default, Mar  4 2019, 09:02:22)
    [GCC 4.2.1 Compatible Apple LLVM 10.0.0 (clang-1000.11.45.5)] on darwin
    Type "help", "copyright", "credits" or "license" for more information.
    >>> a = {'hello': 'world'}
    >>> b = {'hello': 'world'}
    >>> a.values() == b.values()
    True
    >>> a.keys() == b.keys()
    True

However, the dict.values() are not equal in python3:

    $ python3
    Python 3.7.2 (default, Feb 12 2019, 08:16:38)
    [Clang 10.0.0 (clang-1000.11.45.5)] on darwin
    Type "help", "copyright", "credits" or "license" for more information.
    >>> a = {'hello': 'world'}
    >>> b = {'hello': 'world'}
    >>> a.values() == b.values()
    False
    >>> a.keys() == b.keys()
    True

Is this a bug? Or is this behavior specified somewhere in the documentation? Thanks.

Note: it's inspired by this StackOverflow question: https://stackoverflow.com/questions/56403613/questions-about-python-dictionary-equality

----------
components: Library (Lib)
messages: 344145
nosy: johnlinp
priority: normal
severity: normal
status: open
title: Equality on dict.values() are inconsistent between 2 and 3
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37119>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:14:00 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 04:14:00 +0000
Subject: [issue29984] Improve test coverage for 'heapq' module
In-Reply-To: <1491336159.04.0.480090056771.issue29984@psf.upfronthosting.co.za>
Message-ID: <1559362440.55.0.534189985117.issue29984@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 664fe3996f7e05ae351526f02b21504bb065bcf8 by Raymond Hettinger (Rob Day) in branch 'master':
bpo-29984: Improve 'heapq' test coverage (GH-992)
https://github.com/python/cpython/commit/664fe3996f7e05ae351526f02b21504bb065bcf8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29984>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:17:03 2019
From: report at bugs.python.org (Windson Yang)
Date: Sat, 01 Jun 2019 04:17:03 +0000
Subject: [issue37073] clarify functions docs in IO modules and Bytes Objects
In-Reply-To: <1559027884.63.0.0963085588001.issue37073@roundup.psfhosted.org>
Message-ID: <1559362623.65.0.249662990398.issue37073@roundup.psfhosted.org>


Windson Yang <wiwindson at outlook.com> added the comment:

Sure. Feel free to edit my PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37073>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:26:41 2019
From: report at bugs.python.org (Windson Yang)
Date: Sat, 01 Jun 2019 04:26:41 +0000
Subject: [issue37073] clarify functions docs in IO modules and Bytes Objects
In-Reply-To: <1559027884.63.0.0963085588001.issue37073@roundup.psfhosted.org>
Message-ID: <1559363201.34.0.53216205895.issue37073@roundup.psfhosted.org>


Change by Windson Yang <wiwindson at outlook.com>:


----------
keywords: +patch
pull_requests: +13600
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13713

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37073>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:29:06 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 04:29:06 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559363346.89.0.750736214517.issue33608@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
pull_requests: +13601
pull_request: https://github.com/python/cpython/pull/13714

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:30:17 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 04:30:17 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559363417.83.0.107923528065.issue36818@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
resolution: rejected -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:34:23 2019
From: report at bugs.python.org (Windson Yang)
Date: Sat, 01 Jun 2019 04:34:23 +0000
Subject: [issue37073] clarify functions docs in IO modules and Bytes Objects
In-Reply-To: <1559027884.63.0.0963085588001.issue37073@roundup.psfhosted.org>
Message-ID: <1559363663.59.0.743479241232.issue37073@roundup.psfhosted.org>


Change by Windson Yang <wiwindson at outlook.com>:


----------
pull_requests: +13602
pull_request: https://github.com/python/cpython/pull/13715

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37073>
_______________________________________

From report at bugs.python.org  Sat Jun  1 00:42:29 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 04:42:29 +0000
Subject: [issue14014] codecs.StreamWriter.reset contract not fulfilled
In-Reply-To: <1329242513.77.0.581823861095.issue14014@psf.upfronthosting.co.za>
Message-ID: <1559364149.98.0.537317347582.issue14014@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
pull_requests: +13603
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13716

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14014>
_______________________________________

From report at bugs.python.org  Sat Jun  1 01:05:29 2019
From: report at bugs.python.org (Nathaniel Smith)
Date: Sat, 01 Jun 2019 05:05:29 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
Message-ID: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>


New submission from Nathaniel Smith <njs at pobox.com>:

Maybe we should expose the SSL_CTX_set_num_tickets function:

https://www.openssl.org/docs/man1.1.1/man3/SSL_CTX_set_num_tickets.html

This is a new function added in OpenSSL 1.1.1, that lets you control the number of tickets issued by a TLS 1.3 connection.

It turns out that by default, openssl 1.1.1 issues 2 tickets at the end of the server handshake. In principle this can cause deadlocks and data corruption:

  https://github.com/openssl/openssl/issues/7967
  https://github.com/openssl/openssl/issues/7948

And my problem specifically is that this pretty much kills all of Trio's fancy protocol testing helpers, because any protocol that's built on top of TLS is automatically broken as far as the helpers are concerned. And they're right. Right now I have to disable TLS 1.3 entirely to get Trio's test suite to avoid deadlocking.

Hopefully the openssl devs will fix this, but so far their latest comment is that they consider this a feature and so they think it has to stay broken for at least RHEL 8's lifetime.

Currently the only workaround is to either disable TLS 1.3, or disable tickets. But the 'ssl' module doesn't expose any way to control tickets. This issue proposes to add that.

Fortunately, exposing SSL_CTX_set_num_tickets should be pretty trivial, at least in theory.

Questions:

Do we have a preferred convention for how to expose these kinds of settings at the Python level? Attribute on SSLContext?

There's both an SSL* and a SSL_CTX* ? I guess the CTX version is sufficient, or is there another convention?

As a bonus complication, openssl sometimes ignores the configured number of tickets, and uses a completely different mechanism:

> The default number of tickets is 2; the default number of tickets sent following a resumption handshake is 1 but this cannot be changed using these functions. The number of tickets following a resumption handshake can be reduced to 0 using custom session ticket callbacks (see https://www.openssl.org/docs/man1.1.1/man3/SSL_CTX_set_session_ticket_cb.html)

Do we want to open the can-of-worms involved in wrapping this too? I think if we only wrapped SSL_CTX_set_num_tickets then that would be enough to let me kluge my tests into passing and pretend that things are just fine, so long as we don't test session resumption...

----------
assignee: christian.heimes
components: SSL
messages: 344148
nosy: alex, christian.heimes, dstufft, janssen, njs
priority: normal
severity: normal
status: open
title: Provide knobs to disable session ticket generation on TLS 1.3
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Sat Jun  1 01:24:36 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 05:24:36 +0000
Subject: [issue36411] Python 3 f.tell() gets out of sync with file pointer in
 binary append+read mode
In-Reply-To: <1553387625.02.0.693122073587.issue36411@roundup.psfhosted.org>
Message-ID: <1559366676.89.0.413175326606.issue36411@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +13604
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13717

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 01:33:47 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 01 Jun 2019 05:33:47 +0000
Subject: [issue37119] Equality on dict.values() are inconsistent between 2 and
 3
In-Reply-To: <1559362021.42.0.783299654915.issue37119@roundup.psfhosted.org>
Message-ID: <1559367227.39.0.549643507695.issue37119@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

https://docs.python.org/3/library/stdtypes.html#dictionary-view-objects

> Keys views are set-like since their entries are unique and hashable. If all values are hashable, so that (key, value) pairs are unique and hashable, then the items view is also set-like. (Values views are not treated as set-like since the entries are generally not unique.) For set-like views, all of the operations defined for the abstract base class collections.abc.Set are available (for example, ==, <, or ^).

In Python 2 keys() and values() return a list where __eq__ is implemented. In Python 3 view objects are returned. This can be seen in Python 2 also using viewkeys and viewvalues where viewvalues() is False. So this is not a bug but I am not sure if docs can be improved to clarify this further.


$ python2
Python 2.7.14 (default, Mar 12 2018, 13:54:56)
[GCC 4.2.1 Compatible Apple LLVM 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> a = {'a': 1}
>>> b = {'a': 1}
>>> a.viewkeys() == b.viewkeys()
True
>>> a.viewvalues() == b.viewvalues()
False
>>> a.values() == b.values()
True

----------
nosy: +rhettinger, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37119>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:08:29 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 06:08:29 +0000
Subject: [issue37119] Equality on dict.values() are inconsistent between 2 and
 3
In-Reply-To: <1559362021.42.0.783299654915.issue37119@roundup.psfhosted.org>
Message-ID: <1559369309.91.0.123423884331.issue37119@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

See also issue12445.

----------
nosy: +serhiy.storchaka
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> dict view values objects are missing tp_richcmp and tp_as_number

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37119>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:16:00 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 06:16:00 +0000
Subject: [issue36411] Python 3 f.tell() gets out of sync with file pointer in
 binary append+read mode
In-Reply-To: <1553387625.02.0.693122073587.issue36411@roundup.psfhosted.org>
Message-ID: <1559369760.41.0.244772940397.issue36411@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Further testing revealed the problem and fix also apply to text mode. I submitted a pull request to fix this issue with tests for both binary and text mode.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:33:25 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 06:33:25 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559370805.15.0.0616618888819.issue18911@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:


New changeset 5ac0b988fd5f1428efe35329c531c7b5c74d37f6 by Stefan Behnel (Windson yang) in branch 'master':
bpo-18911: clarify that the minidom XML writer receives texts but not bytes (GH-13352)
https://github.com/python/cpython/commit/5ac0b988fd5f1428efe35329c531c7b5c74d37f6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:34:15 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 06:34:15 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559370855.74.0.297719687503.issue18911@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8 -Python 2.7, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:36:41 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 06:36:41 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559371001.67.0.404689822353.issue18911@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
resolution: fixed -> 
stage: resolved -> backport needed
status: closed -> open
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:40:04 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 06:40:04 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559371204.72.0.729336246963.issue18911@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13605
stage: backport needed -> patch review
pull_request: https://github.com/python/cpython/pull/13718

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:40:08 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 06:40:08 +0000
Subject: [issue36518] Avoid conflicts when pass arbitrary keyword arguments to
 Python function
In-Reply-To: <1554300842.91.0.496796216897.issue36518@roundup.psfhosted.org>
Message-ID: <1559371208.18.0.0646704322991.issue36518@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13606
pull_request: https://github.com/python/cpython/pull/13700

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36518>
_______________________________________

From report at bugs.python.org  Sat Jun  1 02:58:57 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 06:58:57 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559372337.14.0.217642674434.issue18911@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:


New changeset 18e23f227be59241cbb1eeb6d6669771dd7275fb by Stefan Behnel (Miss Islington (bot)) in branch '3.7':
bpo-18911: clarify that the minidom XML writer receives texts but not bytes (GH-13718)
https://github.com/python/cpython/commit/18e23f227be59241cbb1eeb6d6669771dd7275fb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:00:02 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 07:00:02 +0000
Subject: [issue18911] minidom does not encode correctly when calling
 Document.writexml
In-Reply-To: <1378186619.58.0.930376227557.issue18911@psf.upfronthosting.co.za>
Message-ID: <1559372402.39.0.139598760142.issue18911@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18911>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:01:26 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 07:01:26 +0000
Subject: [issue21109] tarfile: Traversal attack vulnerability
In-Reply-To: <1396253659.12.0.842636239516.issue21109@psf.upfronthosting.co.za>
Message-ID: <1559372486.87.0.706073420776.issue21109@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21109>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:21:30 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 07:21:30 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559373690.87.0.184506298288.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 4a686504eb2bbf69adf78077458508a7ba131667 by Raymond Hettinger (Yash Aggarwal) in branch 'master':
bpo-35431: Implemented math.comb (GH-11414)
https://github.com/python/cpython/commit/4a686504eb2bbf69adf78077458508a7ba131667


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:33:22 2019
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 01 Jun 2019 07:33:22 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559374402.16.0.5285752219.issue37120@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
keywords: +patch
pull_requests: +13607
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13719

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:34:29 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 07:34:29 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559374469.98.0.376131407135.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Leaving this open for a while in case there is more work that needs to be done or any further comments to be resolved.

----------
assignee:  -> rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:44:03 2019
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 01 Jun 2019 07:44:03 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559375043.88.0.468897169035.issue37120@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

+1 for the idea

Yes, for simple flags and settings, an attribute on the SSLContext is prefer. The SSLContext object is the configuration space for its connections. I would prefer to keep the setting only on the context and not clutter SSLSocket and SSLObject with additional attributes. PR 13719 goes one step further and restricts the setter to a PROTOCOL_TLS_SERVER, too.

Let's look in the callback another time. I won't be able to come up with a wrapper for that in the next three days.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:51:22 2019
From: report at bugs.python.org (jpic)
Date: Sat, 01 Jun 2019 07:51:22 +0000
Subject: [issue34155] email.utils.parseaddr mistakenly parse an email
In-Reply-To: <1559283982.86.0.259349738436.issue34155@roundup.psfhosted.org>
Message-ID: <CAC6Op1_+JOWJNy0XU73kjKNdWo30BXxAPRdGM40dcqUvfMz54Q@mail.gmail.com>


jpic <jpic at yourlabs.org> added the comment:

The email API does error recovery without loading invalid domains into
the domain variable which could lead to dangerous situations, example
with "a at foo.":

>>> email.message_from_string('From: a at foo.',policy=email.policy.default)['from'].addresses[0].domain
''

In perspective with the new patch proposed by maxking that lets an
invalid domain make it to the domain variable:

>>> email.message_from_string('From: a at b@c.com',policy=email.policy.default)['from'].addresses[0].domain
'b at c.com'

For me maxking's suggestion opens the question of where to draw the
line between invalid domains should be loaded into the domain variable
and what invalid domains should not be loaded into the domain
variable.

Another smaller advantage of of Go's net/mail behaviour is that
results between parseaddr and email are consistently empty strings for
an invalid domain: parseaddr does not seem able to return a list of
defects.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34155>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:55:22 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 07:55:22 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1559375722.23.0.854192941847.issue21872@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Sat Jun  1 03:56:56 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 07:56:56 +0000
Subject: [issue29984] Improve test coverage for 'heapq' module
In-Reply-To: <1491336159.04.0.480090056771.issue29984@psf.upfronthosting.co.za>
Message-ID: <1559375816.21.0.106109371327.issue29984@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29984>
_______________________________________

From report at bugs.python.org  Sat Jun  1 04:00:24 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 08:00:24 +0000
Subject: [issue37116] Use PEP 570 syntax for positional-only parameters
In-Reply-To: <1559314061.29.0.391357031696.issue37116@roundup.psfhosted.org>
Message-ID: <1559376024.75.0.780882081053.issue37116@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 2085bd0877e17ad4d98a4586d5eabb6faecbb190 by Serhiy Storchaka in branch 'master':
bpo-37116: Use PEP 570 syntax for positional-only parameters. (GH-13700)
https://github.com/python/cpython/commit/2085bd0877e17ad4d98a4586d5eabb6faecbb190


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37116>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:16:02 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 09:16:02 +0000
Subject: [issue37117] Simplify customization of the logging time through
 datefmt
In-Reply-To: <1559328242.82.0.712821467925.issue37117@roundup.psfhosted.org>
Message-ID: <1559380562.8.0.962113601429.issue37117@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> AFAIK, the converter attribute is only to "be set" with a function of such signature. It is not documented that it can be used and it is only used on the format time function.

What do you mean by "it is not documented"? It is documented here:

https://docs.python.org/3/library/logging.html#logging.Formatter.formatTime

See also questions on Stack Overflow relating to it:

https://stackoverflow.com/search?q=%5Bpython%5D+%5Blogging%5D+converter

Not sure what you mean by "only to be set". Obviously, it is also read *somewhere* - otherwise why would you set it?

> The only situation where this might break someone is if they inherit from formatter, substitute the formatTime function by their own implementation and rely on the function returning a time tuple. Doing that is relying on the implementation of the formatter though, as the docs explain is just something to be set.

But the converter is documented as returning a time tuple, and there conceivably exists code that relies on that. There is no reason why someone couldn't have implemented a Formatter subclass with an overridden formatTime method that assumes the converter returns a time tuple. We can't know the impact of this change in terms of the number of people/amount of software affected, but that it might break *someone's* code is IMO enough reason not to proceed with it.

> Note how you need to split the formatting of time into two different parts.

It's still a one-liner both ways in your example - just a slightly different format string. Also, note that %f doesn't give you all that much flexibility - you get six places whether you like it or not. So it's hardly something which will meet everybody's formatting requirements. So "hey, just use datefmt" won't cut it for all scenarios. Ditto for timezone display - there is a school of thought that says logs should only hold UTC time. Users can always override formatTime in their Formatter subclass to do exactly what they want - it could be a one-time thing that they can then use wherever they want.

I don't want to give the impression that I'm against *any* change - I'm not. You can see lots of changes in the logging codebase contributed by various people. A recent example in the area of logging Formatter is

https://github.com/python/cpython/pull/9703

So by all means I welcome contributions, but you might find me a bit more conservative than you would like!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37117>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:19:15 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 09:19:15 +0000
Subject: [issue36813] QueueListener not calling task_done upon termination
In-Reply-To: <1557155039.79.0.434860875914.issue36813@roundup.psfhosted.org>
Message-ID: <1559380755.43.0.21588502367.issue36813@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6b282e18877ec84e927b381b4ce187eaf4ba3dd7 by Miss Islington (bot) (Bar Harel) in branch 'master':
bpo-36813: Fix QueueListener to call task_done() upon termination. (GH-13113)
https://github.com/python/cpython/commit/6b282e18877ec84e927b381b4ce187eaf4ba3dd7


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36813>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:19:21 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 09:19:21 +0000
Subject: [issue36813] QueueListener not calling task_done upon termination
In-Reply-To: <1557155039.79.0.434860875914.issue36813@roundup.psfhosted.org>
Message-ID: <1559380761.86.0.540243035599.issue36813@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13608
pull_request: https://github.com/python/cpython/pull/13722

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36813>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:36:32 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 09:36:32 +0000
Subject: [issue36813] QueueListener not calling task_done upon termination
In-Reply-To: <1557155039.79.0.434860875914.issue36813@roundup.psfhosted.org>
Message-ID: <1559381792.44.0.74699452262.issue36813@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f286e0373feda0955c910a9fe4ef99cd2c40969e by Miss Islington (bot) in branch '3.7':
bpo-36813: Fix QueueListener to call task_done() upon termination. (GH-13113)
https://github.com/python/cpython/commit/f286e0373feda0955c910a9fe4ef99cd2c40969e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36813>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:36:25 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 01 Jun 2019 09:36:25 +0000
Subject: [issue36813] QueueListener not calling task_done upon termination
In-Reply-To: <1557155039.79.0.434860875914.issue36813@roundup.psfhosted.org>
Message-ID: <1559381785.02.0.568609606965.issue36813@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36813>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:45:07 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 09:45:07 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559382307.59.0.598407463508.issue36027@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I think GH-13266 is ready to go, but I'd appreciate a second pair of eyes on it if anyone has time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:48:20 2019
From: report at bugs.python.org (Mario Corchero)
Date: Sat, 01 Jun 2019 09:48:20 +0000
Subject: [issue37117] Simplify customization of the logging time through
 datefmt
In-Reply-To: <1559328242.82.0.712821467925.issue37117@roundup.psfhosted.org>
Message-ID: <1559382500.2.0.571012311182.issue37117@roundup.psfhosted.org>


Mario Corchero <mariocj89 at gmail.com> added the comment:

> What do you mean by "it is not documented"? It is documented here:

As it says:

"This function uses a user-configurable function to convert the creation time to a tuple. By default, time.localtime() is used; to change this for a particular formatter instance, set the converter attribute to a function with the same signature as time.localtime() or time.gmtime(). To change it for all formatters, for example if you want all logging times to be shown in GMT, set the converter attribute in the Formatter class." I assumed it means users can set such attribute but not something in the formatter class where people will do formatter.converter(xyz). If the intention was for users to also be able to use the converter attribute then I misunderstood that.

> Obviously, it is also read *somewhere* - otherwise why would you set it?

The implementation of formatTime uses it only at the moment.

> See also questions on Stack Overflow relating to it: https://stackoverflow.com/search?q=%5Bpython%5D+%5Blogging%5D+converter

Through all the questions and answers in stackoverflow they are all setting the converter (which will still work) and some (2 I think) only are reading it when they are also setting it in the class (Example: https://stackoverflow.com/questions/6290739/python-logging-use-milliseconds-in-time-format/6290946#6290946, which by chance is effectively trying to solve the same problem brought up here).

> But the converter is documented as returning a time tuple,

It just says "set the converter attribute to a function with the same signature as time.localtime() or time.gmtime()" there is no reference to what the default value has, it could even be None when user is reading it. Of course, you wrote it hehe, so if you say the intent is for people to use the default formatter that is a different thing :).

>  but that it might break *someone's* code is IMO enough reason not to proceed with it.

I looked hard and could not find any of those in Github (it does not mean that there are none indeed). I would agree on not releasing this as a patch release, but as part of a new minor I would argue that it is fair. From my point of view, it only breaks people depending on the implementation of it and using the formatter in a not common way (at least from what was seen in stackoverflow and github, there is also no cookbook that recommends doing anything like that).

> It's still a one-liner both ways in your example

Yeah but it requires to deeply understand how Formatter is formatting time rather than just using a template.

> Users can always override formatTime in their Formatter subclass to do exactly what they want - it could be a one-time thing that they can then use wherever they want

They need to copy paste this code around on all their scripts/apps or create their own library to include this.

> I don't want to give the impression that I'm against *any* change - I'm not

Don't worry, I can totally understand :), if you still think it is not worth pursuing this feel free to close the issue. It was an idea I thought it was worth pushing but it is totally your call (I won't take it at all personal ^^). Thanks for taking the time to answer!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37117>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:50:59 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 09:50:59 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559382659.9.0.491826378077.issue37111@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> This seems like an attempt at victim blaming.

Er, no, it was a straight question about whether you'd read the documentation.

> I'm afraid this line of reasoning is suffering from selection bias, cherry picking, confirmation bias, and probably some others too.

Er, no, it was stating that lots of people have successfully used logging on Windows with utf-8, as a way of justifying my opinion that there's no deficiency here that needs addressing.

> Sure "stream" is on there, but then you need to know about streams and make the association with logging which I apparently don't. You have to remember not everyone has your level of proficiency in the language. In fact, most Python users don't.

Sure, and that's fine. Experienced developers learn stuff every day too. But responding to issues takes time (notice how many people will have been notified about this issue from the "nosy list" above; each would have to spend at least some time looking at it), so raising issues should be done only after exhausting other resources to make sure that the problem isn't in one's own level of knowledge or understanding, but an actual problem with the software. This is why I earlier suggested Stack Overflow and python-list as useful resources for improving one's knowledge and understanding.

> Lets put this another way - is there a reason NOT to have Unicode logging as the default?

I have no idea what you mean by this. As my example illustrated, it's quite easy to log Unicode in log files.

A simple Internet search for "basicConfig encoding" yields for me as the second result this Stack Overflow question

https://stackoverflow.com/questions/21402530

for which the accepted answer is a slight variation on what I suggested earlier.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:52:25 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 09:52:25 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559382745.85.0.424463990192.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Thanks, Raymond. I'm planning to do a post-merge review and test this weekend.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 05:56:13 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 09:56:13 +0000
Subject: [issue37117] Simplify customization of the logging time through
 datefmt
In-Reply-To: <1559328242.82.0.712821467925.issue37117@roundup.psfhosted.org>
Message-ID: <1559382973.41.0.586762223704.issue37117@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37117>
_______________________________________

From report at bugs.python.org  Sat Jun  1 06:45:51 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 01 Jun 2019 10:45:51 +0000
Subject: [issue36461] timeit: Additional changes for autorange
In-Reply-To: <1558762853.33.0.966475323893.issue36461@roundup.psfhosted.org>
Message-ID: <20190601104543.GR4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Sorry for the late reply.

> Just a question: why we need to check ``if number == 0:``? In the 
> proposal you asked for None too. What changed? Even if the function is 
> called with False, will it hurts to keep the default value?

Fair question. On rethinking, I'm okay with an explicit check for None 
or zero, ``if number is None or number < 0`` but I don't like the idea 
of accepting *any* falsey value.

Calling the function with False is fine, since False == 0 but I don't 
think it is fine to call the function with (say) [] or {} or "", which 
are all falsey values.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36461>
_______________________________________

From report at bugs.python.org  Sat Jun  1 06:54:11 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 01 Jun 2019 10:54:11 +0000
Subject: [issue36461] timeit: Additional changes for autorange
In-Reply-To: <20190601104543.GR4221@ando.pearwood.info>
Message-ID: <20190601105406.GS4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> ``if number is None or number < 0``

Sorry, that should be number == 0

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36461>
_______________________________________

From report at bugs.python.org  Sat Jun  1 07:04:40 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 01 Jun 2019 11:04:40 +0000
Subject: [issue36411] Python 3 f.tell() gets out of sync with file pointer in
 binary append+read mode
In-Reply-To: <1553387625.02.0.693122073587.issue36411@roundup.psfhosted.org>
Message-ID: <1559387080.59.0.451507874886.issue36411@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 07:38:56 2019
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 01 Jun 2019 11:38:56 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1559324839.4.0.572294965949.issue36839@roundup.psfhosted.org>
Message-ID: <CAEfz+Tx1U6uP+FnR0T7RZQnBW5Ms37+qYS+4+K_QhJqCZ0Fc2g@mail.gmail.com>


Inada Naoki <songofacandy at gmail.com> added the comment:

On Sat, Jun 1, 2019 at 2:47 AM Brett Cannon <report at bugs.python.org> wrote:
>
> Brett Cannon <brett at python.org> added the comment:
>
> RE: "I think it needs significant benefits for typical users, not only for Instagram. If only Instagram get benefit from this, keep it as Instagram's internal patch."
>
> But who's typical in this case? You? Me? We're talking code objects, something that the typical Python user doesn't even know exists if you take "typical" to mean "common" or "majority". I suspect if we asked Python developers if they knew what lnotab was an abbreviation of they wouldn't know, let alone how it worked.
>
> And just because Instagram did this work and is making it public doesn't mean (a) others wouldn't use it or (b) others are already doing it privately. There are plenty of other companies with massive server installs of Python beyond Instagram.
>
> My point is we have to be very careful when we start to claim we know what is typical or useful to the wider community considering how huge and diverse the Python community is.
>

I'm sorry for bad word choice.  I didn't mean "majority" or "common".
For example, I was +1 for gc.freeze(), even if majority users doesn't use it.

My point is (a) it's very hard others utilize it, and (b) it's very
hard others confirm the benefit.

And I suspect that Dino's estimation is wrong, but no one can verify
the estimation
because he didn't show enough concrete information.

Elaborately speaking,

* They need to use custom importer and serializer other than marshal
to import code objects.
* They need to use lightweight object for buffer.  At least,
memoryview object is large (192byte
  on Python 3.7.3 amd64).

Even if Instaram can not open source their import system, they can be
show more concrete
data.  For example, their this [1] report is very good at considering
gc.freeze().

[1] https://instagram-engineering.com/dismissing-python-garbage-collection-at-instagram-4dca40b29172

While I agree that mmap pyc files is interesting idea, I feel allowing
buffer object for co_code
is wrong way to achieve it (*).  But there are no enough data to
discuss the benefit.

Current status is Dino claims this idea have benefit in Instagram, but
no one can confirm the benefit.
I think we shouldn't discuss without reliable or reproducible data for
this type of proposal.

(*) One possible idea is code object have just a pointer and length
for co_code, and reference to
   object who owns the data (mmaped file).  code object can load
co_lnotab and docstring lazily too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sat Jun  1 07:47:09 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 01 Jun 2019 11:47:09 +0000
Subject: [issue36984] typing docs "versionadded" is inaccurate for many
 attributes
In-Reply-To: <1558416035.31.0.248938950481.issue36984@roundup.psfhosted.org>
Message-ID: <1559389629.15.0.463732768301.issue36984@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
nosy: +levkivskyi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36984>
_______________________________________

From report at bugs.python.org  Sat Jun  1 08:02:14 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 01 Jun 2019 12:02:14 +0000
Subject: [issue35849] Added thousands separators to Lib/pstats.py final report
In-Reply-To: <1548766331.46.0.0833286868767.issue35849@roundup.psfhosted.org>
Message-ID: <1559390534.65.0.752873728357.issue35849@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

For reference, issue24084 is about increasing the size of the quicker timings.  Both projects change the layout.

----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35849>
_______________________________________

From report at bugs.python.org  Sat Jun  1 08:10:23 2019
From: report at bugs.python.org (Yash Aggarwal)
Date: Sat, 01 Jun 2019 12:10:23 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559391023.4.0.814796359897.issue35431@roundup.psfhosted.org>


Yash Aggarwal <aggarwal.yash2011 at gmail.com> added the comment:

Thanks @rhettinger for cleaning up the code and closing the pr. I didn't get what you meant by long, and sorry for not being much active as well. I am stuck with a pretty time consuming internship.

----------
versions: +Python 3.6 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 09:08:51 2019
From: report at bugs.python.org (Dale Visser)
Date: Sat, 01 Jun 2019 13:08:51 +0000
Subject: [issue37101] Filterer.filter can be rewritten using built-ins just as
 efficient much more readable
In-Reply-To: <1559231349.65.0.379811854452.issue37101@roundup.psfhosted.org>
Message-ID: <1559394531.98.0.705741169972.issue37101@roundup.psfhosted.org>


Dale Visser <dale.visser at live.com> added the comment:

I've learned a lot about the performance trade-offs of generator expressions. The only way of shortening this code (readability is subjective) that I've found not to negatively impact performance is this:

    def filter(self, record):
        rv = True
        for f in self.filters:
            if not getattr(f, 'filter', f)(record):
                rv = False
                break
        return rv

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37101>
_______________________________________

From report at bugs.python.org  Sat Jun  1 09:12:58 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 13:12:58 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559394778.18.0.119108472111.issue36839@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> * They need to use lightweight object for buffer.  At least,
> memoryview object is large (192byte
>  on Python 3.7.3 amd64).

Actually it is larger, because you should add the size of internal objects. In 3.8:

>>> sys.getsizeof(memoryview(b''))
184
>>> sys.getsizeof(gc.get_referents(memoryview(b''))[0])
128

312 bytes total, not counting padding. The average size of co_code in Lib/*.py is 85 bytes. Unless Instagram uses gigantic functions and methods (and no comprehensions or lambdas), the net benefit will be negative.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sat Jun  1 09:29:51 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 13:29:51 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559395791.17.0.23293030009.issue36839@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The size of the code object is at least 144 bytes.

>>> def f(): pass
... 
>>> sys.getsizeof(f.__code__)
144

If the function uses parameters, variables or constants (and you cannot do much useful without using them), their size should be added too. It overwhelms the size of the raw bytecode.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sat Jun  1 10:13:52 2019
From: report at bugs.python.org (Lasha Gogua)
Date: Sat, 01 Jun 2019 14:13:52 +0000
Subject: =?utf-8?b?W2lzc3VlMzcxMjFdICfhg5AnLnVwcGVyKCkgc2hvdWxkIHJldHVybiAn4YOQ?=
 =?utf-8?q?=27?=
Message-ID: <1559398432.1.0.631402061489.issue37121@roundup.psfhosted.org>


New submission from Lasha Gogua <gogualasha at gmail.com>:

Python's .upper() string method still translates Georgian characters this to "'?'" which is not right

Python 3.7.3 (default, May 11 2019, 00:45:16) 
[GCC 8.3.1 20190223 (Red Hat 8.3.1-2)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> '?'
'?'
>>> '?'.upper()
'?'
>>> print('?'.upper())
?
>>> 

and it works in Python 3.6.x and below

Python 3.6.3 (default, Jan  4 2018, 16:40:53) 
[GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> '?'
'?'
>>> '?'.upper()
'?'
>>> print('?'.upper())
?
>>> 

now i have found the solution but is it correct? What's changed in the new version (Python 3.7.x)?

Python 3.7.3 (default, May 11 2019, 00:45:16) 
[GCC 8.3.1 20190223 (Red Hat 8.3.1-2)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> print('?'.upper())
?
>>> print('?'.encode().upper().decode())
?
>>> print('?'.encode('utf-8').upper().decode('utf-8'))
?
>>>

----------
components: Unicode
messages: 344174
nosy: Lasha Gogua, ezio.melotti, vstinner
priority: normal
severity: normal
status: open
title: '?'.upper() should return '?'
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37121>
_______________________________________

From report at bugs.python.org  Sat Jun  1 10:41:14 2019
From: report at bugs.python.org (SilentGhost)
Date: Sat, 01 Jun 2019 14:41:14 +0000
Subject: =?utf-8?b?W2lzc3VlMzcxMjFdICfhg5AnLnVwcGVyKCkgc2hvdWxkIHJldHVybiAn4YOQ?=
 =?utf-8?q?=27?=
In-Reply-To: <1559398432.1.0.631402061489.issue37121@roundup.psfhosted.org>
Message-ID: <1559400074.29.0.383522091465.issue37121@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

What changed was that python 3.7 is using Unicode 11 standard, which has introduced changes for Georgian script. See "Casing Issues" under https://www.unicode.org/versions/Unicode11.0.0/#Migration

The Python is correctly implements the standard.

----------
nosy: +SilentGhost
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37121>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:04:22 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 15:04:22 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559401462.95.0.055786583241.issue35431@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13609
pull_request: https://github.com/python/cpython/pull/13725

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:08:41 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 15:08:41 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559401721.2.0.763209006495.issue35431@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 13725 is a technical fix/optimization/cleanup. Later we can apply algorithmic optimization.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:21:51 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 01 Jun 2019 15:21:51 +0000
Subject: [issue36612] Unittest document is not clear on SetUpClass calls
In-Reply-To: <1555070993.71.0.91547720267.issue36612@roundup.psfhosted.org>
Message-ID: <1559402511.21.0.0655292823409.issue36612@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

@xtreak or @lisroach, any thoughts?  Thanks!

----------
nosy: +cheryl.sabella, lisroach, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36612>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:46:08 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 15:46:08 +0000
Subject: [issue37122] Make co->co_argcount represent the total number of
 positional arguments in the code object
Message-ID: <1559403968.0.0.258896403168.issue37122@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Originally proposed in:

https://mail.python.org/pipermail/python-dev/2019-June/157812.html

----------
components: Interpreter Core
messages: 344178
nosy: pablogsal, scoder, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Make co->co_argcount represent the total number of positional arguments in the code object
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37122>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:46:58 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 15:46:58 +0000
Subject: [issue37122] Make co->co_argcount represent the total number of
 positional arguments in the code object
In-Reply-To: <1559403968.0.0.258896403168.issue37122@roundup.psfhosted.org>
Message-ID: <1559404018.93.0.403992555505.issue37122@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13610
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13726

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37122>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:52:01 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 15:52:01 +0000
Subject: [issue31968] exec(): method's default arguments from dict-inherited
 globals
In-Reply-To: <1510058956.93.0.213398074469.issue31968@psf.upfronthosting.co.za>
Message-ID: <1559404321.85.0.0722698708172.issue31968@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 059b9ea5ac98f432e41b05d1fa5aab4ffa22df4d by Raymond Hettinger (Anthony Shaw) in branch 'master':
bpo-31968: Documentation -- add clarification on the globals dict for exec() (GH-13140)
https://github.com/python/cpython/commit/059b9ea5ac98f432e41b05d1fa5aab4ffa22df4d


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31968>
_______________________________________

From report at bugs.python.org  Sat Jun  1 11:53:07 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 15:53:07 +0000
Subject: [issue31968] exec(): method's default arguments from dict-inherited
 globals
In-Reply-To: <1510058956.93.0.213398074469.issue31968@psf.upfronthosting.co.za>
Message-ID: <1559404387.75.0.561119121119.issue31968@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31968>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:05:31 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:05:31 +0000
Subject: [issue37123] test_multiprocessing fails randomly on Windows
Message-ID: <1559405131.96.0.0818992217462.issue37123@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

https://buildbot.python.org/all/#/builders/58/builds/2539
https://buildbot.python.org/all/#/builders/58/builds/2539

Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 327, in test_multiprocessing
    out, err = check_output([envpy, '-c',
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 42, in check_output
    raise subprocess.CalledProcessError(
subprocess.CalledProcessError: Command '['d:\\temp\\tmp_qt0ywa6\\Scripts\\python_d.exe', '-c', 'from multiprocessing import Pool; print(Pool(1).apply_async("Python".lower).get(3))']' returned non-zero exit status 3221225477.



======================================================================
FAIL: test_mymanager (test.test_multiprocessing_spawn.WithManagerTestMyManager)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\_test_multiprocessing.py", line 2806, in test_mymanager
    self.assertEqual(manager._process.exitcode, 0)
AssertionError: -15 != 0
----------------------------------------------------------------------

----------
messages: 344180
nosy: pablogsal
priority: normal
severity: normal
status: open
title: test_multiprocessing fails randomly on Windows

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37123>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:13:14 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 16:13:14 +0000
Subject: [issue36993] zipfile: tuple IndexError on extract
In-Reply-To: <1558441969.28.0.928640082083.issue36993@roundup.psfhosted.org>
Message-ID: <1559405594.08.0.770063550116.issue36993@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

This report is valid. Serhiy has improved error reporting of the extra field in feccdb2a249a71be330765be77dee57121866779.

counts can indeed be an empty tuple:

    elif ln == 0:
        counts = ()

If I'm reading section 4.5.3 of https://pkware.cachefly.net/webdocs/casestudies/APPNOTE.TXT correctly, I think we need to raise BadZipFile if ln == 0.

----------
components: +Library (Lib)
nosy: +berker.peksag, serhiy.storchaka
resolution: not a bug -> 
stage: resolved -> needs patch
status: closed -> open
type:  -> behavior
versions:  -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36993>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:13:45 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 16:13:45 +0000
Subject: [issue36993] zipfile: tuple IndexError on extract
In-Reply-To: <1558441969.28.0.928640082083.issue36993@roundup.psfhosted.org>
Message-ID: <1559405625.7.0.997209336702.issue36993@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
keywords: +patch
pull_requests: +13611
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13727

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36993>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:15:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:15:26 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
Message-ID: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

BUILDBOT FAILURE REPORT
=======================

Builder name: AMD64 Windows8.1 Refleaks 2.7
Builder url: https://buildbot.python.org/all/#/builders/33/
Build url: https://buildbot.python.org/all/#/builders/33/builds/604

Failed tests
------------



Test leaking resources
----------------------

- test_msilib is leaking references


Build summary
-------------

== Tests result: FAILURE then FAILURE ==

360 tests OK.

10 slowest tests:
- test_bsddb3: 4042.9s
- test_mmap: 434.0s
- test_multiprocessing: 313.8s
- test_shelve: 246.5s
- test_mailbox: 239.3s
- test_ssl: 227.2s
- test_lib2to3: 135.6s
- test_largefile: 131.5s
- test_decimal: 126.0s
- test_urllib2_localnet: 122.6s

1 test failed:
    test_msilib

42 tests skipped:
    test_aepack test_al test_applesingle test_bsddb185 test_cd test_cl
    test_commands test_crypt test_curses test_dbm test_dl test_epoll
    test_fcntl test_fork1 test_gdb test_gdbm test_gl test_grp
    test_imgfile test_ioctl test_kqueue test_linuxaudiodev test_macos
    test_macostools test_mhlib test_nis test_openpty test_ossaudiodev
    test_pipes test_poll test_posix test_pty test_pwd test_readline
    test_resource test_scriptpackages test_spwd test_sunaudiodev
    test_threadsignals test_wait3 test_wait4 test_zipfile64
2 skips unexpected on win32:
    test_gdb test_readline

1 re-run test:
    test_msilib

Total duration: 1 hour 20 min


Tracebacks
----------



Current builder status
----------------------

The builder is failing currently

Commits
-------



Other builds with similar failures
----------------------------------

-  https://buildbot.python.org/all/#/builders/80/builds/608
-  https://buildbot.python.org/all/#/builders/132/builds/505

----------
components: Tests
messages: 344182
nosy: pablogsal
priority: normal
severity: normal
status: open
title: test_msilib is potentially leaking references and memory blocks
type: behavior
versions: Python 2.7, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:15:32 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:15:32 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559405732.61.0.892294192447.issue37124@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:15:53 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:15:53 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559405753.63.0.373744024884.issue37124@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

This is likely to be caused by: 

https://github.com/python/cpython/pull/13688

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:20:23 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 16:20:23 +0000
Subject: [issue36992] zipfile: AttributeError on extract (LZMA)
In-Reply-To: <1558441771.7.0.234228276725.issue36992@roundup.psfhosted.org>
Message-ID: <1559406023.81.0.61470578628.issue36992@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

This is a duplicate of issue 36991 and will be fixed by the same PR.

----------
nosy: +berker.peksag
resolution: not a bug -> duplicate
superseder:  -> zipfile: AttributeError on extract

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36992>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:31:17 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:31:17 +0000
Subject: [issue37125] math.comb is leaking references
Message-ID: <1559406677.46.0.632223828362.issue37125@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

./python Lib/test/bisect_cmd.py test_math -R 2:2

...

WARNING: Running tests with --huntrleaks/-R and less than 3 warmup repetitions can give false positives!
Run tests sequentially
0:00:00 load avg: 1.32 [1/1] test_math
beginning 4 repetitions
1234
....
test_math leaked [12352, 12352] references, sum=24704
test_math leaked [1, 1] memory blocks, sum=2
test_math failed

== Tests result: FAILURE ==

1 test failed:
    test_math

Total duration: 663 ms
Tests result: FAILURE
ran 1 tests/2
exit 2
Tests failed: continuing with this subtest

Tests (1):
* test.test_math.IsCloseTests.testComb

Bisection completed in 13 iterations and 0:00:11

----------
components: Interpreter Core, Tests
messages: 344185
nosy: pablogsal, rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: math.comb is leaking references
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37125>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:33:18 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:33:18 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559406798.46.0.307906583739.issue35431@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

math.comb is leaking, I opened https://bugs.python.org/issue37125 to track it.

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:33:24 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 16:33:24 +0000
Subject: [issue36976] email: AttributeError
In-Reply-To: <1558376398.04.0.740342940317.issue36976@roundup.psfhosted.org>
Message-ID: <1559406804.43.0.78319070734.issue36976@roundup.psfhosted.org>


Change by Berker Peksag <berker.peksag at gmail.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Certain Malformed email causes email.parser to throw AttributeError

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36976>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:34:56 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:34:56 +0000
Subject: [issue37125] math.comb is leaking references
In-Reply-To: <1559406677.46.0.632223828362.issue37125@roundup.psfhosted.org>
Message-ID: <1559406896.67.0.86410430584.issue37125@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

It seems that https://github.com/python/cpython/pull/13725 fixes the leak:

? ./python -m test test_math -R :
Run tests sequentially
0:00:00 load avg: 1.55 [1/1] test_math
beginning 9 repetitions
123456789
.........

== Tests result: SUCCESS ==

1 test OK.

Total duration: 26 sec 283 ms
Tests result: SUCCESS

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37125>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:37:49 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 01 Jun 2019 16:37:49 +0000
Subject: [issue37123] test_multiprocessing fails randomly on Windows
In-Reply-To: <1559405131.96.0.0818992217462.issue37123@roundup.psfhosted.org>
Message-ID: <1559407069.15.0.907090436808.issue37123@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I couldn't find the traceback for test_venv in the buildbot logs. They were skipped and fixed as part of issue35978.

----------
components: +Tests
nosy: +xtreak
type:  -> behavior
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37123>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:55:05 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 16:55:05 +0000
Subject: [issue37123] test_multiprocessing fails randomly on Windows
In-Reply-To: <1559405131.96.0.0818992217462.issue37123@roundup.psfhosted.org>
Message-ID: <1559408105.17.0.0498063119967.issue37123@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Sorry, I posted the same link twice. Here is the test_venv failure:

https://buildbot.python.org/all/#/builders/58/builds/2538

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37123>
_______________________________________

From report at bugs.python.org  Sat Jun  1 12:59:27 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 16:59:27 +0000
Subject: [issue32411] Idlelib.browser: stop sorting dicts created by pyclbr
In-Reply-To: <1513996869.13.0.213398074469.issue32411@psf.upfronthosting.co.za>
Message-ID: <1559408367.51.0.570634413901.issue32411@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Can this move forward now?

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:00:48 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:00:48 +0000
Subject: [issue37126] test_threading is leaking references
Message-ID: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

https://buildbot.python.org/all/#/builders/1/builds/601

OK (skipped=1)
.
test_threading leaked [9770, 9772, 9768] references, sum=29310
test_threading leaked [3960, 3961, 3959] memory blocks, sum=11880
2 tests failed again:
    test_asyncio test_threading

----------
components: Tests
messages: 344191
nosy: pablogsal, vstinner
priority: normal
severity: normal
status: open
title: test_threading is leaking references
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:08:07 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:08:07 +0000
Subject: [issue37122] Make co->co_argcount represent the total number of
 positional arguments in the code object
In-Reply-To: <1559403968.0.0.258896403168.issue37122@roundup.psfhosted.org>
Message-ID: <1559408887.45.0.0472005950128.issue37122@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset cd74e66a8c420be675fd2fbf3fe708ac02ee9f21 by Pablo Galindo in branch 'master':
bpo-37122: Make co->co_argcount represent the total number of positonal arguments in the code object (GH-13726)
https://github.com/python/cpython/commit/cd74e66a8c420be675fd2fbf3fe708ac02ee9f21


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37122>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:08:23 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:08:23 +0000
Subject: [issue37122] Make co->co_argcount represent the total number of
 positional arguments in the code object
In-Reply-To: <1559403968.0.0.258896403168.issue37122@roundup.psfhosted.org>
Message-ID: <1559408903.9.0.650974496965.issue37122@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37122>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:12:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 17:12:04 +0000
Subject: [issue36993] zipfile: tuple IndexError on extract
In-Reply-To: <1558441969.28.0.928640082083.issue36993@roundup.psfhosted.org>
Message-ID: <1559409124.25.0.683265278199.issue36993@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

It is not enough. IndexError can be raised for ln == 8 or 16 when file_size, compress_size and header_offset are all set to 0xffffffff.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36993>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:14:57 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 17:14:57 +0000
Subject: [issue21879] str.format() gives poor diagnostic on placeholder
 mismatch
In-Reply-To: <1404052648.46.0.81950938275.issue21879@psf.upfronthosting.co.za>
Message-ID: <1559409297.64.0.633779540022.issue21879@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21879>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:27:57 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:27:57 +0000
Subject: [issue33346] Syntax error with async generator inside dictionary
 comprehension
In-Reply-To: <1524567941.57.0.682650639539.issue33346@psf.upfronthosting.co.za>
Message-ID: <1559410077.72.0.83568501666.issue33346@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Ping, should we include this in beta1 or as is a "bugfix" this can be backported?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33346>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:37:19 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:37:19 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559410639.96.0.197798241029.issue37126@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

? ./python -m test test_threading -m test_excepthook_thread_None -R :
Run tests sequentially
0:00:00 load avg: 1.38 [1/1] test_threading
beginning 9 repetitions
123456789
.........
test_threading leaked [364, 364, 364, 364] references, sum=1456
test_threading leaked [164, 164, 164, 164] memory blocks, sum=656
test_threading failed

== Tests result: FAILURE ==

1 test failed:
    test_threading

Total duration: 159 ms
Tests result: FAILURE

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:37:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 17:37:26 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559410646.22.0.694716873334.issue37126@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 13:54:03 2019
From: report at bugs.python.org (Christian Heimes)
Date: Sat, 01 Jun 2019 17:54:03 +0000
Subject: [issue34271] Please support logging of SSL master secret by env
 variable SSLKEYLOGFILE
In-Reply-To: <1532867889.16.0.56676864532.issue34271@psf.upfronthosting.co.za>
Message-ID: <1559411643.98.0.119381952589.issue34271@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
pull_requests: +13612
pull_request: https://github.com/python/cpython/pull/13728

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34271>
_______________________________________

From report at bugs.python.org  Sat Jun  1 14:05:35 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 18:05:35 +0000
Subject: [issue37125] math.comb is leaking references
In-Reply-To: <1559406677.46.0.632223828362.issue37125@roundup.psfhosted.org>
Message-ID: <1559412335.58.0.151434180872.issue37125@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37125>
_______________________________________

From report at bugs.python.org  Sat Jun  1 14:07:35 2019
From: report at bugs.python.org (Berker Peksag)
Date: Sat, 01 Jun 2019 18:07:35 +0000
Subject: [issue36993] zipfile: tuple IndexError on extract
In-Reply-To: <1558441969.28.0.928640082083.issue36993@roundup.psfhosted.org>
Message-ID: <1559412455.04.0.106035969937.issue36993@roundup.psfhosted.org>


Berker Peksag <berker.peksag at gmail.com> added the comment:

@alter-bug-tracer, could you please create test files for the cases Serhiy has just mentioned?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36993>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:00:33 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 19:00:33 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559415633.88.0.506092593398.issue37126@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The problem here is that there is a reference cycle with threading.ExceptHookArgs but structseq objects are not tracked by the GC.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:01:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 19:01:26 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559415686.84.0.376375471504.issue37126@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13613
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13729

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:03:10 2019
From: report at bugs.python.org (Jonathan)
Date: Sat, 01 Jun 2019 19:03:10 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559415790.19.0.0400659188798.issue37111@roundup.psfhosted.org>


Jonathan <bugreports at lightpear.com> added the comment:

> I have no idea what you mean by this.

I don't see how I can be clearer. What are the reasons for NOT implementing logging to file be unicode as a default? Logging to screen is unicode as a default. What are the reasons for not wanting consistency?

> A simple Internet search for "basicConfig encoding" yields for me as the second result this Stack Overflow question 

Indeed, and it was from that question I got my solution in fact. The problem was the 30-60 minutes I wasted before that trying to figure out why my program was crashing and why it was only crashing *sometimes*. I'd written the logging part of the program a year ago and not really touched it since, so the logging module being a possible culprit was not even in my mind when the program crashed.

> As my example illustrated, it's quite easy to log Unicode in log files.

Yes, things are easy when you know it's necessary. It's the process of discovery that's an unnecessary waste of people's time. That's why I raised this and that's why I would consider this a bug in my own software. It's inconsistent, it invites problems, and it wastes peoples time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:09:05 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 19:09:05 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559416145.38.0.390683707685.issue35431@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 2b843ac0ae745026ce39514573c5d075137bef65 by Serhiy Storchaka in branch 'master':
bpo-35431: Refactor math.comb() implementation. (GH-13725)
https://github.com/python/cpython/commit/2b843ac0ae745026ce39514573c5d075137bef65


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:09:20 2019
From: report at bugs.python.org (Stefan Krah)
Date: Sat, 01 Jun 2019 19:09:20 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559416160.09.0.496934223399.issue36839@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

The managed buffer can be shared:

>>> b = b'12345'
>>> m1 = memoryview(b)
>>> m2 = memoryview(m1)
>>> gc.get_referents(m1)[0]
<managedbuffer object at 0x1216fd8>
>>> gc.get_referents(m2)[0]
<managedbuffer object at 0x1216fd8>


And I understood that Dino proposed to share one code instance as a memory mapped file for *all* processes.

----------
nosy: +skrah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:09:25 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 19:09:25 +0000
Subject: [issue28595] shlex.shlex should not augment wordchars
In-Reply-To: <1478166136.94.0.995190174918.issue28595@psf.upfronthosting.co.za>
Message-ID: <1559416165.49.0.917878637512.issue28595@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 56624a99a916fd27152d5b23364303acc0d707de by Vinay Sajip (Evan) in branch 'master':
bpo-28595: Allow shlex whitespace_split with punctuation_chars (GH-2071)
https://github.com/python/cpython/commit/56624a99a916fd27152d5b23364303acc0d707de


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28595>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:11:46 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 19:11:46 +0000
Subject: [issue37127] Handling pending calls during runtime finalization may
 cause problems.
Message-ID: <1559416306.37.0.716771519489.issue37127@roundup.psfhosted.org>


New submission from Eric Snow <ericsnowcurrently at gmail.com>:

In Python/lifecycle.c (Py_FinalizeEx) we call _Py_FinishPendingCalls(), right after we stop all non-daemon Python threads but before we've actually started finalizing the runtime state.  That call looks for any remaining pending calls (for the main interpreter) and runs them.  There's some evidence of a bug there.

In bpo-33608 I moved the pending calls to per-interpreter state.  We saw failures (sometimes sporadic) on a few buildbots (e.g. FreeBSD) during runtime finalization.  However, nearly all of the buildbots were fine, so it may be a question of architecture or slow hardware.  See bpo-33608 for details on the failures.

There are a number of possibilities, but it's been tricky reproducing the problem in order to investigate.  Here are some theories:

* daemon threads (a known weak point in runtime finalization) block pending calls from happening until some time after portions of the runtime have already been cleaned up
* there's a race that causes the pending calls machinery to get caught in some sort infinite loop (e.g. a pending call fails and gets re-queued)
* a corner case in the pending calls logic that triggers only during finalization

Here are some other points to consider:

* do we have the same problem during subinterpreter finalization (Py_EndInterpreter() rather than runtime finalization)?
* perhaps the problem extends beyond finalization, but the conditions are more likely there
* the change for bpo-33608 could have introduced the bug rather that exposing an existing one

----------
assignee: eric.snow
components: Interpreter Core
messages: 344202
nosy: eric.snow
priority: normal
severity: normal
stage: test needed
status: open
title: Handling pending calls during runtime finalization may cause problems.
type: crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37127>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:13:04 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 19:13:04 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559416384.6.0.0379606041174.issue37111@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Learning is not a waste of time. You're entitled to your opinion, but this is not a bug in logging. We'll have to agree to disagree.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:16:06 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 19:16:06 +0000
Subject: [issue20092] type() constructor should bind __int__ to __index__ when
 __index__ is defined and __int__ is not
In-Reply-To: <1388260592.79.0.323683192221.issue20092@psf.upfronthosting.co.za>
Message-ID: <1559416566.83.0.724647440147.issue20092@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20092>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:17:36 2019
From: report at bugs.python.org (Jonathan)
Date: Sat, 01 Jun 2019 19:17:36 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559416656.86.0.308751719097.issue37111@roundup.psfhosted.org>


Jonathan <bugreports at lightpear.com> added the comment:

> Learning is not a waste of time. You're entitled to your opinion, but this is not a bug in logging. We'll have to agree to disagree.

I agree and value learning a great deal. However learning should happen on your own time, NOT when a program crashes randomly and tries taking you down the rabbit hole. I like learning but not about unrelated things when I'm trying to do useful work.

Fine, if you don't consider this a bug, consider it a feature request. "User would like Python logging of Unicode characters to be consistent" is not an unreasonable request.

----------
status: closed -> open
type: behavior -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:20:33 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 01 Jun 2019 19:20:33 +0000
Subject: [issue34155] email.utils.parseaddr mistakenly parse an email
In-Reply-To: <1532012023.85.0.56676864532.issue34155@psf.upfronthosting.co.za>
Message-ID: <1559416833.73.0.0656305198822.issue34155@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I don't know if we can make the API consistent between parseaddr and the parsing header value since they are completely different even right now. Like you already noticed there is no way to register defects and instead parseaddr returns ('', '') to denote the failure to parse.

About parsing malicious domain, my line of thinking was along the lines of presenting whatever is there to user of the API, without 'hiding' that information. It would be harder to figure out the exception if the domain is missing. 

Even though the domain is parsed in the `domain` value, the value itself is clearly invalid. Any attempt to ever use that Address() will definitely cause an error (perhaps, there should be a sanity check in SMTP.send_message for that?).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34155>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:21:31 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 19:21:31 +0000
Subject: [issue20092] type() constructor should bind __int__ to __index__ when
 __index__ is defined and __int__ is not
In-Reply-To: <1388260592.79.0.323683192221.issue20092@psf.upfronthosting.co.za>
Message-ID: <1559416891.31.0.877952914663.issue20092@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I like the delegation of `float` and `complex` to use `__index__` that was introduced in GH-13108; it would be nice to have that regardless of which solution is decided on for `__int__` and `__index__`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20092>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:21:38 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 19:21:38 +0000
Subject: [issue37127] Handling pending calls during runtime finalization may
 cause problems.
In-Reply-To: <1559416306.37.0.716771519489.issue37127@roundup.psfhosted.org>
Message-ID: <1559416898.04.0.919934982508.issue37127@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Also, someone did manage to investigate and identify a likely cause:

https://bugs.python.org/issue33608#msg342791

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37127>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:24:13 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 01 Jun 2019 19:24:13 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559417053.68.0.544689866918.issue37111@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Different people have different ideas of what a default should be. You can pretty much guarantee that whatever a default is, someone will think it should be something else. The basicConfig functionality has been around in its present form since 2003, and people in general haven't had a problem with the current defaults. There is no case for changing a default unless there is a consensus among lots of people that a default needs changing.

----------
stage: resolved -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:28:02 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 19:28:02 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559417282.46.0.587833376501.issue37126@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

?ukasz, this PR will fix the x86 Gentoo Refleaks 3.x and friends, so I would recommend landing this before the release.

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:29:52 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 19:29:52 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559417392.17.0.341636484413.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

That's really helpful, Pavel!  Thanks for investigating so thoroughly.  I'm going to double check all the places I've made the assumption that "tstate" isn't NULL and likewise for "tstate->interp".

Is there an issue open for the bug in multiprocessing?  If not, would you mind opening one?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:32:35 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 19:32:35 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559417555.04.0.0293341877325.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

I've made a few tweaks and Victor did some cleanup, so I'm going to try the PR again.  At first I'm also going to disable the _PyEval_FinishPendingCalls() call in _Py_FinalizeEx() and then enable it is a separate PR.

Also, I've opened bpo-37127 specifically to track the problem with _PyEval_FinishPendingCalls() during _Py_FinalizeEx(), to ensure that the disabled call doesn't slip through the cracks. :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:49:35 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 19:49:35 +0000
Subject: [issue32515] Add an option to trace to run module as a script
In-Reply-To: <1515358727.93.0.467229070634.issue32515@psf.upfronthosting.co.za>
Message-ID: <1559418575.97.0.137388301935.issue32515@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32515>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:50:43 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sat, 01 Jun 2019 19:50:43 +0000
Subject: [issue36885] Make makeunicode.py script more readable
In-Reply-To: <1557558491.4.0.613612433422.issue36885@roundup.psfhosted.org>
Message-ID: <1559418643.13.0.924897396568.issue36885@roundup.psfhosted.org>


Change by Stefan Behnel <stefan_ml at behnel.de>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36885>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:55:22 2019
From: report at bugs.python.org (Paul Moore)
Date: Sat, 01 Jun 2019 19:55:22 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559418922.45.0.236583342508.issue37111@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

> User would like Python logging of Unicode characters to be consistent

It is consistent. The encoding of

    logging.basicConfig(filename='c:\\my_log.log')

is consistent with the encoding of

    open('c:\\my_log.log')

Both use the system default encoding, which is not UTF-8. There is some discussion going on right now, as to whether it *should* be, but it isn't, and I wouldn't consider changing the behaviour of loging *without* changing the behaviour of open() to be consistent.

Logging to the console is consistent with the standard IO streams, and it was PEP 528 (https://www.python.org/dev/peps/pep-0528/) that made that change - before that, the standard IO streams, and logging to the console, used the console codepage.

So, while I agree that the behaviour takes a bit of work to understand, it's not (IMO) inconsistent, nor is it (IMO) a bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sat Jun  1 15:57:58 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 19:57:58 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559419078.57.0.496644246277.issue35431@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13614
pull_request: https://github.com/python/cpython/pull/13731

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:01:21 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:01:21 +0000
Subject: [issue5680] Command-line arguments when running in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559419281.84.0.633327794358.issue5680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Can be bump this up in priority?  The patch has been awaiting review for a good while.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:08:35 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 20:08:35 +0000
Subject: [issue37125] math.comb is leaking references
In-Reply-To: <1559406677.46.0.632223828362.issue37125@roundup.psfhosted.org>
Message-ID: <1559419715.45.0.478929901281.issue37125@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Fixed by https://github.com/python/cpython/pull/13725

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37125>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:13:40 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:13:40 +0000
Subject: [issue29882] Add an efficient popcount method for integers
In-Reply-To: <1490203842.58.0.276315183014.issue29882@psf.upfronthosting.co.za>
Message-ID: <1559420020.23.0.0287950053248.issue29882@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Is everyone comfortable with how negative numbers are handled by this patch?  It might be better to limit the domain and raise a ValueError rather than make a presumption about what the user intends.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29882>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:16:20 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 20:16:20 +0000
Subject: [issue29882] Add an efficient popcount method for integers
In-Reply-To: <1490203842.58.0.276315183014.issue29882@psf.upfronthosting.co.za>
Message-ID: <1559420180.35.0.568848544648.issue29882@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am going to add the imath module. If we decide to add popcount(), it may be better to add it in this module instead of int class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29882>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:18:51 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 20:18:51 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1559420331.46.0.75834623689.issue36842@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 3b57f50efc16c65df96914ec53bc8d3dc28e18b6 by Pablo Galindo in branch 'master':
bpo-36842: Pass positional only parameters to code_new audit hook (GH-13707)
https://github.com/python/cpython/commit/3b57f50efc16c65df96914ec53bc8d3dc28e18b6


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:20:53 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:20:53 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559420453.17.0.377305396021.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Why do we want __index__ support?  This seems like an unnecessary extension without relevant use cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:23:38 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 20:23:38 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559420618.0.0.946586556892.issue35431@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

NumPy integer types are not subclasses of int.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:26:09 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:26:09 +0000
Subject: [issue37125] math.comb is leaking references
In-Reply-To: <1559406677.46.0.632223828362.issue37125@roundup.psfhosted.org>
Message-ID: <1559420769.63.0.989030836292.issue37125@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Please file this in the tracker issue so that the discussions don't sprawl.  Thx.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37125>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:31:46 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 20:31:46 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559421106.34.0.151176756502.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I'd expect any math module function accepting integers to be sufficiently duck-typed to accept integer-like things (i.e., objects that implement `__index__`), in just the same way that the regular math module functions (sin, log, atan, sqrt, ...) accept arbitrary objects defining `__float__`. We already do this for gcd, factorial.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:32:21 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:32:21 +0000
Subject: [issue34303] micro-optimizations in functools.reduce()
In-Reply-To: <1533100143.91.0.56676864532.issue34303@psf.upfronthosting.co.za>
Message-ID: <1559421141.23.0.0261704894537.issue34303@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset e5f6207ba6cb510d9370519ba869296be01787be by Raymond Hettinger (Sergey Fedoseev) in branch 'master':
bpo-34303: Micro-optimizations in functools.reduce() (GH-8598)
https://github.com/python/cpython/commit/e5f6207ba6cb510d9370519ba869296be01787be


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34303>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:32:46 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:32:46 +0000
Subject: [issue34303] micro-optimizations in functools.reduce()
In-Reply-To: <1533100143.91.0.56676864532.issue34303@psf.upfronthosting.co.za>
Message-ID: <1559421166.14.0.628030130894.issue34303@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34303>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:34:42 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 20:34:42 +0000
Subject: [issue29882] Add an efficient popcount method for integers
In-Reply-To: <1490203842.58.0.276315183014.issue29882@psf.upfronthosting.co.za>
Message-ID: <1559421282.43.0.39503669671.issue29882@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> Is everyone comfortable with how negative numbers are handled by this patch?

Not entirely, but it's not terribly wrong and it's consistent with how `int.bit_length` works. (I'm also a bit uncomfortable about `int.bit_length`s behaviour on negative numbers, but it is the way it is.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29882>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:35:32 2019
From: report at bugs.python.org (Tim Peters)
Date: Sat, 01 Jun 2019 20:35:32 +0000
Subject: [issue29882] Add an efficient popcount method for integers
In-Reply-To: <1490203842.58.0.276315183014.issue29882@psf.upfronthosting.co.za>
Message-ID: <1559421332.55.0.166534933022.issue29882@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I prefer that a negative int raise ValueError, but am OK with it using the absolute value instead (i.e., what it does now).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29882>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:35:34 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 20:35:34 +0000
Subject: [issue29882] Add an efficient popcount method for integers
In-Reply-To: <1490203842.58.0.276315183014.issue29882@psf.upfronthosting.co.za>
Message-ID: <1559421334.93.0.131719928311.issue29882@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> I am going to add the imath module.

Aimed at 3.8, or 3.9? This seems somewhat rushed for 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29882>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:46:10 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 20:46:10 +0000
Subject: [issue26791] shutil.move fails to move symlink (Invalid cross-device
 link)
In-Reply-To: <1460912297.17.0.227992133358.issue26791@psf.upfronthosting.co.za>
Message-ID: <1559421970.93.0.319678554019.issue26791@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26791>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:47:29 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 20:47:29 +0000
Subject: [issue37128] Add math.perm()
Message-ID: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

The function which returns the number of ways to choose k items from n items without repetition and without order was added in issue35431. This functions is always goes in pair with other function, which returns the number of ways to choose k items from n items without repetition and with order. These functions are always learned together in curses of combinatorics. Often C(n,k) is determined via P(n,k) (and both are determined via factorial).

    P(n, k) = n! / (n-k)!
    C(n, k) = P(n, k) / k!

The proposed PR adds meth.perm(). It shares most of the code with math.comb().

----------
components: Library (Lib)
messages: 344226
nosy: lemburg, mark.dickinson, serhiy.storchaka, stutzbach
priority: normal
severity: normal
status: open
title: Add math.perm()
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:49:09 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:49:09 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559422149.16.0.736475519772.issue37128@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

+0 from me.  It is inevitable that this will be requested now that we have comb().  The need for this is much less though.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:49:22 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 20:49:22 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559422162.73.0.749731734093.issue37128@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +13615
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13731

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:52:11 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 01 Jun 2019 20:52:11 +0000
Subject: [issue26468] shutil.copy2 raises OSError if filesystem doesn't
 support chmod
In-Reply-To: <1456910519.95.0.44073308632.issue26468@psf.upfronthosting.co.za>
Message-ID: <1559422331.25.0.980642872874.issue26468@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26468>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:54:40 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 20:54:40 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559422480.66.0.114515686992.issue37128@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> +0 from me.  It is inevitable that this will be requested now that we have comb().

Exactly my thoughts, too. I don't think I'll have any use for `math.perm`; the main reason to add it will be to satisfy all those who got taught combinations and permutations at the same time, see them as a unit, and then get surprised when they find `math.comb` without `math.perm`.

The good part is that now that we have math.comb, I think everything about the API of math.perm is already clear (including what to call it).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:56:05 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:56:05 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559422565.83.0.488897536904.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Mark, please see:  https://twitter.com/daveinstpaul/status/1134919179361034240

What are your thoughts?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 16:58:07 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 20:58:07 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559422687.25.0.406921401373.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

One other idea: it may be worth putting in an alias for "binomial" to improve findability and readability in contexts where a person really does what binomial coefficients and is not otherwise thinking about counting contexts.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:01:20 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 01 Jun 2019 21:01:20 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559422880.65.0.0398578691282.issue35431@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Just a heads up from issue37125: The leak is was fixed by PR13725.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:02:47 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 21:02:47 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559422967.55.0.941580406754.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> What are your thoughts?

Sigh. I don't object to extending to `k < 0` and `k > n`, but once we've made that extension it's impossible to undo if we decide we'd rather have had the error checking. I'd really like to see some convincing use-cases. Quotes from Concrete Mathematics (fine book though it is) don't amount to use-cases.

I'd say leave it as-is for 3.8, see what the reaction is, and maybe relax constraints in 3.9 if that seems appropriate. But if a majority of others really want to make the change now, that's okay with me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:03:25 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 01 Jun 2019 21:03:25 +0000
Subject: [issue32411] Idlelib.browser: stop sorting dicts created by pyclbr
In-Reply-To: <1513996869.13.0.213398074469.issue32411@psf.upfronthosting.co.za>
Message-ID: <1559423005.59.0.666208191804.issue32411@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 1a4d9ffa1aecd7e750195f2be06d3d16c7a3a88f by Terry Jan Reedy (Cheryl Sabella) in branch 'master':
bpo-32411: IDLE: Remove line number sort in browser.py (#5011)
https://github.com/python/cpython/commit/1a4d9ffa1aecd7e750195f2be06d3d16c7a3a88f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:03:45 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 21:03:45 +0000
Subject: [issue32411] Idlelib.browser: stop sorting dicts created by pyclbr
In-Reply-To: <1513996869.13.0.213398074469.issue32411@psf.upfronthosting.co.za>
Message-ID: <1559423025.91.0.563417710376.issue32411@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13616
pull_request: https://github.com/python/cpython/pull/13732

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:05:50 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 01 Jun 2019 21:05:50 +0000
Subject: [issue20092] type() constructor should bind __int__ to __index__ when
 __index__ is defined and __int__ is not
In-Reply-To: <1388260592.79.0.323683192221.issue20092@psf.upfronthosting.co.za>
Message-ID: <1559423150.7.0.370938012326.issue20092@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset bdbad71b9def0b86433de12cecca022eee91bd9f by Serhiy Storchaka in branch 'master':
bpo-20092. Use __index__ in constructors of int, float and complex. (GH-13108)
https://github.com/python/cpython/commit/bdbad71b9def0b86433de12cecca022eee91bd9f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20092>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:10:24 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 21:10:24 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559423424.7.0.59183502409.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> I'd say leave it as-is for 3.8, see what the reaction is, 
> and maybe relax constraints in 3.9 if that seems appropriate.

I concur.  That said, the referenced tweet was a reaction :-)

FWIW, itertools.combinations(seq, r) returns 0 values when r > len(seq).

Tim, what do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:10:52 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 01 Jun 2019 21:10:52 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559423452.64.0.251037048416.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I'm particularly sceptical about real-world use-cases for k < 0. Maybe we should consider removing just the k > n requirement.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:11:50 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 21:11:50 +0000
Subject: [issue29414] Change 'the for statement is such an iterator' in
 Tutorial
In-Reply-To: <1485976216.65.0.169866413965.issue29414@psf.upfronthosting.co.za>
Message-ID: <1559423510.84.0.621116963958.issue29414@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 218e47b61862470477922e9aba1a23fd3dab18ae by Raymond Hettinger (Marco Buttu) in branch 'master':
bpo-29414: Change 'the for statement is such an iterator' in Tutorial (GH-273)
https://github.com/python/cpython/commit/218e47b61862470477922e9aba1a23fd3dab18ae


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29414>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:12:13 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 21:12:13 +0000
Subject: [issue29414] Change 'the for statement is such an iterator' in
 Tutorial
In-Reply-To: <1485976216.65.0.169866413965.issue29414@psf.upfronthosting.co.za>
Message-ID: <1559423533.3.0.991567726619.issue29414@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29414>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:15:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 21:15:26 +0000
Subject: [issue34722] Non-deterministic bytecode generation
In-Reply-To: <1537278827.47.0.956365154283.issue34722@psf.upfronthosting.co.za>
Message-ID: <1559423726.47.0.290633889702.issue34722@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Bumping up the priority a bit on this one.  It would be nice to get it in for 3.8.

----------
priority: normal -> high
versions: +Python 3.8 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34722>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:19:47 2019
From: report at bugs.python.org (Tim Peters)
Date: Sat, 01 Jun 2019 21:19:47 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559423987.0.0.601596370725.issue35431@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Strongly prefer requiring 0 <= k <= n at first.  This is a programming language:  it will be applied to real problems, not to abstract proofs where some slop can be helpful in reducing the number of cases that need to be considered.

The Twitter fellow is certainly right that "0" is the clear answer to "how many 5-element subsets does have a 4-element set have?", but in the context of real problems it's more likely (to my eyes) that a programmer asking that question of `comb()` has gotten confused.  It certainly would have been "an error" in any programming use for `comb()` I've ever had.

Raymond, I'm not clear on what you mean by "alias".  You mean supplying the same function under more than one name?  I'd be -1 on that (where would it end?  the answer to every future name bikeshedding issue then would be "all of the above").  But +1 on, e.g., adding a doc index entry for "binomial" pointing to "comb".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:26:34 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 01 Jun 2019 21:26:34 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559424394.23.0.968607333459.issue35431@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13617
pull_request: https://github.com/python/cpython/pull/13734

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:39:49 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 21:39:49 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559425189.75.0.888990179238.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:


New changeset 6a150bcaeb190d1731b38ab9c7a5d1a352847ddc by Eric Snow in branch 'master':
bpo-33608: Factor out a private, per-interpreter _Py_AddPendingCall(). (gh-13714)
https://github.com/python/cpython/commit/6a150bcaeb190d1731b38ab9c7a5d1a352847ddc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:51:52 2019
From: report at bugs.python.org (Michal)
Date: Sat, 01 Jun 2019 21:51:52 +0000
Subject: [issue37129] Add RWF_APPEND flag
Message-ID: <1559425912.96.0.374088169798.issue37129@roundup.psfhosted.org>


Change by Michal <bezoka at bezoka.pl>:


----------
components: Library (Lib)
nosy: bezoka, pablogsal, vstinner
priority: normal
severity: normal
status: open
title: Add RWF_APPEND flag
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37129>
_______________________________________

From report at bugs.python.org  Sat Jun  1 17:52:32 2019
From: report at bugs.python.org (Michal)
Date: Sat, 01 Jun 2019 21:52:32 +0000
Subject: [issue37129] Add RWF_APPEND flag
Message-ID: <1559425952.87.0.398536904195.issue37129@roundup.psfhosted.org>


Change by Michal <bezoka at bezoka.pl>:


----------
keywords: +patch
pull_requests: +13618
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13735

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37129>
_______________________________________

From report at bugs.python.org  Sat Jun  1 18:26:03 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 01 Jun 2019 22:26:03 +0000
Subject: [issue32411] Idlelib.browser: stop sorting dicts created by pyclbr
In-Reply-To: <1513996869.13.0.213398074469.issue32411@psf.upfronthosting.co.za>
Message-ID: <1559427963.37.0.0632554086124.issue32411@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ac60d1afd2b04f61fe4c965740fa32809f2b84ed by Miss Islington (bot) in branch '3.7':
bpo-32411: IDLE: Remove line number sort in browser.py (GH-5011)
https://github.com/python/cpython/commit/ac60d1afd2b04f61fe4c965740fa32809f2b84ed


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 18:28:07 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 01 Jun 2019 22:28:07 +0000
Subject: [issue32411] Idlelib.browser: stop sorting dicts created by pyclbr
In-Reply-To: <1513996869.13.0.213398074469.issue32411@psf.upfronthosting.co.za>
Message-ID: <1559428087.8.0.864798186027.issue32411@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

yes ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32411>
_______________________________________

From report at bugs.python.org  Sat Jun  1 18:37:31 2019
From: report at bugs.python.org (David Radcliffe)
Date: Sat, 01 Jun 2019 22:37:31 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559428651.33.0.42234840663.issue35431@roundup.psfhosted.org>


David Radcliffe <dradcliffe at gmail.com> added the comment:

I think that binomial(n, k) should return 0 when k > n or k < 0. This is a practical consideration. I'm concerned about evaluating sums involving binomial coefficients. Mathematicians are often rather loose about specifying the upper and lower bounds of summation, because the unwanted terms are zero anyway. These formulas should not result in value errors when they are implemented directly.

To give a simplistic example, the sum of the first n positive integers is binomial(n+1, 2), and the formula should still work if n is zero.

----------
nosy: +David Radcliffe

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sat Jun  1 19:16:53 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 23:16:53 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559431013.87.0.779898930754.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

So far so good. :)  I'll keep an eye on things and if the buildbots are still happy then I'll add back _PyEval_FinishPendingCalls() in _Py_FinalizeEx() in a few days.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 19:32:41 2019
From: report at bugs.python.org (Eric Snow)
Date: Sat, 01 Jun 2019 23:32:41 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559431961.17.0.639232739651.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

FYI, after merging that PR I realized that the COMPUTE_EVAL_BREAKER macro isn't quite right.  While the following scenario worked before, now it doesn't:

1. interpreter A: _PyEval_AddPendingCall() causes the global
   eval breaker to be set
2. interpreter B: the next pass through the eval loop uses
   COMPUTE_EVAL_BREAKER; it has no pending calls so the global
   eval breaker is unset
3. interpreter A: the next pass through the eval loop does not
   run the pending call because the eval breaker is no longer set

This really isn't a problem because the eval breaker is triggered for the GIL pretty frequently.  Furthermore, it won't be a problem once the GIL is per-interpreter (at which point we will switch to a per-interpreter eval breaker).

If it is important enough then I can fix it.  I even wrote up a solution. [1]  However, I'd rather leave it alone (hence no PR).  The alternatives are more complicated and the situation should be relatively short-lived.

FWIW, in addition to the solution I mentioned above, I tried a few other ways:

* have a per-interpreter eval breaker in addition to the global one
* have only a per-interpreter eval breaker (the ultimate objective)
* consolidate the pending calls for every interpreter every time
  UNSIGNAL_PENDING_CALLS and UNSIGNAL_ASYNC_EXC are used

However, each has performance penalties while the branch I created does not.  I try to be really careful when it comes to the performance of the eval loop. :)

[1] https://github.com/ericsnowcurrently/cpython/tree/eval-breaker-shared

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sat Jun  1 20:07:20 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Sun, 02 Jun 2019 00:07:20 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1559434040.77.0.43284750444.issue36985@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

Guido, I remember you were against exposing `ForwardRef` as public at some point, but recently you approved https://github.com/python/cpython/pull/13456 that added it to `typing.__all__`. I don't have any particular opinion on this, but if you don't object, I think it would make sense to add a short section about this to the docs, since it may be exposed at runtime, e.g. in `List['Cls']`.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Sat Jun  1 20:14:56 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 00:14:56 +0000
Subject: [issue36984] typing docs "versionadded" is inaccurate for many
 attributes
In-Reply-To: <1558416035.31.0.248938950481.issue36984@roundup.psfhosted.org>
Message-ID: <1559434496.3.0.92226350951.issue36984@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13620
pull_request: https://github.com/python/cpython/pull/13737

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36984>
_______________________________________

From report at bugs.python.org  Sat Jun  1 20:15:09 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 00:15:09 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559434509.19.0.72257617941.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

3 recent 'doit' requests (2 on PR 1589) raise my priority for this issue.

When a user runs a file from an editor, IDLE simulates, as well as it can, the user entering 'python -i path' in a system command line shell.   Both on a command line and in IDLE, the program starts with sys.argv = ['path'] (at least on my Windows system).  This can be shown by running a file with 'import sys; print(sys.path)' both ways.

The request for this issue is to simulate 'python -i path a1, a2, ...'.
The program should start with sys.argv = ['path', 'a1', 'a2', '...'], with the argument strings being the same as they would be if entered at a command line on the *same system*.

I have looked at least a bit at all 4 patches and have decided to start fresh, using just a few existing lines.  The latest of the 4 was submitted 2 years ago, while I was learning to use git.

By the following September, using config-extensions was obsolete.  *If* we want to save a command string across sessions, a line could be added to config-main.  But I am dubious about this.  I expect that users will want to vary argument values for 1 program and need different sets of arguments for different programs.


I want to use a subclass of idlelib.query.Query for the query box.  No need to reinvent it.

I believe that argument strings should be parsed into an argument list using shlex.split.  No need to reinvent that either.  But I am not an expert in this area and the doc it rather vague.  I suspect that 'posix=False' should be used on Windows.  Does anyone know?  Gabriel's patch is the only one using shlex.split, but always with the default 'posix=True'.

Saimadhav tested his patch on Debian.  The others did not say.  A verified-by-human htest should be added to runscript.py, and manual test running 'import sys; print(sys.argv)' from an editor done on the 3 major OSes.

----------
stage: patch review -> needs patch
title: Command-line arguments when running in IDLE -> Simulate command-line arguments for program run in IDLE
versions: +Python 3.8 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 20:25:05 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Sun, 02 Jun 2019 00:25:05 +0000
Subject: [issue36984] typing docs "versionadded" is inaccurate for many
 attributes
In-Reply-To: <1558416035.31.0.248938950481.issue36984@roundup.psfhosted.org>
Message-ID: <1559435105.76.0.780081619171.issue36984@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36984>
_______________________________________

From report at bugs.python.org  Sat Jun  1 20:37:13 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sun, 02 Jun 2019 00:37:13 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559435833.63.0.420887024955.issue5680@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

I'll can work on a PR for this, unless you want to do it based on your research.

----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 21:13:40 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 01:13:40 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559438020.61.0.397254675825.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

When running IDLE normally, with a subprocess, it would be possible to pass arguments to python itself when IDLE restarts the user process (with
shell.restart_shell()).  That would be another issue.  We would have to look at whether any options would disable idlelib.run and how running code supervised might change results.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 21:18:12 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Sun, 02 Jun 2019 01:18:12 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
Message-ID: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>


New submission from N.P. Khelili <nophke at free.fr>:

Hi guys!

I'm new to python and working on my first real project with it....
I'm sorry if it's not the right place for posting this.

I noticed that that pathlib.with_name() method does not accept to give a name to a path that does not already have one.

It seems a bit inconsistent knowing that the Path constructor does not require one...

>>> Path()
PosixPath('.')

>>> Path().resolve()
PosixPath('/home/nono')

but:
 
>>> Path().with_name('dodo')

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.7/pathlib.py", line 819, in with_name
    raise ValueError("%r has an empty name" % (self,))
ValueError: PosixPath('.') has an empty name

whereas if you do:

>>> Path().resolve().with_name('dodo')
PosixPath('/home/dodo')

I first tought "explicit is better than implicit" and then why not allways use resolve first! That was not a big deal but then I tried:

>>> Path('..').with_name('dudu').resolve()
PosixPath('/home/nono/dudu')

( ! )

>>> Path('..').resolve().with_name('dudu')
PosixPath('/dudu')

It seems that the dots and slashes are in fact not really interpreted leading to:

>>> Path('../..').with_name('dudu')
PosixPath('../dudu')

>>> Path('../..').with_name('dudu').resolve()
PosixPath('/home/dudu')

( ! )
 
>>> Path('../..').resolve().with_name('dudu')

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.7/pathlib.py", line 819, in with_name
    raise ValueError("%r has an empty name" % (self,))
ValueError: PosixPath('/') has an empty name

Even if the doc briefly tells about this, I found this behavior quite disturbing....

I don't know what could be the correct answer to this,
maybe making Path('..') as invalid as Path('.'),
or adding a few more lines in the doc...

Sincerly yours,

----------
components: Library (Lib)
messages: 344250
nosy: Nophke
priority: normal
severity: normal
status: open
title: pathlib.with_name() doesn't like unnamed files.
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Sat Jun  1 21:20:53 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 01:20:53 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559438453.54.0.335802186596.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

My suspicion about posix=False was wrong.

>>> shlex.split(''' 1 "'a' 'b'" ''', posix=False)
['1', '"\'a\' \'b\'"']  # len(...[1]) = 9
>>> shlex.split(''' 1 '"a" "b"' ''')
['1', '"a" "b"']  # len = 7
f:\dev\3x>py -c "import sys; print(sys.argv)" 1 "'a' 'b'"
['-c', '1', "'a' 'b'"]  # Matches 'True'

>>> shlex.split(''' 1 '"a" "b"' ''', posix=False)
['1', '\'"a" "b"\'']
>>> shlex.split(''' 1 '"a" "b"' ''')
['1', '"a" "b"']  # Similar difference
f:\dev\3x>py -c "import sys; print(sys.argv)" 1 '"a" "b"'
['-c', '1', "'a", "b'"]  # crazy inversion and 3 args, matches neither

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 21:37:19 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 01:37:19 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559439439.13.0.696459641267.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Cheryl, go ahead after reading the notes above.  Use an f-string for the runcommand argument and remember that it is run within the pristine user environment.  Otherwise, let's start with minimal changes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sat Jun  1 22:38:21 2019
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 02 Jun 2019 02:38:21 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559443101.7.0.947808525505.issue36839@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> And I understood that Dino proposed to share one code instance as a memory mapped file for *all* processes.

What instance means?  code object? co_code?
Anyway, Dino didn't propose such thing.  He only proposed accepting buffer object for code constructor.
He didn't describe how to use buffer object.  Python doesn't provide share buffer object inter processes.

There are no enough concrete information for estimate benefits.
We're discussing imagination, not concrete idea.

Let's stop discuss more, and wait Dino provide concrete example which can be used to estimate benefits.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sat Jun  1 22:40:43 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 02 Jun 2019 02:40:43 +0000
Subject: [issue35964] shutil.make_archive (xxx, tar,
 root_dir) is adding './' entry to archive which is wrong
In-Reply-To: <1549888846.57.0.721579437713.issue35964@roundup.psfhosted.org>
Message-ID: <1559443243.44.0.823278203912.issue35964@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +13621
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13738

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35964>
_______________________________________

From report at bugs.python.org  Sat Jun  1 22:45:22 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 02 Jun 2019 02:45:22 +0000
Subject: [issue35964] shutil.make_archive (xxx, tar,
 root_dir) is adding './' entry to archive which is wrong
In-Reply-To: <1549888846.57.0.721579437713.issue35964@roundup.psfhosted.org>
Message-ID: <1559443522.41.0.0744971372706.issue35964@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

I submitted a pull request that excludes '.' directory entries when adding directories to a tar archive.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35964>
_______________________________________

From report at bugs.python.org  Sun Jun  2 01:58:22 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 02 Jun 2019 05:58:22 +0000
Subject: [issue32865] os.pipe creates inheritable FDs with a bad internal
 state on Windows
In-Reply-To: <1518882714.97.0.467229070634.issue32865@psf.upfronthosting.co.za>
Message-ID: <1559455102.84.0.397040745882.issue32865@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13622
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13739

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32865>
_______________________________________

From report at bugs.python.org  Sun Jun  2 02:08:31 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 06:08:31 +0000
Subject: [issue36781] Optimize sum() for bools
In-Reply-To: <1556876973.98.0.990157093134.issue36781@roundup.psfhosted.org>
Message-ID: <1559455711.35.0.473338525017.issue36781@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am not sure that this optimization should be added. sum(pred(x) for x in data) will be always slower than sum(1 for x in data if pred(x)) because more items is passed to sun() in the former case. It can be considered as an anti-pattern.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36781>
_______________________________________

From report at bugs.python.org  Sun Jun  2 02:15:24 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 06:15:24 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559456124.77.0.985218383015.issue36839@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The managed buffer can be shared if it refers to the same bytes. But different code objects in the same process refer to different bytes, therefore they should have distinct managed buffers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sun Jun  2 03:38:22 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 02 Jun 2019 07:38:22 +0000
Subject: [issue1438480] shutil.move raises OSError when copystat fails
Message-ID: <1559461102.45.0.774199083563.issue1438480@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1438480>
_______________________________________

From report at bugs.python.org  Sun Jun  2 03:41:56 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 07:41:56 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559461316.0.0.774721961709.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

@David Ratcliffe

> the sum of the first n positive integers is binomial(n+1, 2), and the formula should still work if n is zero.

I agree that's a convincing use-case.

Can you think of any practical uses for allowing negative `k`? I can't.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 03:43:36 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 07:43:36 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559461416.22.0.00430568926377.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> @David Ratcliffe

Radcliffe! Apologies for the misspelling. It's still early in this timezone and I haven't had any coffee yet.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 04:17:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 08:17:04 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559463424.46.0.255655740138.issue37128@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 5ae299ac78abb628803ab7dee0997364547f5cc8 by Serhiy Storchaka in branch 'master':
bpo-37128: Add math.perm(). (GH-13731)
https://github.com/python/cpython/commit/5ae299ac78abb628803ab7dee0997364547f5cc8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sun Jun  2 04:53:34 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 08:53:34 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559465614.71.0.765601980685.issue37128@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sun Jun  2 04:53:41 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 08:53:41 +0000
Subject: [issue37128] Add math.perm()
In-Reply-To: <1559422049.94.0.857716315829.issue37128@roundup.psfhosted.org>
Message-ID: <1559465621.32.0.896610996582.issue37128@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37128>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:10:40 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 09:10:40 +0000
Subject: [issue36879] bug with round() and "numpy floats"
In-Reply-To: <1557521461.62.0.231118714409.issue36879@roundup.psfhosted.org>
Message-ID: <1559466640.1.0.776281395934.issue36879@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
resolution:  -> third party
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36879>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:24:09 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 09:24:09 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559467449.09.0.223110054675.issue36027@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:


New changeset c52996785a45d4693857ea219e040777a14584f8 by Mark Dickinson in branch 'master':
bpo-36027: Extend three-argument pow to negative second argument (GH-13266)
https://github.com/python/cpython/commit/c52996785a45d4693857ea219e040777a14584f8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:25:02 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 09:25:02 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559467502.97.0.407208085846.issue36027@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Done. Closing.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:32:08 2019
From: report at bugs.python.org (Stefan Krah)
Date: Sun, 02 Jun 2019 09:32:08 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559467928.57.0.116015194278.issue36839@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

On Sun, Jun 02, 2019 at 02:38:21AM +0000, Inada Naoki wrote:
> What instance means?  code object? co_code?
> Anyway, Dino didn't propose such thing.  He only proposed accepting buffer object for code constructor.
> He didn't describe how to use buffer object.  Python doesn't provide share buffer object inter processes.

He did, at a high level. in the original mail:

"If code objects supported the buffer protocol it would be possible to load
 code from a memory mapped file which is shared across all of the processes."


It is not very detailed, but gives the rationale.  I assumed that the
new shared memory support would be used, but it would be nice to hear
more details.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:39:49 2019
From: report at bugs.python.org (Terji)
Date: Sun, 02 Jun 2019 09:39:49 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
Message-ID: <1559468389.01.0.935675553387.issue37131@roundup.psfhosted.org>


New submission from Terji <Terji78 at yahoo.com>:

Checking if a range's items are ll truthy can be done y checking if 0 the range contains 0, however currently Python iterates over the range, making the operation slower than needed.

    >>> rng = range(1, 1_000_000)
    >>> timeit all(rng)
    19.9 ms ? 599 ?s per loop

If the all function could special case range, this could be like made fast like this:

    if isinstance(obj, range):
        if 0 in obj:
            return False
        return True

----------
components: Interpreter Core
messages: 344263
nosy: Petersen
priority: normal
severity: normal
status: open
title: all(range()...)) is needlessley slow
type: performance
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 05:58:04 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 02 Jun 2019 09:58:04 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
In-Reply-To: <1559468389.01.0.935675553387.issue37131@roundup.psfhosted.org>
Message-ID: <1559469484.67.0.591441021466.issue37131@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Why should ``all()`` special case ``range``? Apart from showing off benchmarks, what's the point?

Should ``any()`` also special case it? How about other lazy sequences and computed iterables, such as itertools.count objects, itertools.cycle objects, itertools.repeat objects, etc? How many special cases do we want?

Personally, I don't *necessarily* oppose special-casing types, but it breaks the independence of types, and couples the all() function and the range() function. To be worth doing, we should get some practical benefit out of it. It isn't clear what that benefit is.

Don't get me wrong, its not like I *want* all(range(1, 10**10)) to be slow. But nor do I want to couple the all() function to the range function and complicate the implementation if there is no corresponding benefit. After all, testing with all() is fundamentally an O(N) worst case operation so anything better than that is a nice surprise.

If there were special dunders __all__ and __any__ it would be easy to encapsulate this behaviour inside the range objects themselves, and neither any() nor all() would need to know anything about range objects.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:25:22 2019
From: report at bugs.python.org (Terji)
Date: Sun, 02 Jun 2019 10:25:22 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
In-Reply-To: <1559468389.01.0.935675553387.issue37131@roundup.psfhosted.org>
Message-ID: <1559471122.88.0.327136075482.issue37131@roundup.psfhosted.org>


Terji <Terji78 at yahoo.com> added the comment:

>> Why should ``all()`` special case ``range``? Apart from showing off benchmarks, what's the point?

Mostly to avoid silly mistakes, and the overhead of doing it would be very small, so a very small trade-off.

>> Should ``any()`` also special case it?

No, ``any()``takes at most two iterations to check truthiness in a ``range()``, so that's wouldn't be needed.

>> How about other lazy sequences and computed iterables, such as itertools.count objects, itertools.cycle objects, itertools.repeat objects, etc? How many special cases do we want?


No, I wouldn't propose that. The argument would be that those are iterators/generators while ``range()`` is special-cased built-in sequence with known properties.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:27:17 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 10:27:17 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559471237.66.0.182013088254.issue17576@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I'm working on a PR that finally changes the DeprecationWarnings that Serhiy introduced to TypeErrors; I think that should be acceptable, four Python versions and some years later. With that PR:

- int will always return something of exact type `int` (or raise)
- operator.index will always return something of exact type `int` (or raise)
- PyNumber_Index will always use `__index__` for int subclasses, so this should fix the issue that Barry originally reported (mismatch between `obj.__index__()` and `operator.index(obj)`).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:30:44 2019
From: report at bugs.python.org (Terji)
Date: Sun, 02 Jun 2019 10:30:44 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
In-Reply-To: <1559468389.01.0.935675553387.issue37131@roundup.psfhosted.org>
Message-ID: <1559471444.51.0.271430280205.issue37131@roundup.psfhosted.org>


Terji <Terji78 at yahoo.com> added the comment:

>> If there were special dunders __all__ and __any__ it would be easy to encapsulate this behaviour inside the range objects themselves, and neither any() nor all() would need to know anything about range objects.

This sounds very interesting, and more general. It would be useful for e.g. numpy arrays, where ``all(arr)`` currently is slower than ``arr.all()``. Don't know it there's a reason it wasn't implemented this way originally?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:37:37 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 02 Jun 2019 10:37:37 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
In-Reply-To: <1559471122.88.0.327136075482.issue37131@roundup.psfhosted.org>
Message-ID: <20190602103728.GU4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> >> Why should ``all()`` special case ``range``? Apart from showing off benchmarks, what's the point?
> 
> Mostly to avoid silly mistakes

What sort of silly mistakes?

> and the overhead of doing it would be very small, so a very small trade-off.

Its not just the overhead, its the coupling between two chunks of code 
which should be independent.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:46:42 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 10:46:42 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559472402.09.0.271020602945.issue17576@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
assignee: ethan.furman -> mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:54:57 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 10:54:57 +0000
Subject: [issue37132] Add a module for integer related math functions
Message-ID: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

The math module contains as function for floating-point numbers, as wells as functions for integer only numbers: factorial(), gcd(). Yet few integer specific functions was added in 3.8: isqrt(), perm(), comb().

The proposed PR adds the new imath module, adds into it old functions factorial() and gcd() and moves new functions. It also adds two additional functions: as_integer_ratio() and ilog2().

There are plans for adding more integer functions: divide_and_round(), is_prime(), primes(), but the work in progress.

----------
components: Library (Lib)
messages: 344269
nosy: mark.dickinson, rhettinger, serhiy.storchaka, stutzbach, tim.peters
priority: normal
severity: normal
status: open
title: Add a module for integer related math functions
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:56:11 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 10:56:11 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559472971.65.0.644729907792.issue17576@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
pull_requests: +13623
pull_request: https://github.com/python/cpython/pull/13740

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:56:41 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 10:56:41 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559473001.18.0.383202564667.issue35621@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset 13ed07998ad93dbdd94991ba0451b9b559f07972 by Andrew Svetlov in branch 'master':
bpo-35621: Support running subprocesses in asyncio when loop is executed in non-main thread (#13630)
https://github.com/python/cpython/commit/13ed07998ad93dbdd94991ba0451b9b559f07972


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:57:09 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 10:57:09 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559473029.81.0.0256277828828.issue35621@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 06:58:49 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 10:58:49 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559473129.78.0.642881826132.issue37132@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +13624
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13741

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:01:47 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 11:01:47 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559473307.2.0.118866788397.issue36027@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 13266 introduced a compiler warning.

Objects/longobject.c: In function ?long_invmod?:
Objects/longobject.c:4246:25: warning: passing argument 2 of ?long_compare? from incompatible pointer type [-Wincompatible-pointer-types]
     if (long_compare(a, _PyLong_One)) {
                         ^~~~~~~~~~~
Objects/longobject.c:3057:1: note: expected ?PyLongObject * {aka struct _longobject *}? but argument is of type ?PyObject * {aka struct _object *}?
 long_compare(PyLongObject *a, PyLongObject *b)
 ^~~~~~~~~~~~

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:01:50 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 11:01:50 +0000
Subject: [issue35635] asyncio.create_subprocess_exec() only works in main
 thread
In-Reply-To: <1546394840.15.0.0864584726941.issue35635@roundup.psfhosted.org>
Message-ID: <1559473310.69.0.391500443167.issue35635@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Fixed by #35621

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> asyncio.create_subprocess_exec() only works with main event loop

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35635>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:09:41 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 11:09:41 +0000
Subject: [issue32052] Provide access to buffer of asyncio.StreamReader
In-Reply-To: <1510859388.33.0.213398074469.issue32052@psf.upfronthosting.co.za>
Message-ID: <1559473781.31.0.257800232695.issue32052@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Closing.
Brief:
1. Access to an internal buffer is not an option.
2. Pushing data back to stream after fetching is not an option too: it kills almost any possible optimization and makes code overcomplicated. aiohttp used to have "unread_data()" API but we deprecated it and going to remove the method entirely. A wrapper around the stream with puback functionality is an option though unless it doesn't touch underlying stream implementation.
3. Extending a set of reader operations is a good idea, please make a separate issue with a concrete proposal if needed.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32052>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:10:30 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 11:10:30 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559473830.89.0.622325971573.issue37132@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Some questions:

- What's the plan for the existing functions `math.gcd` and `math.factorial`? Do they eventually get deprecated, or do we keep `gcd` and `factorial` in both `math` and `imath`?

- Does PEP 399 apply here? If so, we'll need a pure Python version as well as a C version

- Should `imath.isqrt` be renamed to `imath.sqrt`?

- What's the actual benefit of this separation?

This feels like a really big change to be making a day before feature freeze; I'm not convinced that we don't need a PEP for this. How bad would it be if we have to defer until 3.9?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:11:42 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 11:11:42 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559473902.93.0.750571890561.issue33694@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13625
pull_request: https://github.com/python/cpython/pull/13630

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:11:49 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 11:11:49 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559473909.82.0.673703627215.issue17576@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am not sure that raising an error is the best option. We can just convert an integer subclass to an exact int using _PyLong_Copy().

I am not sure that converting to an exact int in low-level C API functions is the best option. In many cases we use only the content of the resulting object ignoring its type (when convert it to the C integer or float, to bytes array, to new instance of int subclass). Creating a new exact int is a waste of time.

This is why I withdrawn my patches and this issue is still open.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:14:24 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 11:14:24 +0000
Subject: [issue31087] asyncio.create_subprocess_* should honor `encoding`
In-Reply-To: <1501477317.46.0.791551033282.issue31087@psf.upfronthosting.co.za>
Message-ID: <1559474064.59.0.726176071066.issue31087@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

encoding was explicitly disabled by #36686
Now its usage generates ValueError.

asyncio stdio/stdout/stderr streams are bytes.
If you want to propose a patch that supports text streams -- please create another issue for that.

----------
nosy: +asvetlov
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Docs: asyncio.loop.subprocess_exec documentation is confusing, it's not clear how to inherit stdin, stdout or stderr in the subprocess

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31087>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:14:49 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 11:14:49 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559474089.86.0.770482313099.issue37132@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> Should `imath.isqrt` be renamed to `imath.sqrt`?

On futher reflection, I don't think it should. It's a different function, so it's not like comparing `math.sqrt` and `cmath.sqrt`.

One more: I suggest renaming the new function `ilog` to `ilog2`, for consistency with `math.log` versus `math.log2`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:16:29 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 11:16:29 +0000
Subject: [issue32115] Ignored SIGCHLD causes asyncio.Process.wait to hang
 forever
In-Reply-To: <1511375532.97.0.213398074469.issue32115@psf.upfronthosting.co.za>
Message-ID: <1559474189.93.0.0729238176664.issue32115@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

#35621 fixes the problem for default ThreadedChildWatcher

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> asyncio.create_subprocess_exec() only works with main event loop

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32115>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:25:16 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 11:25:16 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559474716.18.0.768878584457.issue37132@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> What's the plan for the existing functions `math.gcd` and `math.factorial`?

I think they should eventually get deprecated, but with long term of deprecation. Deprecation warning should be added only when imath versions are already available in older Python versions.

But they can be also kept as pure aliases for very long time.

> Does PEP 399 apply here?

There were no Python implementations when these functions was in the math module. But there are Python implementations for all these functions (used in tests or as predecessors), so it is not hard to add them in the stdlib. Easier that to implement math.sin() on Python from scratch.

> Should `imath.isqrt` be renamed to `imath.sqrt`?

I considered this idea and do not have answer.

> What's the actual benefit of this separation?

Currently math becomes a mix of very different functions. Separation will help to keep it simpler (from user and implementation sides). It also adds a place for landing new integer specific functions which are too specific to add them into the math module or into the int class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:26:28 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 11:26:28 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559474788.76.0.170292819268.issue37132@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I think the new `as_integer_ratio` also needs discussion: it was agreed at some point in the past to add `as_integer_ratio` *methods* on all numeric built-in types, and there's a PR for that. Adding `as_integer_ratio` as a new function too seems like two ways to do it.

Please can we defer to 3.9? There just isn't time for the design discussions that are needed, and I'd personally rather see the first version of the `imath` module be somewhat complete, with `is_prime` and `primes` already.

I do realise that from the perspective of adding an `imath` module, the accumulation of integer-based functions in the `math` module is something of a wart that we're making worse in 3.8, but I don't think rushing in this change is the solution.

Radical suggestion: should we consider delaying the inclusions of `comb`, `perm` and `isqrt` in the math module so that we can do this properly for 3.9?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:39:07 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 11:39:07 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559475547.09.0.51301349465.issue37132@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Actually it was ilog2. There was just an error in the documentation.

Currently we have two ways to represent the number as an integer ratio. The official way is two properties numerator and denominator, every number should have them. And some concrete numeric types have the as_integer_ratio() method which returns both values. Rather of adding as_integer_ratio() to all other numeric types I propose to add a helper function which uses either the as_integer_ratio() method if available, or  the numerator and denominator properties. Currently any code that uses the as_integer_ratio() method should implement a fallback to numerator and denominator. With imath.as_integer_ratio() it can just use this function.

> Radical suggestion: should we consider delaying the inclusions of `comb`, `perm` and `isqrt` in the math module so that we can do this properly for 3.9?

I like it. I suggest to delay also adding the int.as_integer_ratio() method. Currently it does not help because there are other numeric methods without the as_integer_ratio() method.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 07:59:57 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 02 Jun 2019 11:59:57 +0000
Subject: [issue37131] all(range()...)) is needlessley slow
In-Reply-To: <1559468389.01.0.935675553387.issue37131@roundup.psfhosted.org>
Message-ID: <1559476797.22.0.531648232037.issue37131@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

You can implement it yourself.

_all = all
def all(obj):
    if isinstance(obj, range):
        return 0 not in obj
    return _all(obj)

I do not see reasons to do this in the stdlib.

----------
nosy: +serhiy.storchaka
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37131>
_______________________________________

From report at bugs.python.org  Sun Jun  2 08:14:18 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 02 Jun 2019 12:14:18 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559477658.94.0.118231914365.issue37132@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I'm pretty much out of core-dev cycles for this weekend; I'm happy to review GH-13741, but won't have time to do so before next weekend.

I'm overall -0 on this change; there's a minor benefit in the separation, but for me it's outweighted by the duplication of `gcd` and `factorial` (or in the case of `gcd`, triplication, since it's also in the `fractions` module).

I'm out of time, so I'll be brief, but if this does go into 3.8, here are my thoughts:

- please remove the imath.as_integer_ratio function; it needs more discussion, and it has quite a different character from the other functions; it's not at all clear to me that it belongs. We might end up putting it back in eventually, but it needs discussion first, and we don't have time for that discussion before feature freeze.
- please add the pure Python version of imath that PEP 399 requires, or get Brett's confirmation that PEP 399 doesn't apply in this case.
- please get agreement from one (preferably both) of Tim and Raymond

Raymond, Tim: thoughts?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 08:37:53 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Sun, 02 Jun 2019 12:37:53 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559479073.26.0.674255431599.issue35621@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

New buildbot failure on koobs-freebsd10 that appears related to (includes) this changeset

Full log attached

----------
nosy: +koobs
Added file: https://bugs.python.org/file48384/koobs-freebsd-10-non-debug-3x-build-1170.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 08:38:10 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Sun, 02 Jun 2019 12:38:10 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559479090.33.0.0665506880127.issue35621@roundup.psfhosted.org>


Change by Kubilay Kocak <koobs.freebsd at gmail.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 09:38:01 2019
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 02 Jun 2019 13:38:01 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559482681.76.0.630211501807.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Well, what about the modification to VIRTUAL_ENV? I think it's little and without harm.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:11:37 2019
From: report at bugs.python.org (=?utf-8?b?5p6X6Ieq5Z2H?=)
Date: Sun, 02 Jun 2019 14:11:37 +0000
Subject: [issue37119] Equality on dict.values() are inconsistent between 2 and
 3
In-Reply-To: <1559362021.42.0.783299654915.issue37119@roundup.psfhosted.org>
Message-ID: <1559484697.88.0.257467374567.issue37119@roundup.psfhosted.org>


??? <johnlinp at gmail.com> added the comment:

Hi Karthikeyan and Serhiy,

Thank you for the explanation. I'll check the references you gave me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37119>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:21:12 2019
From: report at bugs.python.org (=?utf-8?b?0JDQvdC00YDQtdC5INCa0LDQt9Cw0L3RhtC10LI=?=)
Date: Sun, 02 Jun 2019 14:21:12 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
Message-ID: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>


New submission from ?????? ???????? <heckad at yandex.ru>:

Where to get "ffi.h" file?

----------
components: Build
messages: 344287
nosy: heckad
priority: normal
severity: normal
status: open
title: Erro "ffi.h: No such file" when build python 3.8 (branch master) on windows 10
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:22:24 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 02 Jun 2019 14:22:24 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1559485344.06.0.81147397489.issue37133@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:24:28 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 02 Jun 2019 14:24:28 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1559485468.33.0.851904771549.issue37133@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

How are you building python? Have you been following these instructions? https://cpython-core-tutorial.readthedocs.io/en/latest/build_cpython_windows.html

----------
nosy: +SilentGhost

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:45:18 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 14:45:18 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559486718.28.0.835156860499.issue37126@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 7ffcf848df214135abeea7f6c6faa4135fd0928f by Pablo Galindo in branch 'master':
bpo-37126: Allow structseq objects to be tracked by the GC (GH-13729)
https://github.com/python/cpython/commit/7ffcf848df214135abeea7f6c6faa4135fd0928f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:45:33 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 14:45:33 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559486733.05.0.985950973976.issue37126@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 10:51:11 2019
From: report at bugs.python.org (=?utf-8?b?0JDQvdC00YDQtdC5INCa0LDQt9Cw0L3RhtC10LI=?=)
Date: Sun, 02 Jun 2019 14:51:11 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1559487071.61.0.241043220342.issue37133@roundup.psfhosted.org>


?????? ???????? <heckad at yandex.ru> added the comment:

No, I used https://devguide.python.org/setup/ guide. I have downloaded the latest version of Visual Studio 2019 and evaluated in PowerShell "PCBuild\build.bat". After this, I opened "PCBuild\pcbuild.sln" and trying to build "python" solution and run it. Instead of successful build, the build broked.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Sun Jun  2 11:05:21 2019
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sun, 02 Jun 2019 15:05:21 +0000
Subject: [issue37024] SQLite flag in configure due to homebrew not linking
 sqlite
In-Reply-To: <1558632381.76.0.984637995348.issue37024@roundup.psfhosted.org>
Message-ID: <1559487921.69.0.872249086761.issue37024@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

This can be most likely be closed. In the last days I had some unrelated problems with my mac and had to do a full format. After reinstalling macOS the problem went away, so it must have been something specific to my previous state of things that triggered the error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37024>
_______________________________________

From report at bugs.python.org  Sun Jun  2 11:09:45 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 02 Jun 2019 15:09:45 +0000
Subject: [issue37024] SQLite flag in configure due to homebrew not linking
 sqlite
In-Reply-To: <1558632381.76.0.984637995348.issue37024@roundup.psfhosted.org>
Message-ID: <1559488185.75.0.188965751164.issue37024@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37024>
_______________________________________

From report at bugs.python.org  Sun Jun  2 11:19:39 2019
From: report at bugs.python.org (Tim Peters)
Date: Sun, 02 Jun 2019 15:19:39 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559488779.31.0.84783706415.issue35431@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I'm not convinced, although I agree relaxing k <= n is less damaging than relaxing k >= 0.

Python isn't aimed at mathematicians (although some 3rd-party packages certainly are, and they're free to define things however they like).  We have to trade off convenience for experts in edge cases against the likelihood that an ordinary user is making a mistake.

For example, that's why, despite that Python supports complex numbers, math.sqrt(-1) raises ValueError.  For _most_ users, trying that was probably an error in their logic that led to the argument being negative.  Experts can use cmath.sqrt() instead.

Ordinary users think comb(n, k) is the value of n!//(k!*(n-k)!), and as far as they're concerned factorial is only defined for non-negative integers.  0 <= k <= n follows from that.  (Indeed, the current docs for `comb()` _define_ the result via the factorial expression.)

And ordinary users think of the sum of the first n integers as "number of terms times the average", or memorize directly that the answer is n*(n+1)/2.  That works fine for n=0.  Only an expert thinks of it as `comb(n+1, 2)`.

So I would still rather enforce 0 <= k <= n at the start, and relax it later only if there's significant demand.  In going on three decades of using Python and having written my own `comb()` at least a dozen times, I've never found that constraint limiting, and enforcing it _has_ caught errors in my code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 11:57:53 2019
From: report at bugs.python.org (=?utf-8?b?0JDQvdC00YDQtdC5INCa0LDQt9Cw0L3RhtC10LI=?=)
Date: Sun, 02 Jun 2019 15:57:53 +0000
Subject: [issue36670] test suite broken due to cpu usage feature on win 10/
 german
In-Reply-To: <1555689157.38.0.435665423105.issue36670@roundup.psfhosted.org>
Message-ID: <1559491073.63.0.0687670777968.issue36670@roundup.psfhosted.org>


?????? ???????? <heckad at yandex.ru> added the comment:

I have the same problem in Russian locale.
Adding "oem" encoding in the decode method solve problem with decoding but got:
File "C:\Users\User\Documents\Projects\cpython\lib\test\libregrtest\win_utils.py", line 98, in getloadavg
    load = float(toks[1].replace('"', ''))
ValueError: could not convert string to float

In typeperf_output text with description of the error:
'\r\n??????????? ?????, ?????????...                         \r\n??????: ???????? ?? ???????.\r\n\r\r'
Translation on English is "Exiting, wait... Error: Counters are not specified."

Is it possible to check if the counters are found in advance?

----------
nosy: +heckad

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36670>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:04:29 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sun, 02 Jun 2019 16:04:29 +0000
Subject: [issue30786] getaddrinfo emulation does not support AI_NUMERICSERV
In-Reply-To: <1498560008.54.0.948539783321.issue30786@psf.upfronthosting.co.za>
Message-ID: <1559491469.08.0.523466283747.issue30786@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

I'm going to close this as the OP hasn't provided a response to Benjamin's question.  It can be re-opened if additional information is provided.  Thanks!

----------
nosy: +cheryl.sabella
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30786>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:10:43 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 16:10:43 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559491843.32.0.263671666593.issue35610@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests:  -10657

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:18:06 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 16:18:06 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
Message-ID: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

In the documentation, there are a lot of mismatches regarding function and method signatures that use positional-only arguments with respect to the docstrings (that properly use PEP570 syntax for documenting positional-only parameters).

Not that the official syntax for positional-only parameters is accepted (the "/"), the documentation needs to be updated to reflect positional-only parameters in the functions and methods that use them as covered in the PEP document.

----------
assignee: docs at python
components: Documentation
messages: 344295
nosy: docs at python, pablogsal
priority: normal
severity: normal
status: open
title: Use PEP570 syntax in the documentation
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:24:34 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 16:24:34 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559492674.47.0.881810883102.issue37134@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +easy
stage:  -> needs patch
title: Use PEP570 syntax in the documentation -> [EASY] Use PEP570 syntax in the documentation
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:34:17 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 16:34:17 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559493257.08.0.47751803551.issue37134@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13626
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13743

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:36:28 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 02 Jun 2019 16:36:28 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559493388.47.0.724507437088.issue37132@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

-1 I prefer these functions get left in the regular math module and just organize the docs to separate out integer functions.  Additional namespacing creates cognitive load and creates a findability problem.

Also, I really don't want gcd() to be moved yet again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:41:32 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 02 Jun 2019 16:41:32 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559493692.05.0.926196401904.issue37132@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

After the beta feature freeze, I'll write up an edit the math module docs that makes in easier to find functions (by splitting out a section of the docs for these functions and by creating a summary link table at the top like we do for builtins).  I really don't want a separate module for this and think that would work against the needs of usres.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:42:51 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 16:42:51 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559493771.24.0.366594165467.issue35610@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests:  -10656

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:46:01 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 16:46:01 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559493961.24.0.10191493192.issue35610@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

PR 5968 was previously linked here due to my title editing mistake, soon reversed, on the PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 12:58:54 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 16:58:54 +0000
Subject: [issue34261] Add description to clinic.py
In-Reply-To: <1532782049.63.0.56676864532.issue34261@psf.upfronthosting.co.za>
Message-ID: <1559494734.06.0.401991028683.issue34261@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34261>
_______________________________________

From report at bugs.python.org  Sun Jun  2 13:44:54 2019
From: report at bugs.python.org (Tim Hoffmann)
Date: Sun, 02 Jun 2019 17:44:54 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559497494.77.0.705587030673.issue33694@roundup.psfhosted.org>


Change by Tim Hoffmann <tim.hoffmann at posteo.de>:


----------
pull_requests: +13627
pull_request: https://github.com/python/cpython/pull/8518

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:05:40 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 18:05:40 +0000
Subject: [issue12639] msilib Directory.start_component() fails if keyfile is
 not None
In-Reply-To: <1311611007.28.0.321431208072.issue12639@psf.upfronthosting.co.za>
Message-ID: <1559498740.05.0.285890365049.issue12639@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

test_msilib is leaking references https://bugs.python.org/issue37124

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12639>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:06:03 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 18:06:03 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559498763.19.0.855836023341.issue37124@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +lukasz.langa
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:19:01 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 02 Jun 2019 18:19:01 +0000
Subject: [issue12178] csv writer doesn't escape escapechar
In-Reply-To: <1306348030.98.0.468032848078.issue12178@psf.upfronthosting.co.za>
Message-ID: <1559499541.19.0.340315588968.issue12178@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy:  -Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12178>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:31:56 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 18:31:56 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559500316.78.0.594230813641.issue35610@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I don't especially like 'prompt_last_line', but cannot think of anything better.  Removing the duplication now will make any future change easier.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:54:43 2019
From: report at bugs.python.org (Petter S)
Date: Sun, 02 Jun 2019 18:54:43 +0000
Subject: [issue35047] Better error messages in unittest.mock
In-Reply-To: <1540283736.06.0.788709270274.issue35047@psf.upfronthosting.co.za>
Message-ID: <1559501683.39.0.812772694117.issue35047@roundup.psfhosted.org>


Change by Petter S <petter.strandmark at gmail.com>:


----------
pull_requests: +13628
pull_request: https://github.com/python/cpython/pull/13746

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35047>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:56:50 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 18:56:50 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559501810.94.0.656654240457.issue35610@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 6bdc4dee01788599808c7858e2fe9fdd72cf6792 by Terry Jan Reedy (Cheryl Sabella) in branch 'master':
bpo-35610: IDLE - Replace .context_use_ps1 with .prompt_last_line (GH-11307)
https://github.com/python/cpython/commit/6bdc4dee01788599808c7858e2fe9fdd72cf6792


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:58:50 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 18:58:50 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559501930.91.0.388546843297.issue35610@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13629
pull_request: https://github.com/python/cpython/pull/13747

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 14:59:29 2019
From: report at bugs.python.org (Petter S)
Date: Sun, 02 Jun 2019 18:59:29 +0000
Subject: [issue27682] wsgiref BaseHandler / SimpleHandler can raise additional
 errors when handling an error
In-Reply-To: <1470313993.65.0.630797703267.issue27682@psf.upfronthosting.co.za>
Message-ID: <1559501969.4.0.06494183706.issue27682@roundup.psfhosted.org>


Change by Petter S <petter.strandmark at gmail.com>:


----------
pull_requests: +13630
pull_request: https://github.com/python/cpython/pull/13748

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27682>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:00:02 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 19:00:02 +0000
Subject: [issue36670] test suite broken due to cpu usage feature on win 10/
 german
In-Reply-To: <1555689157.38.0.435665423105.issue36670@roundup.psfhosted.org>
Message-ID: <1559502002.87.0.574884841851.issue36670@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy:  -terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36670>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:03:26 2019
From: report at bugs.python.org (Pierre Glaser)
Date: Sun, 02 Jun 2019 19:03:26 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559502206.01.0.702485708.issue26836@roundup.psfhosted.org>


Pierre Glaser <pierreglaser at msn.com> added the comment:

>From a quick skim at the man page of memfd_create, this looks promising.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:35:29 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 19:35:29 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559504129.78.0.620163609968.issue37124@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13631
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13750

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:35:55 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 19:35:55 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559504155.98.0.706217756651.issue35610@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b4e0bfd4778e142f037f50c19c4bb5bd123b4641 by Miss Islington (bot) in branch '3.7':
bpo-35610: IDLE - Replace .context_use_ps1 with .prompt_last_line (GH-11307)
https://github.com/python/cpython/commit/b4e0bfd4778e142f037f50c19c4bb5bd123b4641


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:36:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 02 Jun 2019 19:36:38 +0000
Subject: [issue35610] IDLE: replace use of EditorWindow.context_use_ps1
In-Reply-To: <1546059751.61.0.784436952304.issue35610@roundup.psfhosted.org>
Message-ID: <1559504198.69.0.254789641815.issue35610@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35610>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:38:04 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 19:38:04 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559504284.92.0.966743484249.issue37124@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The leak is because creating a 'msilib.Directory' adds an entry on a global variable '_directories', therefore leaking.

My first PR will make sure the _directories is cleared out after the test to stop the leak, but it seems to me that the variable is unused.

@Steve, could you confirm that there is still a reason for the msilib._directories?

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:42:56 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 02 Jun 2019 19:42:56 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559504576.56.0.439902304309.issue35621@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Also seems to occur on Ubuntu : https://buildbot.python.org/all/#/builders/141/builds/1912/steps/5/logs/stdio

karthi at ubuntu-s-1vcpu-1gb-blr1-01:~/cpython$ ./python -m unittest test.test_asyncio.test_unix_events
...................Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/karthi/cpython/Lib/threading.py", line 923, in _bootstrap_inner
    self.run()
  File "/home/karthi/cpython/Lib/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "/home/karthi/cpython/Lib/test/test_asyncio/test_unix_events.py", line 1833, in f
    self.assertIsInstance(watcher, asyncio.SafeChildWatcher)
  File "/home/karthi/cpython/Lib/unittest/case.py", line 1330, in assertIsInstance
    self.fail(self._formatMessage(msg, standardMsg))
  File "/home/karthi/cpython/Lib/unittest/case.py", line 748, in fail
    raise self.failureException(msg)
AssertionError: <asyncio.unix_events.ThreadedChildWatcher object at 0x7f00b357d640> is not an instance of <class 'asyncio.unix_events.SafeChildWatcher'>
../home/karthi/cpython/Lib/asyncio/base_events.py:646: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
...............................................................................................
----------------------------------------------------------------------
Ran 116 tests in 1.391s

OK

----------
nosy: +pablogsal, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 15:51:58 2019
From: report at bugs.python.org (Zachary Ware)
Date: Sun, 02 Jun 2019 19:51:58 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1559505118.32.0.6572658944.issue37133@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

Did running PCbuild/build.bat successfully download dependencies to the `externals` directory?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:17:16 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 02 Jun 2019 20:17:16 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559506636.5.0.569535614185.issue35621@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

It seems the assertion has to use ThreadedChildWatcher instead of SafeChildWatcher as the default seems to be changed at [0] . If changing assertion fixes the test I am curious why it didn't fail in the primary CI.


[0] https://github.com/python/cpython/commit/13ed07998ad93dbdd94991ba0451b9b559f07972#diff-8441007d39090aec5e09dbfcfa9973b7R1299

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:22:01 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 02 Jun 2019 20:22:01 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559506921.43.0.802954892216.issue17576@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Can we at least switch to PyLong_CheckExact?  That would fix Barry's original issue and should run slightly faster.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:23:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 20:23:27 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559507007.23.0.520151802289.issue37126@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

You forgot to call PyObject_GC_UnTrack() in structseq_dealloc(), no?

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:25:20 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 20:25:20 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559507120.55.0.145027766138.issue37126@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13632
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/13751

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:30:51 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 20:30:51 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559507451.32.0.273827557505.issue37126@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> You forgot to call PyObject_GC_UnTrack() in structseq_dealloc(), no?

Yep, thanks for the catch!

----------
stage: patch review -> resolved

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:36:24 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 20:36:24 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559507784.63.0.49515772089.issue37124@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset c0295dba259accc4b247beb22a0b2cc2f31d9850 by Pablo Galindo in branch 'master':
bpo-37124: Fix reference leak in test_msilib (GH-13750)
https://github.com/python/cpython/commit/c0295dba259accc4b247beb22a0b2cc2f31d9850


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:40:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 20:40:03 +0000
Subject: [issue36829] Add sys.unraisablehook() to customize how "unraisable
 exceptions" are logged
In-Reply-To: <1557231007.92.0.23824097772.issue36829@roundup.psfhosted.org>
Message-ID: <1559508003.64.0.257711603701.issue36829@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: Add sys.unraisablehook() to custom how "unraisable exceptions" are logged -> Add sys.unraisablehook() to customize how "unraisable exceptions" are logged

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36829>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:41:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 02 Jun 2019 20:41:26 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1559508086.01.0.0566514317663.issue32912@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I'm seeing these warnings pop up from time to time with various third party packages (such as pyparsing which is invoked by ensurepip).

Am wondering whether this should be deferred for another version or so until be have good confidence that the major third party packages have all had a chance to adapt.  Otherwise, this will mostly be noise for end-users.  Also, it gets in the way of the end-user strategy of "backslash anything that looks special" as preferred over "remember exactly which things are special".  This may be a case of "the cure is worse than the disease".

----------
nosy: +rhettinger
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:42:45 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 20:42:45 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559508165.94.0.442936041505.issue35621@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I cannot reproduce this issue locally :(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:45:08 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 20:45:08 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559508308.34.0.506633819807.issue35621@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

When I ran the tests, the watcher I get is a SafeChildWatcher

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:46:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 20:46:06 +0000
Subject: [issue36829] Add sys.unraisablehook() to customize how "unraisable
 exceptions" are logged
In-Reply-To: <1557231007.92.0.23824097772.issue36829@roundup.psfhosted.org>
Message-ID: <1559508366.52.0.763187565432.issue36829@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13633
pull_request: https://github.com/python/cpython/pull/13752

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36829>
_______________________________________

From report at bugs.python.org  Sun Jun  2 16:50:18 2019
From: report at bugs.python.org (Jarl Gullberg)
Date: Sun, 02 Jun 2019 20:50:18 +0000
Subject: [issue37080] Cannot compile Python3.7.3 on Alt-F (ARM)
In-Reply-To: <1559337987.58.0.910746899611.issue37080@roundup.psfhosted.org>
Message-ID: <CACxTbtF176bfq98j2KMg_hWWc3zdoez1MtqM0uAVT85wyaeV8w@mail.gmail.com>


Jarl Gullberg <jarl.gullberg at gmail.com> added the comment:

That's correct, CPython. I'm not sure if MicroPython would fit the bill for
me, since this system is a full-blown Linux system.

On Fri, 31 May 2019 at 23:26, Terry J. Reedy <report at bugs.python.org> wrote:

>
> Terry J. Reedy <tjreedy at udel.edu> added the comment:
>
> I presume you are trying to compile CPython.  Perhaps you might do better
> with MicroPython, designed for micro devices.  Steve, do you know anything
> about CPython on Arm with linux?
>
> ----------
> nosy: +steve.dower, terry.reedy
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue37080>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37080>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:01:52 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 21:01:52 +0000
Subject: [issue37014] [First easy issue] fileinput module should document that
 openhook and mode are ignored when reading from stdin
In-Reply-To: <1558545967.04.0.906137299955.issue37014@roundup.psfhosted.org>
Message-ID: <1559509312.56.0.83488611034.issue37014@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:


New changeset aca273e2401ca3151e15e984f400233b7f255e15 by Ezio Melotti (Michele Angrisano) in branch 'master':
bpo-37014: Update docstring and Documentation of fileinput.FileInput(). (GH-13545)
https://github.com/python/cpython/commit/aca273e2401ca3151e15e984f400233b7f255e15


----------
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37014>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:02:03 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 21:02:03 +0000
Subject: [issue37014] [First easy issue] fileinput module should document that
 openhook and mode are ignored when reading from stdin
In-Reply-To: <1558545967.04.0.906137299955.issue37014@roundup.psfhosted.org>
Message-ID: <1559509323.22.0.218259215051.issue37014@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13634
pull_request: https://github.com/python/cpython/pull/13753

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37014>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:03:25 2019
From: report at bugs.python.org (Jarl Gullberg)
Date: Sun, 02 Jun 2019 21:03:25 +0000
Subject: [issue37080] Cannot compile Python3.7.3 on Alt-F (ARM)
In-Reply-To: <1559057852.62.0.663214501823.issue37080@roundup.psfhosted.org>
Message-ID: <1559509405.69.0.2593421702.issue37080@roundup.psfhosted.org>


Jarl Gullberg <jarl.gullberg at gmail.com> added the comment:

After some more testing, I can add that the same issue crops up when attempting to compile Python 2.7.16 as well.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37080>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:08:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:08:44 +0000
Subject: [issue36829] Add sys.unraisablehook() to customize how "unraisable
 exceptions" are logged
In-Reply-To: <1557231007.92.0.23824097772.issue36829@roundup.psfhosted.org>
Message-ID: <1559509724.0.0.885467350769.issue36829@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset cdce0574d03005e27b843fc110c54c99c7a76412 by Victor Stinner in branch 'master':
bpo-36829: test_threading: Fix a ref cycle (GH-13752)
https://github.com/python/cpython/commit/cdce0574d03005e27b843fc110c54c99c7a76412


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36829>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:13:42 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 02 Jun 2019 21:13:42 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1559434040.77.0.43284750444.issue36985@roundup.psfhosted.org>
Message-ID: <CAP7+vJKE_uC3caa97RN9rt7sKKMFyKt-V4bOkfAx+Me0rt1hEA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Huh. I think I have mellowed with age. IOW SGTM.

On Sat, Jun 1, 2019 at 17:07 Ivan Levkivskyi <report at bugs.python.org> wrote:

>
> Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:
>
> Guido, I remember you were against exposing `ForwardRef` as public at some
> point, but recently you approved
> https://github.com/python/cpython/pull/13456 that added it to
> `typing.__all__`. I don't have any particular opinion on this, but if you
> don't object, I think it would make sense to add a short section about this
> to the docs, since it may be exposed at runtime, e.g. in `List['Cls']`.
>
> ----------
> nosy: +gvanrossum
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue36985>
> _______________________________________
>
-- 
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:15:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:15:11 +0000
Subject: [issue37126] test_threading is leaking references
In-Reply-To: <1559408448.65.0.831974411649.issue37126@roundup.psfhosted.org>
Message-ID: <1559510111.92.0.185852963375.issue37126@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks.

commit 3caf4de6f05f68c3a175f4d8ce870d7a0016622a
Author: Pablo Galindo <Pablogsal at gmail.com>
Date:   Sun Jun 2 21:52:49 2019 +0100

    Call PyObject_GC_UnTrack in structseq dealloc (GH-13751)

--

FYI I also fixed test_threading:

commit cdce0574d03005e27b843fc110c54c99c7a76412
Author: Victor Stinner <vstinner at redhat.com>
Date:   Sun Jun 2 23:08:41 2019 +0200

    bpo-36829: test_threading: Fix a ref cycle (GH-13752)

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37126>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:18:37 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 21:18:37 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559510317.74.0.759636456347.issue35621@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13635
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/13754

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:20:11 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 21:20:11 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559510411.12.0.861182496932.issue35621@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thanks for the report!

The failure depends on tests order execution (maybe you use -jN flag?).
Before default child watcher was SafeChildWatcher, not it is ThreaderChildWather.
The watcher is a global variable (a property of global event loop policy).

The failed test doesn't make sense for default ThreadChildWatcher but still valuable for old default SafeChildWatcher.
I've changed the test to use SafeChildWatcher explicitly.

See https://github.com/python/cpython/pull/13754 for the fix

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:25:09 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 21:25:09 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559510709.22.0.537136125487.issue35621@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> The failure depends on tests order execution (maybe you use -jN flag?).

Oh, I understand now!

> See https://github.com/python/cpython/pull/13754 for the fix

Thanks for the fix, Andrew! :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:31:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:31:33 +0000
Subject: [issue20602] sys.flags and sys.float_info disappear at shutdown
In-Reply-To: <1392146521.44.0.544055558433.issue20602@psf.upfronthosting.co.za>
Message-ID: <1559511093.73.0.193946823485.issue20602@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Honestly, I'm not sure that this issue is really a major bug. I don't think that it's worth it to backport the change. It's more a subtle change in Python finalization which is super fragile code. I prefer to only change the master branch, so I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20602>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:34:15 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 21:34:15 +0000
Subject: [issue19184] dis module has incorrect docs for RAISE_VARARGS
In-Reply-To: <1381078012.05.0.236677780468.issue19184@psf.upfronthosting.co.za>
Message-ID: <1559511255.19.0.796714014564.issue19184@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:


New changeset e1179a5096fb12297ececd7a1c79969aa5747e28 by Ezio Melotti (Michele Angrisano) in branch 'master':
bpo-19184: Update the documentation of dis module. (GH-13652)
https://github.com/python/cpython/commit/e1179a5096fb12297ececd7a1c79969aa5747e28


----------
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19184>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:35:15 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 21:35:15 +0000
Subject: [issue19184] dis module has incorrect docs for RAISE_VARARGS
In-Reply-To: <1381078012.05.0.236677780468.issue19184@psf.upfronthosting.co.za>
Message-ID: <1559511315.63.0.75431632102.issue19184@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13636
pull_request: https://github.com/python/cpython/pull/13755

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19184>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:36:37 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 21:36:37 +0000
Subject: [issue37014] [First easy issue] fileinput module should document that
 openhook and mode are ignored when reading from stdin
In-Reply-To: <1558545967.04.0.906137299955.issue37014@roundup.psfhosted.org>
Message-ID: <1559511397.54.0.493297848972.issue37014@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:


New changeset 6bd438e137a0618b8db949a4751304f541b6674d by Ezio Melotti (Miss Islington (bot)) in branch '3.7':
bpo-37014: Update docstring and Documentation of fileinput.FileInput(). (GH-13545) (GH-13753)
https://github.com/python/cpython/commit/6bd438e137a0618b8db949a4751304f541b6674d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37014>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:43:10 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 21:43:10 +0000
Subject: [issue37014] fileinput module should document that openhook and mode
 are ignored when reading from stdin
In-Reply-To: <1558545967.04.0.906137299955.issue37014@roundup.psfhosted.org>
Message-ID: <1559511790.12.0.693011678582.issue37014@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

Fixed, thanks for the report and the PRs!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
title: [First easy issue] fileinput module should document that openhook and mode are ignored when reading from stdin -> fileinput module should document that openhook and mode are ignored when reading from stdin
type:  -> enhancement
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37014>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:44:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:44:36 +0000
Subject: [issue37100] test_coroutine.test_unawaited_warning_when_module_broken
 fails on -Werror
In-Reply-To: <1559221025.29.0.0441448239991.issue37100@roundup.psfhosted.org>
Message-ID: <1559511876.4.0.700197282725.issue37100@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13637
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13756

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37100>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:46:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:46:40 +0000
Subject: [issue37100] test_coroutine.test_unawaited_warning_when_module_broken
 fails on -Werror
In-Reply-To: <1559221025.29.0.0441448239991.issue37100@roundup.psfhosted.org>
Message-ID: <1559512000.18.0.41262088187.issue37100@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote PR 13756 which fix the test.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37100>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:52:22 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 21:52:22 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559512342.86.0.773521778948.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset fb9423fd0a85f06affb8c3a8f25dd598a649aa42 by Petr Viktorin in branch 'master':
bpo-36974: Make tp_call=PyVectorcall_Call work for inherited types (GH-13699)
https://github.com/python/cpython/commit/fb9423fd0a85f06affb8c3a8f25dd598a649aa42


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Sun Jun  2 17:59:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 21:59:27 +0000
Subject: [issue32573] All sys attributes (.argv,
 ...) should exist in embedded environments
In-Reply-To: <1516131988.33.0.467229070634.issue32573@psf.upfronthosting.co.za>
Message-ID: <1559512767.7.0.85770304316.issue32573@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The issue has been fixed in Python 3.8. See PEP 587 and http://docs.python.org/dev/c-api/init_config.html for the larger scope.

For Python 3.7, the fix is trivial: don't add the following 2 lines in your application:

if not hasattr(sys, 'argv'):
    sys.argv = ['']

Python 3.7 Release Manager, Ned Deily, was opposed to change the behavior in a minor release:
https://github.com/python/cpython/pull/13553#issuecomment-496768319

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32573>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:04:04 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Sun, 02 Jun 2019 22:04:04 +0000
Subject: [issue37074] os.stat() does not work for NUL and CON
In-Reply-To: <1559029061.14.0.328684807212.issue37074@roundup.psfhosted.org>
Message-ID: <1559513044.92.0.878206552247.issue37074@roundup.psfhosted.org>


Change by Michele Angrisano <michele.angrisano at gmail.com>:


----------
nosy:  -mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37074>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:04:23 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Sun, 02 Jun 2019 22:04:23 +0000
Subject: [issue36986] tarfile: unexpected IsADirectoryError on extraction
In-Reply-To: <1558422809.19.0.381089325981.issue36986@roundup.psfhosted.org>
Message-ID: <1559513063.11.0.467847412137.issue36986@roundup.psfhosted.org>


Change by Michele Angrisano <michele.angrisano at gmail.com>:


----------
nosy:  -mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36986>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:05:00 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Sun, 02 Jun 2019 22:05:00 +0000
Subject: [issue37086] time.sleep error message misleading
In-Reply-To: <1559126222.88.0.100290912588.issue37086@roundup.psfhosted.org>
Message-ID: <1559513100.17.0.120417368633.issue37086@roundup.psfhosted.org>


Change by Michele Angrisano <michele.angrisano at gmail.com>:


----------
nosy:  -mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37086>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:24:25 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Sun, 02 Jun 2019 22:24:25 +0000
Subject: [issue35814] Syntax quirk with variable annotations
In-Reply-To: <1548308739.94.0.144807070146.issue35814@roundup.psfhosted.org>
Message-ID: <1559514265.03.0.135600723236.issue35814@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
pull_requests: +13638
pull_request: https://github.com/python/cpython/pull/13757

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35814>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:34:38 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 22:34:38 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559514878.72.0.0198774645276.issue36027@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

I will fix the compiler warning along with another one that I just introduced.

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:39:01 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 22:39:01 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559515141.52.0.56084084864.issue36027@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +13639
pull_request: https://github.com/python/cpython/pull/13758

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:39:01 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 22:39:01 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559515141.66.0.667228853091.issue36974@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +13640
pull_request: https://github.com/python/cpython/pull/13758

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:45:56 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 02 Jun 2019 22:45:56 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559515556.74.0.915401354201.issue35621@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c6789d6c85a290a35f3839efb52a3d34536dcebe by Miss Islington (bot) (Andrew Svetlov) in branch 'master':
bpo-35621: Fix tests when SafeChildWatcher is expected instead of ThreadedChildWatcher (GH-13754)
https://github.com/python/cpython/commit/c6789d6c85a290a35f3839efb52a3d34536dcebe


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun  2 18:54:17 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 22:54:17 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
Message-ID: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

test_import (test.test_multiprocessing_spawn._TestImportStar) ... ok
----------------------------------------------------------------------
Ran 352 tests in 322.667s
OK (skipped=34)
Warning -- files was modified by test_multiprocessing_spawn
  Before: []
  After:  ['python.core']
0:11:39 load avg: 4.96 [202/423/1] test_winconsoleio skipped
test_winconsoleio skipped -- test only relevant on win32

https://buildbot.python.org/all/#/builders/168/builds/1124/steps/5/logs/stdio

----------
components: Interpreter Core, Tests
keywords: buildbot
messages: 344332
nosy: pablogsal
priority: high
severity: normal
status: open
title: test_multiprocessing_spawn segfaults on AMD64 FreeBSD CURRENT Shared 3.x
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:00:08 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 23:00:08 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559516408.22.0.571361990737.issue37135@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +koobs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:00:23 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 23:00:23 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559516423.45.0.982816671147.issue37135@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:07:11 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 02 Jun 2019 23:07:11 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559516831.69.0.843338703772.issue33694@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13642
pull_request: https://github.com/python/cpython/pull/13754

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:08:17 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 23:08:17 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559516897.63.0.454676636599.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset e584cbff1ea78e700cf9943d50467e3b58301ccc by Petr Viktorin in branch 'master':
bpo-36027 bpo-36974: Fix "incompatible pointer type" compiler warnings (GH-13758)
https://github.com/python/cpython/commit/e584cbff1ea78e700cf9943d50467e3b58301ccc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:08:17 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 23:08:17 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559516897.71.0.23063972971.issue36027@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset e584cbff1ea78e700cf9943d50467e3b58301ccc by Petr Viktorin in branch 'master':
bpo-36027 bpo-36974: Fix "incompatible pointer type" compiler warnings (GH-13758)
https://github.com/python/cpython/commit/e584cbff1ea78e700cf9943d50467e3b58301ccc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:18:53 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 23:18:53 +0000
Subject: [issue19184] dis module has incorrect docs for RAISE_VARARGS
In-Reply-To: <1381078012.05.0.236677780468.issue19184@psf.upfronthosting.co.za>
Message-ID: <1559517533.76.0.105112291366.issue19184@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:


New changeset 9390e98c3ed9eb9fa414030a2feec1926193af94 by Ezio Melotti (Miss Islington (bot)) in branch '3.7':
bpo-19184: Update the documentation of dis module. (GH-13652) (GH-13755)
https://github.com/python/cpython/commit/9390e98c3ed9eb9fa414030a2feec1926193af94


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19184>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:19:46 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Sun, 02 Jun 2019 23:19:46 +0000
Subject: [issue19184] dis module has incorrect docs for RAISE_VARARGS
In-Reply-To: <1381078012.05.0.236677780468.issue19184@psf.upfronthosting.co.za>
Message-ID: <1559517586.5.0.421036728531.issue19184@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

Fixed, thanks for the report and the PRs!

----------
assignee: docs at python -> ezio.melotti
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19184>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:31:15 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 23:31:15 +0000
Subject: [issue37012] Possible crash due to PyType_FromSpecWithBases()
In-Reply-To: <1558533850.59.0.459054292807.issue37012@roundup.psfhosted.org>
Message-ID: <1559518275.4.0.231132705534.issue37012@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 7f4ae1b2cc60cb69938e7c88793b9e9a2dd36d93 by Petr Viktorin in branch 'master':
bpo-37012: Clean up special cases in PyType_FromSpecWithBases slot assignments (GH-13496)
https://github.com/python/cpython/commit/7f4ae1b2cc60cb69938e7c88793b9e9a2dd36d93


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37012>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:35:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 23:35:40 +0000
Subject: [issue37100] test_coroutine.test_unawaited_warning_when_module_broken
 fails on -Werror
In-Reply-To: <1559221025.29.0.0441448239991.issue37100@roundup.psfhosted.org>
Message-ID: <1559518540.29.0.815635366903.issue37100@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 3cf7ea1272fbc921a89acdbe40ca152813028cb5 by Victor Stinner in branch 'master':
bpo-37100: Fix test_coroutines with -Werror (GH-13756)
https://github.com/python/cpython/commit/3cf7ea1272fbc921a89acdbe40ca152813028cb5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37100>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:37:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 02 Jun 2019 23:37:29 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559518649.63.0.322569582954.issue33694@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +13643
pull_request: https://github.com/python/cpython/pull/13745

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:43:16 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 23:43:16 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559518996.45.0.743103822319.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 9e3e06e582accec82eb29cf665c3b4c7d84d2eb0 by Petr Viktorin (Jeroen Demeyer) in branch 'master':
bpo-36974: document PEP 590 (GH-13450)
https://github.com/python/cpython/commit/9e3e06e582accec82eb29cf665c3b4c7d84d2eb0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:49:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 02 Jun 2019 23:49:06 +0000
Subject: [issue37069] regrtest: log unraisable exceptions and uncaught thread
 exceptions
In-Reply-To: <1558997484.87.0.618934402283.issue37069@roundup.psfhosted.org>
Message-ID: <1559519346.19.0.827015270672.issue37069@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13644
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13759

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37069>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:49:39 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 02 Jun 2019 23:49:39 +0000
Subject: [issue35814] Syntax quirk with variable annotations
In-Reply-To: <1548308739.94.0.144807070146.issue35814@roundup.psfhosted.org>
Message-ID: <1559519379.06.0.407515816508.issue35814@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13645
pull_request: https://github.com/python/cpython/pull/13760

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35814>
_______________________________________

From report at bugs.python.org  Sun Jun  2 19:57:25 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Sun, 02 Jun 2019 23:57:25 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559519845.42.0.448775282002.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset be718c33f06b3496faa61142df24fb071fd5d1f1 by Petr Viktorin (Jeroen Demeyer) in branch 'master':
bpo-36974: add some assertions for PEP 590 (GH-13682)
https://github.com/python/cpython/commit/be718c33f06b3496faa61142df24fb071fd5d1f1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:00:33 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 00:00:33 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559520033.66.0.818552862505.issue36027@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +13646
pull_request: https://github.com/python/cpython/pull/13761

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:00:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 00:00:46 +0000
Subject: [issue37069] regrtest: log unraisable exceptions and uncaught thread
 exceptions
In-Reply-To: <1558997484.87.0.618934402283.issue37069@roundup.psfhosted.org>
Message-ID: <1559520046.67.0.851554432849.issue37069@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote a minimum implementation: PR 13759 marks a test as "altered the execution environment" (ENV_CHANGED) if sys.unraisablehook() is called at least once. This this PR, 9 tests fail:

* test_urllib: see bpo-36918
* test_io: see bpo-18748

* test_thread: test_save_exception_state_on_error()
* test_yield_from: test_broken_getattr_handling()
* test_coroutines: test_fatal_coro_warning()
* test_cprofile: test_bad_counter_during_dealloc()
* test_raise: test_3611()
* test_ssl: test_sni_callback_raising() and test_sni_callback_wrong_return_type()

* test_generators: I'm not sure, it's maybe caused by doctests? multiple tests?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37069>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:05:00 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Mon, 03 Jun 2019 00:05:00 +0000
Subject: [issue37005] bz2 module doesn't write end-of-stream marker
In-Reply-To: <1558496168.36.0.56962236665.issue37005@roundup.psfhosted.org>
Message-ID: <1559520300.04.0.892428580907.issue37005@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

The bz2 library and the bzip2 utility generate identical files. For example:

>>> import bz2
>>> with bz2.open('bz2test.txt.bz2', mode='wb') as f:
...     f.write(b'foobar')
... 
6

generates this file:

$ hexdump bz2test.txt.bz2
0000000 42 5a 68 39 31 41 59 26 53 59 52 c0 3d c1 00 00
0000010 01 01 80 31 00 90 00 20 00 21 83 41 9a 09 88 1c
0000020 5d c9 14 e1 42 41 4b 00 f7 04                  
000002a

and

$ echo -n 'foobar' | bzip2 -c > bzip2test.txt.bz2

generates this file:

$ hexdump bzip2test.txt.bz2 
0000000 42 5a 68 39 31 41 59 26 53 59 52 c0 3d c1 00 00
0000010 01 01 80 31 00 90 00 20 00 21 83 41 9a 09 88 1c
0000020 5d c9 14 e1 42 41 4b 00 f7 04                  
000002a

The StreamFooter is there, it is just difficult to see because it isn't byte-aligned. It starts at byte 0x20 bit 6.  If you take 0x5dc914e14241 and shift it right two bits, you get the StreamFooter FooterMagic value: 0x177245385090. It is followed by a 32-bit CRC and two zero-bits of padding to byte-align the end of the file.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37005>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:12:27 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 03 Jun 2019 00:12:27 +0000
Subject: [issue27432] Support unittest assertion truncation of repr in error
 messages
In-Reply-To: <1467365269.89.0.517880663648.issue27432@psf.upfronthosting.co.za>
Message-ID: <1559520747.84.0.820069513694.issue27432@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

I spent a while looking at this and what it'd take to wind up with a TestCase.maxReprLength style implementation to limit the length of unittest assertion failure reprs. I don't see a nice path forward via safe_repr as is (as the PR started with).

adding max_length as the PR does is easy enough... but plumbing everything through is rather gross. mostly mechanical changes I started in a client before abandoning the work:

 1 change all TestCase method safe_repr calls to self._safe_repr method calls so that the method could pass self.maxReprLength in via max_length=.
 2 realize that this is mostly pointless without also updating unittest.util._common_shorten_repr which calls safe_repr in a similar manner. do that...
 3 and notice how we have many calls of safe_repr on safe_repr'ed things and the nesting between _common_shorten_repr and safe_repr which makes for messy uninformative potentially misleading error messages when maxReprLength was actually set to a value.

Overall I think we should backup and reconsider what we want our unittest assertions to do and how if we're going to add error message length constraining as a feature. shoehorning it in via the existing repr implementations doesn't feel right.

So I closed that PR.

unittest.safe_repr (aka unittest.util.safe_repr) remains an undocumented API.  future to be determined.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27432>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:12:40 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 03 Jun 2019 00:12:40 +0000
Subject: [issue27432] Support unittest assertion truncation of repr in error
 messages
In-Reply-To: <1467365269.89.0.517880663648.issue27432@psf.upfronthosting.co.za>
Message-ID: <1559520760.55.0.0483831246081.issue27432@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
assignee: gregory.p.smith -> 
stage: patch review -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27432>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:14:50 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Mon, 03 Jun 2019 00:14:50 +0000
Subject: [issue37005] bz2 module doesn't write end-of-stream marker
In-Reply-To: <1558496168.36.0.56962236665.issue37005@roundup.psfhosted.org>
Message-ID: <1559520890.45.0.367020738574.issue37005@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Sorry, the StreamFooter starts at byte 0x1f bit 1, not 0x20 bit 6.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37005>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:28:32 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 00:28:32 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559521712.97.0.708236752868.issue36027@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 1e375c6269e9de4f3d05d4aa6d6d74e00f522d63 by Petr Viktorin in branch 'master':
bpo-36027: Really fix "incompatible pointer type" compiler warning (GH-13761)
https://github.com/python/cpython/commit/1e375c6269e9de4f3d05d4aa6d6d74e00f522d63


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:33:29 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Mon, 03 Jun 2019 00:33:29 +0000
Subject: [issue37030] Lib/cmd.py: Hide undocumented commands in help and
 completenames
In-Reply-To: <1558682753.85.0.407660629596.issue37030@roundup.psfhosted.org>
Message-ID: <1559522009.02.0.581734026567.issue37030@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

How to add a label 'awaiting core review' to pull request?

tirkarthi: "Left comment for doc and test. But in general would like to hear from a core dev on this."

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37030>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:34:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 00:34:28 +0000
Subject: [issue37069] regrtest: log unraisable exceptions and uncaught thread
 exceptions
In-Reply-To: <1558997484.87.0.618934402283.issue37069@roundup.psfhosted.org>
Message-ID: <1559522068.49.0.115051301567.issue37069@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13647
pull_request: https://github.com/python/cpython/pull/13762

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37069>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:37:05 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Mon, 03 Jun 2019 00:37:05 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559522225.63.0.411077825966.issue5680@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
pull_requests: +13648
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13763

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:43:06 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 00:43:06 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559522586.35.0.59942252056.issue33694@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
pull_requests: +13649
pull_request: https://github.com/python/cpython/pull/13761

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:43:24 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 00:43:24 +0000
Subject: [issue36896] clarify in types.rst that FunctionTypes & co
 constructors don't have stable signature
In-Reply-To: <1557698610.19.0.556381141599.issue36896@roundup.psfhosted.org>
Message-ID: <1559522604.98.0.518027465992.issue36896@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 13136e83a637a9f1cfbada7e93097005296659b4 by Petr Viktorin (Matthias Bussonnier) in branch 'master':
bpo-36896: Clarify that some types constructors are unstable (GH-13271)
https://github.com/python/cpython/commit/13136e83a637a9f1cfbada7e93097005296659b4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36896>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:47:58 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Mon, 03 Jun 2019 00:47:58 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559522878.45.0.13321574005.issue5680@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

I've added a minimal change for running a module in the editor with command line arguments. 

Some notes:
1. The shortcut key (F7) can be entered while on the shell window.  As of now, any of the Run menu shortcuts can be entered, so I didn't fix that bug as part of this issue.
2. I'm not saving the arguments in any way.
3. I didn't (yet) make the change to print the command line arguments in the shell or to add it to the status bar.
4. I didn't make a change to get the sys.argv values from startup.
5. I added a single menu entry and not a cascade of different custom run options.

----------
stage: patch review -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:53:11 2019
From: report at bugs.python.org (MrValdez)
Date: Mon, 03 Jun 2019 00:53:11 +0000
Subject: [issue21110] Slowdown and high memory usage when adding a new module
 in embedded Python 3.4 on 64bit Windows
In-Reply-To: <1396262123.2.0.239412802273.issue21110@psf.upfronthosting.co.za>
Message-ID: <1559523191.25.0.960256733218.issue21110@roundup.psfhosted.org>


MrValdez <shunyvaldez at gmail.com> added the comment:

I couldn't replicate since my old dev machine didn't have rubenvb.

Since this issue has been around for 5 years already, rubenvb isn't maintained and I couldn't replicate, I think its fine to close this issue.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21110>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:55:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 00:55:10 +0000
Subject: [issue37100] test_coroutine.test_unawaited_warning_when_module_broken
 fails on -Werror
In-Reply-To: <1559221025.29.0.0441448239991.issue37100@roundup.psfhosted.org>
Message-ID: <1559523310.14.0.298323615405.issue37100@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It's now fixed, thanks for the report!

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37100>
_______________________________________

From report at bugs.python.org  Sun Jun  2 20:58:04 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 00:58:04 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559523484.79.0.825554186872.issue5680@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Thanks.  Those seem reasonable for a first pass.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:09:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:09:22 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
Message-ID: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Travis CI: "Documentation tests" failed with:

Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 Pygments-2.4.2 Sphinx-2.1.0 alabaster-0.7.12 babel-2.7.0 blurb-1.0.7 certifi-2019.3.9 chardet-3.0.4 docutils-0.14 idna-2.8 imagesize-1.1.0 packaging-19.0 pyparsing-2.4.0 python-docs-theme-2018.7 pytz-2019.1 requests-2.22.0 six-1.12.0 snowballstemmer-1.2.1 sphinxcontrib-applehelp-1.0.1 sphinxcontrib-devhelp-1.0.1 sphinxcontrib-htmlhelp-1.0.2 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.2 sphinxcontrib-serializinghtml-1.1.3 urllib3-1.25.3
(...)
Warning, treated as error:
duplicate object description of email.message, other instance in library/email.message, use :noindex: for one of them

https://travis-ci.org/python/cpython/jobs/540532864

ref: https://github.com/python/cpython/pull/13762

--

Sphinx 2.1 was released yesterday:

https://www.sphinx-doc.org/en/master/changes.html#release-2-1-0-released-jun-02-2019

----------
components: Build
messages: 344352
nosy: lukasz.langa, mdk, vstinner
priority: release blocker
severity: normal
status: open
title: Travis CI: Documentation tests fails with Sphinx 2.1
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:12:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:12:40 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1559524360.08.0.118744543009.issue37136@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13650
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13764

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:18:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:18:08 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
Message-ID: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

s390x RHEL 3.x buildbot:
https://buildbot.python.org/all/#/builders/21/builds/3150

test_cancel_gather_1 (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests)
Ensure that a gathering future refuses to be cancelled once all ... ok
test_cancel_gather_2 (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ...
Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)
Dangling thread: <_MainThread(MainThread, started 4396153272064)>
ok

test_cancel_inner_future (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok
test_cancel_task_catching (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok

--


AMD64 FreeBSD 10-STABLE Non-Debug 3.x:
https://buildbot.python.org/all/#/builders/167/builds/1181

test_cancel_gather_2 (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)

----------
components: Tests
messages: 344353
nosy: pablogsal, vstinner
priority: normal
severity: normal
status: open
title: test_asyncio: test_cancel_gather_2() dangling thread
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:23:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:23:03 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559524983.02.0.0713877708369.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New coredump:
https://buildbot.python.org/all/#builders/168/builds/1129

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:24:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:24:36 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559525076.43.0.00273395745062.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> So far so good. :)  I'll keep an eye on things and if the buildbots are still happy then I'll add back _PyEval_FinishPendingCalls() in _Py_FinalizeEx() in a few days.

I have no idea if it's related, but we started to see coredumps on FreeBSD:
https://bugs.python.org/issue37135

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:25:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:25:18 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559525118.29.0.455671107945.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Maybe it's related to bpo-33608.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:26:50 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 01:26:50 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559525210.09.0.622282845708.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Do we really want to do this?  ISTM, this would be a regression in the readability of the docs.  100% of the users of the docs will be confronted with this syntax which is mostly irrelevant to them.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:26:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:26:58 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559525218.4.0.932993860997.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Another similar error on "ARMv7 Debian buster 3.x" buildbot:
https://buildbot.python.org/all/#/builders/176/builds/664

test_proc_exited (test.test_asyncio.test_subprocess.SubprocessTransportTests) ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:28:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:28:35 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559525315.55.0.942157732907.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

AMD64 Ubuntu Shared 3.x:
https://buildbot.python.org/all/#/builders/141/builds/1912

test_proc_exited (test.test_asyncio.test_subprocess.SubprocessTransportTests) ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)
test_close (test.test_asyncio.test_unix_events.SafeChildWatcherTests) ... /srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/asyncio/base_events.py:646: ResourceWarning: unclosed event loop <_UnixSelectorEventLoop running=False closed=False debug=False>
  _warn(f"unclosed event loop {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:32:02 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 01:32:02 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559525522.67.0.195577237352.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Guido, was it your intention that this show-up everywhere in the docs.  I had thought the primary motivation was to make it possible to write pure python code that exactly matched a C API.   

ISTM, there is no need to confront every single user of the docs with a notation that is known to be confusing.  From a teacher's point of view, pushing this notation everywhere in the docs changes the priority of the topic.  Formerly, it was an optional intermediate/advanced topic.  But if it is visible everywhere, it becomes an unavoidable day one topic for every single learner (that is if we want them to be able to read and understand the docs).

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:39:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:39:03 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1559525943.36.0.816768463659.issue37136@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I tried but I failed to reproduce the issue using:

git clean -fdx
./configure CFLAGS="-O0"
make

cd Doc
make venv PYTHON=../python

# Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 Pygments-2.4.2 Sphinx-2.1.0 alabaster-0.7.12 babel-2.7.0 blurb-1.0.7 certifi-2019.3.9 chardet-3.0.4 docutils-0.14 idna-2.8 imagesize-1.1.0 packaging-19.0 pyparsing-2.4.0 python-docs-theme-2018.7 pytz-2019.1 requests-2.22.0 six-1.12.0 snowballstemmer-1.2.1 sphinxcontrib-applehelp-1.0.1 sphinxcontrib-devhelp-1.0.1 sphinxcontrib-htmlhelp-1.0.2 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.2 sphinxcontrib-serializinghtml-1.1.3 urllib3-1.25.3

# I added "LANG=" to ignore my French locale
# LANG= PATH=./venv/bin:$PATH sphinx-build -b doctest -d build/doctrees -D latex_elements.papersize= -q -W -j4 -W . build/doctest

LANG= make PYTHON=../python SPHINXOPTS="-q -W -j4" doctest

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:42:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:42:59 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1559526179.91.0.0496769368238.issue37136@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Tests passed on my PR 13764, so I remove the release blocker status.

It might be something wrong specific to my PR 13762.

----------
nosy:  -lukasz.langa
priority: release blocker -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:51:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:51:25 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1559526685.39.0.711551672492.issue37136@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, it's very strange. The test passed when run again manually on Travis CI. I close the issue....

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:51:34 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 03 Jun 2019 01:51:34 +0000
Subject: [issue27987] obmalloc's 8-byte alignment causes undefined behavior
In-Reply-To: <1473207430.19.0.578630759123.issue27987@psf.upfronthosting.co.za>
Message-ID: <1559526694.86.0.182655182519.issue27987@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 8766cb74e186d3820db0a855ccd780d6d84461f7 by Gregory P. Smith (Inada Naoki) in branch '3.7':
[3.7] bpo-27987: align PyGC_Head to alignof(long double) (GH-13335) (GH-13581)
https://github.com/python/cpython/commit/8766cb74e186d3820db0a855ccd780d6d84461f7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27987>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:51:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 01:51:45 +0000
Subject: [issue37069] regrtest: log unraisable exceptions and uncaught thread
 exceptions
In-Reply-To: <1558997484.87.0.618934402283.issue37069@roundup.psfhosted.org>
Message-ID: <1559526705.65.0.783713257279.issue37069@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0025350294959594e7f57aef4fc9579c77a0ed1c by Victor Stinner in branch 'master':
bpo-37069: tests use catch_unraisable_exception() (GH-13762)
https://github.com/python/cpython/commit/0025350294959594e7f57aef4fc9579c77a0ed1c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37069>
_______________________________________

From report at bugs.python.org  Sun Jun  2 21:59:53 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 01:59:53 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559527193.76.0.127445663463.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Here are a few other data points.  There is no consensus but either returning 0 or erroring out seem reasonable.

MS Excel's COMBIN: If number < 0, number_chosen < 0, or number < number_chosen, COMBIN returns the #NUM! error value.

Scipy.misc.comb: If k > N, N < 0, or k < 0, then a 0 is returned.

Matlib.nchoose: Error: K must an integer between 0 and N.

Maple.numbcomb: Unclear from the docs what this does

Wolfram alpha:  Returns 0
https://www.wolframalpha.com/input/?i=10+choose+12

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:02:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 02:02:46 +0000
Subject: [issue27987] obmalloc's 8-byte alignment causes undefined behavior
In-Reply-To: <1473207430.19.0.578630759123.issue27987@psf.upfronthosting.co.za>
Message-ID: <1559527366.82.0.165019292103.issue27987@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution: wont fix -> fixed
versions:  -Python 2.7, Python 3.6, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27987>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:13:08 2019
From: report at bugs.python.org (Windson Yang)
Date: Mon, 03 Jun 2019 02:13:08 +0000
Subject: [issue26468] shutil.copy2 raises OSError if filesystem doesn't
 support chmod
In-Reply-To: <1456910519.95.0.44073308632.issue26468@psf.upfronthosting.co.za>
Message-ID: <1559527988.13.0.22826070604.issue26468@roundup.psfhosted.org>


Change by Windson Yang <wiwindson at outlook.com>:


----------
keywords: +patch
pull_requests: +13651
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13765

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26468>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:14:54 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 03 Jun 2019 02:14:54 +0000
Subject: [issue33569] dataclasses InitVar does not maintain any type info
In-Reply-To: <1526647195.4.0.682650639539.issue33569@psf.upfronthosting.co.za>
Message-ID: <1559528094.45.0.954275507221.issue33569@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:


New changeset 01ee12ba35a333e8a6a25c4153c4a21838e9585c by Eric V. Smith (Augusto Hack) in branch 'master':
bpo-33569 Preserve type information with dataclasses.InitVar (GH-8927)
https://github.com/python/cpython/commit/01ee12ba35a333e8a6a25c4153c4a21838e9585c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33569>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:15:21 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 03 Jun 2019 02:15:21 +0000
Subject: [issue33569] dataclasses InitVar does not maintain any type info
In-Reply-To: <1526647195.4.0.682650639539.issue33569@psf.upfronthosting.co.za>
Message-ID: <1559528121.62.0.0546384944779.issue33569@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Thanks for the PR!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33569>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:19:20 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Mon, 03 Jun 2019 02:19:20 +0000
Subject: [issue35761] Allow dataclasses to be updated in place
In-Reply-To: <1547734989.68.0.404239918534.issue35761@roundup.psfhosted.org>
Message-ID: <1559528360.64.0.607190634343.issue35761@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I'm going to reject this. There's nothing special about dataclasses that would require a feature like this.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35761>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:27:43 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 02:27:43 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559528863.09.0.855921596654.issue35431@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I'm going to repeat part of an earlier comment :-)

"""
Please resist pointless feature creep.  The original report was about comb(n, k) for integer n and k with 0 <= k <= n and that's all.  Everyone who commented appeared to agree they'd find that useful.
"""

Why can't we take universal agreement for an initial answer? ;-)

Looking at what other packages do doesn't really interest me, unless they differ on the cases everyone agreed would be useful - they have different audiences than Python has.  Guess what Wolfram returns for

(-4) choose (-5)

Go ahead.  That's right:  -4.  Sheesh - I don't care who their audience is, _any_ code calling `choose` with those arguments would be far better served if the function complained.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:32:22 2019
From: report at bugs.python.org (David Radcliffe)
Date: Mon, 03 Jun 2019 02:32:22 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1559527193.76.0.127445663463.issue35431@roundup.psfhosted.org>
Message-ID: <CAJ7c8CkRAEfDf+NjY7Jkh2Zdw9Bq_exdh5mrgDugE7H0a+b3Pg@mail.gmail.com>


David Radcliffe <dradcliffe at gmail.com> added the comment:

I understand that pure mathematics is not the primary use case. But I would
expect that math.comb() would be used to implement mathematical formulas.
As a simple example, the number of edges in a complete graph on n vertices
is binomial(n, 2), and this should be valid if n < 2. Polynomial
interpolation is another problem where this can occur. However, I do agree
that binomial coefficients with negative arguments are relatively
unimportant.

On Sun, Jun 2, 2019 at 8:59 PM Raymond Hettinger <report at bugs.python.org>
wrote:

>
> Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:
>
> Here are a few other data points.  There is no consensus but either
> returning 0 or erroring out seem reasonable.
>
> MS Excel's COMBIN: If number < 0, number_chosen < 0, or number <
> number_chosen, COMBIN returns the #NUM! error value.
>
> Scipy.misc.comb: If k > N, N < 0, or k < 0, then a 0 is returned.
>
> Matlib.nchoose: Error: K must an integer between 0 and N.
>
> Maple.numbcomb: Unclear from the docs what this does
>
> Wolfram alpha:  Returns 0
> https://www.wolframalpha.com/input/?i=10+choose+12
>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue35431>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:38:23 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Mon, 03 Jun 2019 02:38:23 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559529503.64.0.392700800359.issue33608@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

Again, happy to provide ssh access to the koobs-freebsd-current worker to help analysis, just PM me ssh public keys on IRC (koobs @ #python-dev freenode)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Sun Jun  2 22:47:11 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 03 Jun 2019 02:47:11 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559530031.47.0.963150288096.issue37134@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Please don?t call on just me. If you really don?t want this, call on the Steering Council.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Sun Jun  2 23:42:58 2019
From: report at bugs.python.org (Windson Yang)
Date: Mon, 03 Jun 2019 03:42:58 +0000
Subject: [issue37086] time.sleep error message misleading
In-Reply-To: <1559126222.88.0.100290912588.issue37086@roundup.psfhosted.org>
Message-ID: <1559533378.93.0.387289844128.issue37086@roundup.psfhosted.org>


Windson Yang <wiwindson at outlook.com> added the comment:

I just create a PR for it.

----------
nosy: +Windson Yang

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37086>
_______________________________________

From report at bugs.python.org  Sun Jun  2 23:43:22 2019
From: report at bugs.python.org (Windson Yang)
Date: Mon, 03 Jun 2019 03:43:22 +0000
Subject: [issue37086] time.sleep error message misleading
In-Reply-To: <1559126222.88.0.100290912588.issue37086@roundup.psfhosted.org>
Message-ID: <1559533402.49.0.142042322578.issue37086@roundup.psfhosted.org>


Change by Windson Yang <wiwindson at outlook.com>:


----------
keywords: +patch
pull_requests: +13652
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13768

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37086>
_______________________________________

From report at bugs.python.org  Sun Jun  2 23:45:17 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 03:45:17 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1559533517.59.0.215093185601.issue36546@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13653
pull_request: https://github.com/python/cpython/pull/13769

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Sun Jun  2 23:46:26 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 03:46:26 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559533586.05.0.733130515448.issue35431@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I'm not fatally opposed to relaxing k <= n.  David makes some good points about it, and - as Raymond already noted - "0" is consistent with the behavior of itertools.combinations().

The docs would need to change, though, because the factorial "definition" would no longer make sense.  Defining it in terms of the falling factorial would, but that's too obscure for Python's audience.  Probably a combinatorial definition would be best:  `comb(n, k) is the number of k-element subsets of an n-element set".  Then it's clear that n and k are cardinals (integers >= 0), and that the result is 0 when k > n.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun  2 23:52:54 2019
From: report at bugs.python.org (Dobatymo)
Date: Mon, 03 Jun 2019 03:52:54 +0000
Subject: [issue37005] bz2 module doesn't write end-of-stream marker
In-Reply-To: <1558496168.36.0.56962236665.issue37005@roundup.psfhosted.org>
Message-ID: <1559533974.53.0.138646595759.issue37005@roundup.psfhosted.org>


Dobatymo <the-real-hazzard at outlook.com> added the comment:

Sorry, I forgot about the bit alignment when I was checking for the footer. This can be closed then.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37005>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:07:49 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 04:07:49 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1559534869.77.0.355353051426.issue36546@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset cba9f84725353455b0995bd47d0fa8cb1724464b by Raymond Hettinger in branch 'master':
bpo-36546: Add design notes to aid future discussions (GH-13769)
https://github.com/python/cpython/commit/cba9f84725353455b0995bd47d0fa8cb1724464b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:16:10 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 03 Jun 2019 04:16:10 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
Message-ID: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>


New submission from Gregory P. Smith <greg at krypto.org>:

The undefined behavior sanitizer buildbot is flagging a bunch of issues in master (3.8) of late:

AssertionError: 'Objects/classobject.c:74:29: runtime erro[139 chars]re\n' != ''
- Objects/classobject.c:74:29: runtime error: null pointer passed as argument 2, which is declared to never be null
- /usr/include/string.h:43:28: note: nonnull attribute specified here

 (see https://buildbot.python.org/all/#/builders/135/builds/1937/steps/5/logs/stdio)

This appears to be coming from a relatively new classobject.c:method_vectorcall() function

method_vectorcall(PyObject *method, PyObject *const *args,
                  size_t nargsf, PyObject *kwnames)

Which looks like it is probably being called with NULL args value and thus winds up calling memcpy() with src=NULL.

This was introduced in https://github.com/python/cpython/commit/aacc77fbd77640a8f03638216fa09372cc21673d for the PEP 590 implementation.

----------
assignee: Mark.Shannon
components: Interpreter Core
messages: 344378
nosy: Mark.Shannon, gregory.p.smith
priority: normal
severity: normal
stage: needs patch
status: open
title: PEP 590 method_vectorcall calls memcpy with NULL src
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:20:45 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 04:20:45 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559535645.74.0.780137588903.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Sorry, I thought that as the BDFL delegate for PEP 570, you would be the person to ask. Adding the Steering Council members to the nosy list.

----------
nosy: +barry, brett.cannon, ncoghlan, willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:22:09 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 04:22:09 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559535729.43.0.673688893102.issue33694@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13654
pull_request: https://github.com/python/cpython/pull/13769

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:51:43 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 03 Jun 2019 04:51:43 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1559537503.57.0.334509540436.issue35070@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the analysis and the PR!  It turns out the problem is not new to 10.14; as you discovered, it's simply a matter of how may groups a particular user is in and, with all the system-generated groups, that number may vary from release to release and from user to user - which explains why the problem is not always reproducible.  I've added a few review comments to the PR.

----------
title: test_posix fails on macOS 10.14 Mojave -> test_getgrouplist may fail on macOS if user in too many groups
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:56:45 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 04:56:45 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559537805.48.0.33779647737.issue37132@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Ya, I'm mostly with Raymond.  `math` was originally a very thin wrapper around C's libm, but we've been moving away from that more and more for decades, and it's no longer the case anyway that the vast bulk of new Python programmers are intimately familiar with C.

If I were coming new to Python now, I'd expect math functions to ... be in `math` ;-)  Whether integer or float.  I expect this will work fine if the docs are - as Raymond suggests - reworked to make it clear.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Mon Jun  3 00:59:16 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 03 Jun 2019 04:59:16 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559537956.91.0.22818412698.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Two design issues:

1. As I said 2017-06-20, msg296499, I expect to add more alternatives to the standard run to this menu option and dialog.  (Cheryl, I should have pointed you to this post as well as the later ones.)  I want to add just one new option to have only 1 new key to learn.  I already cannot remember all of them and I expect I am not the only one.  They need to be together on one dialog so that uses can conveniently pick multiple options when that makes sense.  Running in a console with args is completely sensible.  And exclusionary logic, such as 'Cannot supply arguments if no restart' should be easier on one dialog.

The configuration and pseudoevent names, perhaps 'run-custom', should be changed to reflect that now.  For the menu, I am less sure.  Perhaps 'Run Custom', 'Run Setup', 'Run with Alternatives', 'Alternate Runs'?

2. I am pretty sure I prefer shift-F5 for the key.  (But cannot be sure until I try it.)  Easier to learn I think.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun  3 01:12:08 2019
From: report at bugs.python.org (Ma Lin)
Date: Mon, 03 Jun 2019 05:12:08 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1559538728.9.0.196774309883.issue21872@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
nosy: +Ma Lin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Mon Jun  3 01:59:52 2019
From: report at bugs.python.org (Friedel Wolff)
Date: Mon, 03 Jun 2019 05:59:52 +0000
Subject: [issue37029] PyObject_Free is O(N) where N = # of arenas
In-Reply-To: <1558676037.99.0.0721055204531.issue37029@roundup.psfhosted.org>
Message-ID: <1559541592.31.0.953716586323.issue37029@roundup.psfhosted.org>


Friedel Wolff <friedel at translate.org.za> added the comment:

I had a bit of time and access to a pretty big machine, so I ran the remove-arena-search branch with the same number of iterations, but also 2x and 4x as many. I attach the output in case it is interesting. The timings seem to be growing linearly with the number of strings. The teardown finishes within minutes.

----------
nosy: +fwolff
Added file: https://bugs.python.org/file48385/free_arenas.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37029>
_______________________________________

From report at bugs.python.org  Mon Jun  3 02:15:52 2019
From: report at bugs.python.org (Roundup Robot)
Date: Mon, 03 Jun 2019 06:15:52 +0000
Subject: [issue30458] [security][CVE-2019-9740][CVE-2019-9947] HTTP Header
 Injection (follow-up of CVE-2016-5699)
In-Reply-To: <1495638091.75.0.96439752743.issue30458@psf.upfronthosting.co.za>
Message-ID: <1559542552.23.0.424680836557.issue30458@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +13655
pull_request: https://github.com/python/cpython/pull/13771

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30458>
_______________________________________

From report at bugs.python.org  Mon Jun  3 02:46:54 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 06:46:54 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559544414.65.0.445712205612.issue17576@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> Can we at least switch to PyLong_CheckExact?

+1

> I am not sure that converting to an exact int in low-level C API functions is the best option.

I am sure. :-)  The number of naturally-occurring cases where we're actually passing a subtype of `int` that's not exactly `int` should be tiny. So long as there's a PyLong_CheckExact fast path, I don't think there are really any performance concerns here.

And we definitely shouldn't let performance concerns dictate API; get the API right first, _then_ see what can be done about performance without changing the API. It's clear to me that `operator.index(obj)` _should_ give the exact same results as `obj.__index__()`.

I'll split my PR up into two pieces, one for turning the deprecated behaviour into TypeErrors, and a second one that just makes the PyLong_CheckExact change. (I likely won't have time before feature freeze, though. OTOH, the PyLong_CheckExact change could be considered a bugfix.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Mon Jun  3 02:52:40 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Mon, 03 Jun 2019 06:52:40 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559544760.78.0.915210857966.issue37135@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Would be nice if someone could post a gdb backtrace of the core dump.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:10:51 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 03 Jun 2019 07:10:51 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559545851.95.0.630272206643.issue17576@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Can we at least switch to PyLong_CheckExact?

This is a behavior change and as such should be preceded by a period of warning.

If we go this way I propose to add a FutureWarning for int subclasses with overridden __index__.

As for turning the deprecated behaviour into TypeErrors, we added yet few deprecation warnings in 3.8. Would not be better to turn all of them into TypeErrors at the same time?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:13:59 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 03 Jun 2019 07:13:59 +0000
Subject: [issue37132] Add a module for integer related math functions
In-Reply-To: <1559472897.43.0.110105466613.issue37132@roundup.psfhosted.org>
Message-ID: <1559546039.69.0.713602988224.issue37132@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Well, then closing this.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37132>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:33:29 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Mon, 03 Jun 2019 07:33:29 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559547209.39.0.173553333594.issue33694@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
nosy:  -yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:34:31 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 07:34:31 +0000
Subject: [issue35814] Syntax quirk with variable annotations
In-Reply-To: <1548308739.94.0.144807070146.issue35814@roundup.psfhosted.org>
Message-ID: <1559547271.52.0.545339452107.issue35814@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 8565f6b6db0fa9f65449b532a5056a98bad3dc37 by Pablo Galindo in branch 'master':
bpo-35814: Allow unpacking in r.h.s of annotated assignment expressions (GH-13760)
https://github.com/python/cpython/commit/8565f6b6db0fa9f65449b532a5056a98bad3dc37


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35814>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:49:34 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 07:49:34 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559548174.89.0.706524577362.issue33694@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13656
pull_request: https://github.com/python/cpython/pull/13760

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 03:51:50 2019
From: report at bugs.python.org (jpic)
Date: Mon, 03 Jun 2019 07:51:50 +0000
Subject: [issue34155] email.utils.parseaddr mistakenly parse an email
In-Reply-To: <1559416833.73.0.0656305198822.issue34155@roundup.psfhosted.org>
Message-ID: <CAC6Op1_QpNxpuY6x=HsEnLmq1_y82VTg5khfi0vt_rWQ-xdsag@mail.gmail.com>


jpic <jpic at yourlabs.org> added the comment:

Thanks for your explanation, but in perspective with other invalid
domains, such as "foo." currently resulting in an empty string too:

>>> email.message_from_string('From: a at foo.',policy=email.policy.default)['from'].addresses[0].domain
''

Do you think this should also change the value of domain to "foo." ?

Also yes with parseaddr it seems that domain is an empty string if it
didn't find a valid domain at all, which is pretty safe in case of
malicious injection attempt - if that's what we're trying to save
python programs from, a clarification of the objective of the patch
would be welcome.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34155>
_______________________________________

From report at bugs.python.org  Mon Jun  3 04:08:03 2019
From: report at bugs.python.org (Batuhan)
Date: Mon, 03 Jun 2019 08:08:03 +0000
Subject: [issue31006] typing.NamedTuple should add annotations to its
 constructor (__new__) parameters.
In-Reply-To: <1500887267.27.0.393959457135.issue31006@psf.upfronthosting.co.za>
Message-ID: <1559549283.64.0.231306437643.issue31006@roundup.psfhosted.org>


Batuhan <batuhanosmantaskaya at gmail.com> added the comment:

IMHO this issue can be closed with this commit (https://github.com/python/typing/commit/435b29470c7d3e87055531f65681bee9746ab999)

----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31006>
_______________________________________

From report at bugs.python.org  Mon Jun  3 04:26:16 2019
From: report at bugs.python.org (=?utf-8?b?5p6X6Ieq5Z2H?=)
Date: Mon, 03 Jun 2019 08:26:16 +0000
Subject: [issue34763] Python lacks 0x4E17
In-Reply-To: <1537543820.35.0.956365154283.issue34763@psf.upfronthosting.co.za>
Message-ID: <1559550376.23.0.323125663527.issue34763@roundup.psfhosted.org>


??? <johnlinp at gmail.com> added the comment:

"?" means "30" in Japanese. However, it is a variant Chinese character to "?", where "?" means "world" in Chinese.

I'm not sure if this information makes any difference.

----------
nosy: +johnlinp

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34763>
_______________________________________

From report at bugs.python.org  Mon Jun  3 04:52:55 2019
From: report at bugs.python.org (Louis Abraham)
Date: Mon, 03 Jun 2019 08:52:55 +0000
Subject: [issue37139] Inconsistent behavior of email.header.decode_header
Message-ID: <1559551975.38.0.600668913696.issue37139@roundup.psfhosted.org>


New submission from Louis Abraham <louis.abraham at yahoo.fr>:

Hi,

(this is my first issue btw)

I think <https://docs.python.org/3/library/email.header.html#email.header.decode_header> has a broken behavior.

It returns a list of `(decoded_string, charset)` pairs. However, `decoded_string` can be either a string or bytes.
I have no preference but it should really be of one type.

----------
messages: 344392
nosy: louis.abraham at yahoo.fr
priority: normal
severity: normal
status: open
title: Inconsistent behavior of email.header.decode_header

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37139>
_______________________________________

From report at bugs.python.org  Mon Jun  3 04:57:17 2019
From: report at bugs.python.org (Oleksandr Pavliuk)
Date: Mon, 03 Jun 2019 08:57:17 +0000
Subject: [issue34788] ipaddress module fails on rfc4007 scoped IPv6 addresses
In-Reply-To: <1537799403.03.0.956365154283.issue34788@psf.upfronthosting.co.za>
Message-ID: <1559552237.36.0.465126824746.issue34788@roundup.psfhosted.org>


Change by Oleksandr Pavliuk <ragnarok49 at gmail.com>:


----------
keywords: +patch
pull_requests: +13657
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13772

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34788>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:18:31 2019
From: report at bugs.python.org (Bruce Merry)
Date: Mon, 03 Jun 2019 09:18:31 +0000
Subject: [issue32052] Provide access to buffer of asyncio.StreamReader
In-Reply-To: <1510859388.33.0.213398074469.issue32052@psf.upfronthosting.co.za>
Message-ID: <1559553511.94.0.157541915907.issue32052@roundup.psfhosted.org>


Bruce Merry <bmerry at gmail.com> added the comment:

Ok, I'll open a separate issue to allow a tuple of possible separators.

----------
nosy: +bmerry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32052>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:21:37 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 09:21:37 +0000
Subject: [issue37140] ctypes change made clang fail to build
Message-ID: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>


New submission from Petr Viktorin <encukou at gmail.com>:

Hello,
I haven't investigated this fully yet, and won't be able to find time today. I'm forwarding the report here in case someone familiar with the code wants to take a look.

On Fedora, "clang" fails to build with Python 3.8, probably due this change (which was supposed to be Windows-only):
https://github.com/python/cpython/commit/32119e10b792ad7ee4e5f951a2d89ddbaf111cc5#diff-998bfefaefe2ab83d5f523e18f158fa4R413

According to serge_sans_paille: if ``self->b_ptr`` contains pointer, the ``memcpy`` creates sharing, and this is dangerous: if a ``__del__`` happens to free the original pointer, we end up with a dangling reference in ``new_ptr``. As far as I can tell, this is what happens in the clang bindings code.

Fedora discussion with link to logs: https://bugzilla.redhat.com/show_bug.cgi?id=1715016

----------
components: ctypes
messages: 344394
nosy: petr.viktorin
priority: normal
severity: normal
status: open
title: ctypes change made clang fail to build
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:22:13 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 03 Jun 2019 09:22:13 +0000
Subject: [issue35947] Update libffi_msvc to current version of libffi
In-Reply-To: <1549665646.45.0.12391127948.issue35947@roundup.psfhosted.org>
Message-ID: <1559553733.36.0.944675169576.issue35947@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Possible regression caused by this change: https://bugs.python.org/issue37140

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35947>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:30:24 2019
From: report at bugs.python.org (SilentGhost)
Date: Mon, 03 Jun 2019 09:30:24 +0000
Subject: [issue37139] Inconsistent behavior of email.header.decode_header
In-Reply-To: <1559551975.38.0.600668913696.issue37139@roundup.psfhosted.org>
Message-ID: <1559554224.65.0.174350962354.issue37139@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

This seem like a duplicate of #24797. I hope the answer given there applies.

----------
components: +email
nosy: +SilentGhost, barry, r.david.murray
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> email.header.decode_header return type is not consistent
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37139>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:32:31 2019
From: report at bugs.python.org (Bruce Merry)
Date: Mon, 03 Jun 2019 09:32:31 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
Message-ID: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>


New submission from Bruce Merry <bmerry at gmail.com>:

Text-based protocols sometimes allow a choice of newline separator - I work with one that allows either \r or \n. Unfortunately that doesn't work with StreamReader.readuntil, which only accepts a single separator, so I've had to do some hacky things to obtain lines without having to 

>From discussion in issue 32052, it sounded like extending StreamReader.readuntil to support a tuple of separators would be feasible.

----------
components: asyncio
messages: 344397
nosy: asvetlov, bmerry, yselivanov
priority: normal
severity: normal
status: open
title: Allow multiple separators in StreamReader.readuntil
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 05:51:07 2019
From: report at bugs.python.org (serge-sans-paille)
Date: Mon, 03 Jun 2019 09:51:07 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559555467.72.0.46586555372.issue37140@roundup.psfhosted.org>


Change by serge-sans-paille <serge.guelton at telecom-bretagne.eu>:


----------
nosy: +serge-sans-paille

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:00:56 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 10:00:56 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559556056.95.0.89725013544.issue37141@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Would you make a PR?
I guess to modify Stream.readuntil() 
StreamReader is deprecated, I'm not sure if we should add new functionality to this class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:02:11 2019
From: report at bugs.python.org (Tom Hale)
Date: Mon, 03 Jun 2019 10:02:11 +0000
Subject: [issue36656] Race conditions due to os.link and os.symlink POSIX
 specification
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559556131.25.0.976043024039.issue36656@roundup.psfhosted.org>


Change by Tom Hale <tomnott at gmail.com>:


----------
title: Allow os.symlink(src, target, force=True) to prevent race conditions -> Race conditions due to os.link and os.symlink POSIX specification

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:06:38 2019
From: report at bugs.python.org (Bruce Merry)
Date: Mon, 03 Jun 2019 10:06:38 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559556398.85.0.16884467632.issue37141@roundup.psfhosted.org>


Bruce Merry <bmerry at gmail.com> added the comment:

I wasn't aware of that deprecation - it doesn't seem to be mentioned at https://docs.python.org/3.8/library/asyncio-stream.html. What is the replacement?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:08:43 2019
From: report at bugs.python.org (Louis Abraham)
Date: Mon, 03 Jun 2019 10:08:43 +0000
Subject: [issue37139] Inconsistent behavior of email.header.decode_header
In-Reply-To: <1559551975.38.0.600668913696.issue37139@roundup.psfhosted.org>
Message-ID: <1559556523.78.0.412403070062.issue37139@roundup.psfhosted.org>


Louis Abraham <louis.abraham at yahoo.fr> added the comment:

Indeed, this is exactly the same (I should have researched more, my bad).

The problem is that I'm using mailbox.Maildir which uses the Compat32 API.

Do you think I should create an issue for Maildir to support the new EmailMessage API?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37139>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:08:56 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 10:08:56 +0000
Subject: [issue34467] No mechanism to abort created coroutine or suppress
 not-awaited warning
In-Reply-To: <1534975363.12.0.56676864532.issue34467@psf.upfronthosting.co.za>
Message-ID: <1559556536.43.0.271929587629.issue34467@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Could you consider passing (async_func, args, kwargs) tuple instead async_func(*args, **kwargs) coroutine?

Looks like it solves your problem and doesn't require asyncio changes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34467>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:16:07 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 03 Jun 2019 10:16:07 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1559556967.09.0.832380830229.issue36231@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +13658
pull_request: https://github.com/python/cpython/pull/13773

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:18:39 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 10:18:39 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559557119.18.0.263430903274.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thank you, Raymond, for sharing your concerns regarding this. I am sorry you disagree with this change.

I would want to expose the reasons I think this is important and justified, but please, don't read this
as a way of dismissing your concerns; I really respect your opinion and judgment (as an example, I am waiting
until you are happy with the API in issue17005 even if that meant waiting 2 years until the next release).

1) The docstrings for these functions already show the "/". As Matthias Bussonnier from IPython and Jupyter has expressed
multiple times, there are a ton of users that do not read html documentation and rely solely on the output from help (either
in Jupyter, IPython or CPython). These users find very strange that the signatures of the docstrings differ when they actually
check the html docs. Some examples of the docstrings:

>>> help(zlib.decompress)
    decompress(data, /, wbits=15, bufsize=16384)
    Returns a bytes object containing the uncompressed data.

>> help(codecs.register)
register(search_function, /)
    Register a codec search function.

2) This communicates the users more explicitly how to call the function and what to expect when this happens,
which is the purpose of documenting signatures in the documentation. We are already documenting keyword-only
parameters for the same reasons.

3) This PR is not changing any of the signatures, is just documenting and informing users what the signature is
and how it will behave. Is just expressing information. The documentation must be user-friendly, but also needs to
be technical.

4) We are already documenting positional-only arguments in multiple other functions in the documentation. This PR just
continues doing that. Some examples of the many cases:

https://docs.python.org/3.8/library/functools.html#functools.partialmethod
https://docs.python.org/3.8/library/threading.html#threading.excepthook
https://docs.python.org/3.8/library/inspect.html#inspect.getcallargs
...

5) I give training sessions to different levels (people that are starting to program, Juniors and Seniors) and they are always
confused when the signature of the function in the documentation does not match the docstring or the actual way of calling the function.
This also includes when we use constructs like f(x, ...), f(x, [y=None,]), f(K) -> V or similar because they are not valid Python
signatures and they do not appear elsewhere. In general, my experience is that people want the signature documented as close as possible
to the real signature in the technical documentation.

I wished we could have iterate over this together having a good discussion before involving the steering council, and I am sorry
if you were afraid that your concerns would have not been listened to. Sadly, I have not answered before because it was 1:26 in the morning
here when you posted your message. I have left the PR open and opened an issue because is the normal workflow and because this allows people
to express here their opinion. 

I think this change is important, but I also think of working together and respecting and understanding everyone's point of view
is much more important. If you think me pushing for this change will impact somehow our ability to work together I will close the PR
and the issue.

For now, I won't do anything before the steering council decides what to do.

I apologize to everyone or the wall of text.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:20:47 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 10:20:47 +0000
Subject: [issue36048] Deprecate implicit truncating when convert Python
 numbers to C integers: use __index__, not __int__
In-Reply-To: <1550644985.32.0.26417547244.issue36048@roundup.psfhosted.org>
Message-ID: <1559557247.34.0.0359267455435.issue36048@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
pull_requests: +13659
pull_request: https://github.com/python/cpython/pull/13740

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36048>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:26:01 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 10:26:01 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559557561.38.0.450219241541.issue37141@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Docs will be updated soon.
The change has landed a week ago, I had no time for docs update before 3.8 beta. Sorry for that.

The idea is: StreamReader and StreamWriter are merged into just Stream, open_connection() is replaced with connect() etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:28:35 2019
From: report at bugs.python.org (Bruce Merry)
Date: Mon, 03 Jun 2019 10:28:35 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559557715.71.0.92157064219.issue37141@roundup.psfhosted.org>


Bruce Merry <bmerry at gmail.com> added the comment:

Ok. Does the new Stream still have a similar interface for readuntil i.e. is this still a relevant request against the new API? I'm happy to let deprecated APIs stay as-is.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:33:13 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 10:33:13 +0000
Subject: [issue37141] Allow multiple separators in StreamReader.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559557993.47.0.508678693785.issue37141@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Yes, Stream supports all StreamReader and StreamWriter methods

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:34:46 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 10:34:46 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559558086.46.0.701396640952.issue17576@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I've closed the PR. Reassigning back to Ethan.

----------
assignee: mark.dickinson -> ethan.furman
nosy: +ethan.furman

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:34:51 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 03 Jun 2019 10:34:51 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1559558091.75.0.285897112793.issue36231@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 0288dd6a5192074fcd5aa0db5d3513c3880209ca by Ned Deily in branch 'master':
bpo-36231:  Support building on macOS without /usr/include (GH-13773)
https://github.com/python/cpython/commit/0288dd6a5192074fcd5aa0db5d3513c3880209ca


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:35:23 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 10:35:23 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559558123.74.0.82715217827.issue17576@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy:  -mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:36:04 2019
From: report at bugs.python.org (Tom Hale)
Date: Mon, 03 Jun 2019 10:36:04 +0000
Subject: [issue36656] Race conditions due to os.link and os.symlink POSIX
 specification
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559558164.8.0.968470115752.issue36656@roundup.psfhosted.org>


Tom Hale <tomnott at gmail.com> added the comment:

Serhiy wrote

> Detected problem is better than non-detected problem.

I agree. I also assert that no problem (via a shutil wrapper) is better than a detected problem which may not be handled.

While it's up to the programmer to handle exceptions, it's only systems programmers who will realise that there is a sometimes-occurring exception which should be handled.

So most people won't handle it. They don't know that they need to.

The shutil os.link and os.symlink wrappers under discussion on python-ideas prevent non-system-programmers from needing to know about the race-condition case (and correctly handling it).

If something is difficult to get right, then let's put it in shutil and save everyone reinventing the wheel.

3 specific cases in which an atomic link replacement would be useful are listed here:

https://code.activestate.com/lists/python-ideas/56195/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:38:04 2019
From: report at bugs.python.org (Bruce Merry)
Date: Mon, 03 Jun 2019 10:38:04 +0000
Subject: [issue37141] Allow multiple separators in Stream.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559558284.69.0.660876627928.issue37141@roundup.psfhosted.org>


Bruce Merry <bmerry at gmail.com> added the comment:

Ok, I've changed the issue title to refer to Stream. Since this would be a new feature, I assume it's off the table for 3.8, but I'll see if I get time to implement a PR in time for 3.9 (and get someone at work to sign off on the contributor agreement, which might be the harder part).

Thanks for the quick and helpful responses.

----------
title: Allow multiple separators in StreamReader.readuntil -> Allow multiple separators in Stream.readuntil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Mon Jun  3 06:43:28 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 10:43:28 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559558608.68.0.305040516381.issue37135@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I am unable to reproduce this locally, will post here a backtrace if I manage to do so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 07:21:43 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 03 Jun 2019 11:21:43 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559560903.03.0.922107332822.issue33694@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +13660
pull_request: https://github.com/python/cpython/pull/13773

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 07:23:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 11:23:39 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559561019.18.0.525385349287.issue37134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-37116.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 07:23:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 11:23:47 +0000
Subject: [issue37116] Use PEP 570 syntax for positional-only parameters
In-Reply-To: <1559314061.29.0.391357031696.issue37116@roundup.psfhosted.org>
Message-ID: <1559561027.0.0.592374087951.issue37116@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-37134.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37116>
_______________________________________

From report at bugs.python.org  Mon Jun  3 07:27:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 11:27:33 +0000
Subject: [issue37116] Use PEP 570 syntax for positional-only parameters
In-Reply-To: <1559314061.29.0.391357031696.issue37116@roundup.psfhosted.org>
Message-ID: <1559561253.01.0.196060727183.issue37116@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> New changeset 2085bd0877e17ad4d98a4586d5eabb6faecbb190 by Serhiy Storchaka in branch 'master':
> bpo-37116: Use PEP 570 syntax for positional-only parameters. (GH-13700)
> https://github.com/python/cpython/commit/2085bd0877e17ad4d98a4586d5eabb6faecbb190

Oh thanks, this change is really nice! It shows that PEP 570 is really useful!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37116>
_______________________________________

From report at bugs.python.org  Mon Jun  3 07:40:50 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 03 Jun 2019 11:40:50 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1559528863.09.0.855921596654.issue35431@roundup.psfhosted.org>
Message-ID: <20190603114029.GX4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

For what its worth, there are concrete, practical applications for 
binomial coefficients with negative arguments. They are used in 
fractional calculus

https://nrich.maths.org/1365

which in turn has applications in physics, chemistry and other sciences:

https://en.wikipedia.org/wiki/Fractional_calculus#Applications

Take that however you see fit :-)

My own preference is for a comb() function that returns 0 for out of 
bounds values (e.g. "choose 5 items from 4"), and a seperate binomial() 
function that accepts any positive or negative integer values. Even I 
think that fractional and complex arguments are probably a bit too 
exotic for the std lib -- that's Mathematica territory.

And yes, Mathematica does accept fractional and complex arguments to 
the choose() function.

https://www.wolframalpha.com/input/?i=choose%28sqr%28-3.5%29,+sqrt%28-4%2Bi%29%29

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:23:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:23:44 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
Message-ID: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

https://buildbot.python.org/all/#/builders/168/builds/1135

running: test_asyncio (23 min 23 sec)
running: test_asyncio (23 min 53 sec)
running: test_asyncio (24 min 23 sec)
running: test_asyncio (24 min 53 sec)
0:38:48 load avg: 0.32 [423/423/1] test_asyncio crashed (Exit code 1)
Timeout (0:25:00)!
Thread 0x0000000800ac3000 (most recent call first):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/selectors.py", line 558 in select
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/asyncio/base_events.py", line 1808 in _run_once
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/asyncio/base_events.py", line 563 in run_forever
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/asyncio/base_events.py", line 595 in run_until_complete
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_asyncio/test_streams.py", line 1531 in test_stream_server_abort
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 628 in _callTestMethod
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 671 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 731 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/runner.py", line 176 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/support/__init__.py", line 1984 in _run_suite
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/support/__init__.py", line 2080 in run_unittest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 203 in _test_module
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 228 in _runtest_inner2
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 264 in _runtest_inner
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 135 in _runtest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 187 in runtest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest_mp.py", line 66 in run_tests_worker
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 611 in _main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 588 in main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 663 in main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/regrtest.py", line 46 in _main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/regrtest.py", line 50 in <module>
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/runpy.py", line 85 in _run_code
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/runpy.py", line 192 in _run_module_as_main

== Tests result: FAILURE ==


...

======================================================================
ERROR: test_stdin_stdout (test.test_asyncio.test_subprocess.SubprocessMultiLoopWatcherTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_asyncio/test_subprocess.py", line 130, in test_stdin_stdout
    exitcode, stdout = self.loop.run_until_complete(task)
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/asyncio/base_events.py", line 608, in run_until_complete
    return future.result()
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/asyncio/tasks.py", line 464, in wait_for
    raise exceptions.TimeoutError()
asyncio.exceptions.TimeoutError

----------
components: Tests
messages: 344415
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_asyncio timed out on AMD64 FreeBSD CURRENT Shared 3.x
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:23:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:23:52 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559564632.73.0.0234673671632.issue37142@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:27:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:27:45 +0000
Subject: [issue37143] multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION
 on Python on x86 Windows7 3.x
Message-ID: <1559564865.07.0.954701975633.issue37143@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Maybe it's related to bpo-33608:
https://bugs.python.org/issue33608#msg340143


https://buildbot.python.org/all/#/builders/58/builds/2558

0:42:36 load avg: 5.63 [299/423/1] test_venv crashed (Exit code 1)
Timeout (0:35:00)!
Thread 0x00000e00 (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1332 in _readerthread
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 865 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 923 in _bootstrap_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap

Thread 0x00000150 (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1332 in _readerthread
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 865 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 923 in _bootstrap_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap

Thread 0x00000d40 (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 1015 in _wait_for_tstate_lock
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 999 in join
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1361 in _communicate
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 999 in communicate
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 40 in check_output
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 327 in test_multiprocessing
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 628 in _callTestMethod
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 671 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 731 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\runner.py", line 176 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1984 in _run_suite
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 2080 in run_unittest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 203 in _test_module
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 228 in _runtest_inner2
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 264 in _runtest_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 135 in _runtest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 187 in runtest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest_mp.py", line 66 in run_tests_worker
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 611 in _main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 588 in main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 663 in main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\regrtest.py", line 46 in _main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\regrtest.py", line 50 in <module>
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 85 in _run_code
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 192 in _run_module_as_main

...

ERROR: test_multiprocessing (test.test_venv.BasicTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 327, in test_multiprocessing
    out, err = check_output([envpy, '-c',
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 42, in check_output
    raise subprocess.CalledProcessError(
subprocess.CalledProcessError: Command '['d:\\temp\\tmpf38yk5w1\\Scripts\\python_d.exe', '-c', 'from multiprocessing import Pool; print(Pool(1).apply_async("Python".lower).get(3))']' returned non-zero exit status 3221225477.


where 3221225477 = 0xc0000005 = EXCEPTION_ACCESS_VIOLATION

----------
components: Tests
messages: 344416
nosy: vstinner
priority: normal
severity: normal
status: open
title: multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION on Python on x86 Windows7 3.x
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37143>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:28:34 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 03 Jun 2019 12:28:34 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559564914.99.0.670844392032.issue37142@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +asyncio
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:28:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:28:44 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559564924.27.0.741484220333.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> So far so good. :)  I'll keep an eye on things and if the buildbots are still happy then I'll add back _PyEval_FinishPendingCalls() in _Py_FinalizeEx() in a few days.

Another crash, on Windows:
https://bugs.python.org/issue37143

It sounds like the exactly same bug is back: same crash on same buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:31:12 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 12:31:12 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559565072.24.0.898940906066.issue26219@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 91234a16367b56ca03ee289f7c03a34d4cfec4c8 by Inada Naoki in branch 'master':
bpo-26219: per opcode cache for LOAD_GLOBAL (GH-12884)
https://github.com/python/cpython/commit/91234a16367b56ca03ee289f7c03a34d4cfec4c8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:39:50 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 12:39:50 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559565590.81.0.521600564869.issue26219@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I committed cache only for LOAD_GLOBAL, which is much simpler than
LOAD_ATTR or LOAD_METHOD.

Caches for other instructions will be implemented 3.9 or later.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:45:41 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 12:45:41 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559565941.0.0.230597546668.issue33694@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13661
pull_request: https://github.com/python/cpython/pull/12884

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:53:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:53:59 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566439.73.0.705262992187.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11628

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:01 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566441.27.0.47191238298.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11627

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:03 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566443.18.0.369942598853.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11626

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:20 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566460.59.0.128395007995.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11593

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:22 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566462.46.0.617483618505.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11594

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:24 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566464.39.0.00334576304772.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11595

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:57 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566497.49.0.295671336661.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -10918

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:54:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:54:58 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566498.98.0.0627050584367.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -10917

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:09 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 12:55:09 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559566509.69.0.243016939011.issue26219@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13662
pull_request: https://github.com/python/cpython/pull/13775

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:10 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566510.96.0.494992803061.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11249

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:12 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566512.82.0.846412366583.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11248

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:28 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566528.81.0.269868404809.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11335

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:30 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566530.71.0.095876794098.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11334

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:49 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566549.4.0.81464597852.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11257

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:55:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:55:51 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566551.14.0.112725204528.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11258

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:04 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566564.5.0.136917281485.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11583

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:06 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566566.41.0.762807699551.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11584

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:20 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566580.55.0.725548713026.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11523

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:22 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566582.31.0.566613662672.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11524

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:37 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566597.97.0.65618508417.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11263

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:39 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566599.89.0.961301477137.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11264

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:54 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566614.97.0.292917103067.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11586

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:56:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:56:57 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566617.42.0.595341068457.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11587

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 08:57:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 12:57:16 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559566636.17.0.949548675566.issue35537@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -11476

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Mon Jun  3 09:31:15 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 13:31:15 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559568675.87.0.917697017005.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Given that (a) we're right up against feature freeze, and (b) the discussions about API already happened in plenty of good time some months ago, leading to agreement on the initial API, I think we should avoid any last-minute changes and stick with what we have for 3.8. Then we can have a more relaxed discussion about what, if anything, should be changed for 3.9.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 09:34:34 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 13:34:34 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559568874.83.0.888527692095.issue26219@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 395420e2a35937fa9777fc3c8b0086629db95e27 by Inada Naoki in branch 'master':
bpo-26219: remove unused code (GH-13775)
https://github.com/python/cpython/commit/395420e2a35937fa9777fc3c8b0086629db95e27


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Mon Jun  3 09:52:41 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 13:52:41 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559569961.77.0.557234123361.issue33694@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13663
pull_request: https://github.com/python/cpython/pull/13775

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 10:25:40 2019
From: report at bugs.python.org (=?utf-8?q?R=C3=A9mi_Lapeyre?=)
Date: Mon, 03 Jun 2019 14:25:40 +0000
Subject: [issue37030] Lib/cmd.py: Hide undocumented commands in help and
 completenames
In-Reply-To: <1558682753.85.0.407660629596.issue37030@roundup.psfhosted.org>
Message-ID: <1559571940.71.0.467310617539.issue37030@roundup.psfhosted.org>


R?mi Lapeyre <remi.lapeyre at henki.fr> added the comment:

It will be done automatically after someone validated the PR.

----------
nosy: +remi.lapeyre

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37030>
_______________________________________

From report at bugs.python.org  Mon Jun  3 10:54:20 2019
From: report at bugs.python.org (DM)
Date: Mon, 03 Jun 2019 14:54:20 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
Message-ID: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>


New submission from DM <darkamaul at hotmail.fr>:

According to the documentation, tarfile.open accepts a path-like object since Python 3.6

However, it is not the case when writing a compressed gzip (w|gz).
See the attached file for minimal POC

Note 1: tested on 3.6 and 3.7
Note 2: https://docs.python.org/3.6/library/tarfile.html#tarfile.open

----------
components: Library (Lib)
files: poc.py
messages: 344423
nosy: dm
priority: normal
severity: normal
status: open
title: tarfile.open: improper handling of path-like object
type: behavior
versions: Python 3.6, Python 3.7
Added file: https://bugs.python.org/file48386/poc.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Mon Jun  3 10:58:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 14:58:17 +0000
Subject: [issue37143] multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION
 on Python on x86 Windows7 3.x
In-Reply-To: <1559564865.07.0.954701975633.issue37143@roundup.psfhosted.org>
Message-ID: <1559573897.5.0.178537895838.issue37143@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

On Windows 10, I ran "python -m test test_venv -m test_multiprocessing -F" for 8 min, and "python -m test test_multiprocessing_spawn" in parallel. I failed to reproduce the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37143>
_______________________________________

From report at bugs.python.org  Mon Jun  3 10:59:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 14:59:27 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559573967.61.0.120774119564.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

https://bugs.python.org/issue33608#msg340075:

> My procedure to reproduce the crash on FreeBSD:
> https://bugs.python.org/issue36114#msg337092

I ran this test for 20 min on the FreeBSD CURRENT buildbot: I failed to reproduce the bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:04:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:04:03 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559574243.82.0.247681040865.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

https://buildbot.python.org/all/#/builders/167/builds/1188

Variant:

test_cancel_both_task_and_inner_future (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok
test_cancel_current_task (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok
test_cancel_gather_1 (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests)
Ensure that a gathering future refuses to be cancelled once all ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)
Dangling thread: <_MainThread(MainThread, started 34389124096)>
ok
test_cancel_gather_2 (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok
test_cancel_inner_future (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok
test_cancel_task_catching (test.test_asyncio.test_tasks.CTaskSubclass_PyFuture_Tests) ... ok

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:16:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:16:50 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559575010.04.0.209564295674.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-34037: "asyncio: BaseEventLoop.close() shutdowns the executor without waiting causing leak of dangling threads".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:22:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:22:36 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559575356.03.0.376390400608.issue37137@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13664
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13779

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:26:02 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 15:26:02 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559575562.25.0.533457942974.issue37135@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Adding the release manager to consider this

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:30:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:30:54 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559575854.11.0.0265370242236.issue33608@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13665
pull_request: https://github.com/python/cpython/pull/13780

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:31:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:31:54 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559575914.8.0.780293241694.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> It sounds like the exactly same bug is back: same crash on same buildbots.

Since it became clear to me that the change broke multiple buildbots and nobody is able to investigate the issue, I wrote PR 13780 to revert the change:
https://pythondev.readthedocs.io/ci.html#revert-on-fail

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:35:37 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 15:35:37 +0000
Subject: [issue34763] Treat U+4E17 as a numeric value
In-Reply-To: <1537543820.35.0.956365154283.issue34763@psf.upfronthosting.co.za>
Message-ID: <1559576137.05.0.108781846107.issue34763@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
title: Python lacks 0x4E17 -> Treat U+4E17 as a numeric value

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34763>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:39:28 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 03 Jun 2019 15:39:28 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559576368.27.0.517924181077.issue36974@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13666
pull_request: https://github.com/python/cpython/pull/13781

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:43:42 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:43:42 +0000
Subject: [issue37087] Adding native id support for openbsd
In-Reply-To: <1559147565.3.0.574292103957.issue37087@roundup.psfhosted.org>
Message-ID: <1559576622.92.0.954364313222.issue37087@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0b9956e9162d8723c2a30ff316ecc25e54459fb1 by Victor Stinner (David Carlier) in branch 'master':
bpo-37087: Adding native ID support for OpenBSD (GH-13654)
https://github.com/python/cpython/commit/0b9956e9162d8723c2a30ff316ecc25e54459fb1


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37087>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:44:34 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Mon, 03 Jun 2019 15:44:34 +0000
Subject: [issue34155] email.utils.parseaddr mistakenly parse an email
In-Reply-To: <1532012023.85.0.56676864532.issue34155@psf.upfronthosting.co.za>
Message-ID: <1559576674.83.0.516404321395.issue34155@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I agree that we currently abandon parsing (raise `HeaderParseError`) when we encounter a unexpected token when parsing domain (expected token is dot-atom-text).

However, that mechanism is meant to signal the higher level parser that we should look for a different type of token. In case of domain, we don't fallback to anything.

I believe we should fallback to `get_unstructured` when we do encounter an invalid domain (either `foo.` or `foo at exaomple` or `foo at example.com`) and register defect. But, the `.domain` attribute on the address class should be None if the domain is invalid.

My proposed solution of `get_unstrucutured` is perhaps not a great idea either since we would end up parsing more than we should (maybe we should parse until `>`?) in case of AddrList or something.

I would love to know what David and Barry think about this one?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34155>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:46:14 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Mon, 03 Jun 2019 15:46:14 +0000
Subject: [issue34155] email.utils.parseaddr mistakenly parse an email
In-Reply-To: <1532012023.85.0.56676864532.issue34155@psf.upfronthosting.co.za>
Message-ID: <1559576774.06.0.110426553557.issue34155@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

slight typo in the previous message:

s/fallback to `get_unstructured` /fallback to *something*/g

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34155>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:49:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:49:09 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559576949.48.0.989738976517.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 49a7e347976c9b39149ac7505b11ad6e9e2bdeec by Victor Stinner in branch 'master':
bpo-37137: Fix test_asyncio: use TestCase.set_event_loop() (GH-13779)
https://github.com/python/cpython/commit/49a7e347976c9b39149ac7505b11ad6e9e2bdeec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:52:22 2019
From: report at bugs.python.org (Eric Snow)
Date: Mon, 03 Jun 2019 15:52:22 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559577142.76.0.6866795475.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Please wait on reverting.  I'm going to investigate.

@koobs, yeah, I'll send you a key.  Thanks! :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:58:28 2019
From: report at bugs.python.org (Eric Snow)
Date: Mon, 03 Jun 2019 15:58:28 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559577508.9.0.898215631372.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

FWIW, the failures before were in test_io and test_multiprocessing_spawn, not test_asyncio.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:58:49 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 15:58:49 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559577529.47.0.394012053166.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I don't have a preference one way or the other (both ways have plausible arguments, error checking vs utility beyond simple combinatorics, and both ways have ample precedents).

That said, if we're going to ultimately relax the constraints, it would be better to do it now before the API is released.  

Even if we were already in feature freeze, it would be okay to change it (the purpose of a beta is to elicit end-user feedback which is what David has just given).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 11:59:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 15:59:41 +0000
Subject: [issue37087] Adding native id support for openbsd
In-Reply-To: <1559147565.3.0.574292103957.issue37087@roundup.psfhosted.org>
Message-ID: <1559577581.09.0.814874150291.issue37087@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks David Carlier :-)

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37087>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:08:00 2019
From: report at bugs.python.org (Eric Snow)
Date: Mon, 03 Jun 2019 16:08:00 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559578080.59.0.731812705036.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

I had really hoped to get this in for 3.8, as I may need it.  However, realistically I doubt it will take just a few minutes to resolve this.  With the beta 1 targeted for today it makes sense to revert my change. :(

(I may still try to convince our fearless RM to allow it in beta 2, but we'll see.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:09:16 2019
From: report at bugs.python.org (SilentGhost)
Date: Mon, 03 Jun 2019 16:09:16 +0000
Subject: [issue37139] Inconsistent behavior of email.header.decode_header
In-Reply-To: <1559551975.38.0.600668913696.issue37139@roundup.psfhosted.org>
Message-ID: <1559578156.41.0.578913340145.issue37139@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

There seems to be some work started in #32975. Perhaps, you'd like to revive it or contribute otherwise?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37139>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:12:08 2019
From: report at bugs.python.org (Xiang Zhang)
Date: Mon, 03 Jun 2019 16:12:08 +0000
Subject: [issue34763] Treat U+4E17 as a numeric value
In-Reply-To: <1537543820.35.0.956365154283.issue34763@psf.upfronthosting.co.za>
Message-ID: <1559578328.76.0.569134806298.issue34763@roundup.psfhosted.org>


Xiang Zhang <angwerzx at 126.com> added the comment:

unicode.org doesn't list "?" as numeric so I think there is nothing we can do.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34763>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:13:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 16:13:34 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1559577508.9.0.898215631372.issue33608@roundup.psfhosted.org>
Message-ID: <CA+3bQGHPGk564UHWp-92mx78R+m=W=dp6YZ2gyuyjjr+7BQLYQ@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

> FWIW, the failures before were in test_io and test_multiprocessing_spawn,
not test_asyncio.

I am not aware of a test_asyncio issue related to this issue, only crashes
in multiprocessing. I bet on a similar crash than the previous attempt,
during shutdown.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:14:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 16:14:39 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559578479.84.0.515771407081.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset e225bebc1409bcf68db74a35ed3c31222883bf8f by Victor Stinner in branch 'master':
Revert "bpo-33608: Factor out a private, per-interpreter _Py_AddPendingCall(). (gh-13714)" (GH-13780)
https://github.com/python/cpython/commit/e225bebc1409bcf68db74a35ed3c31222883bf8f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:23:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 16:23:20 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559579000.5.0.722072175899.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

What annoy me the most in this issue is that I am unable to reproduce it. Even directly on the FreeBSD CURRENT buildbot, I failed to reproduce rhe crash even when I stressed the buildbot and the test.

On the other side, when the CI runs the test suite, crashes are likely!?

These bugs are the worst.

IMHO we must make multiprocessing more deterministic. Python 3.8 is better, but there are still many known issues.
https://pythondev.readthedocs.io/unstable_tests.html

test_venv multiprocessing test misuses the multiprocessing issue, it emirs a ResourceWarning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:40:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 16:40:31 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559580031.59.0.10279239492.issue33608@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My bet is that multiprocessing triggers a bug in daemon threads. Multiprocessing is using and abusing daemon threads. For example, as I wrote, test_venv misuses the multiprocessing API and implicitly let Python release (or maybe not!) "resources" where "resources" can be processes and threads, likely including daemon threads.

Eric: I would love to give you access to a VM where I can reproduce the bug but... I failed to reproduce the bug today :-(

I would suggest to write a stress test for daemon threads:

* spawn daemon threads: 4x times threads than CPU to stress the system
* each thread would sleep a random number of milliseconds and then execute a few pure Python instructions
* spawns these threads, wait a random number of milliseconds, and then "exit Python"

The race condition is that daemon threads may or maybe run during Python finalization depending on the delay.

Maybe you can make the crash more likely by adding a sleep of a few *seconds* before the final exit. For example, at the exit of Py_RunMain().

Last time I saw the crash, it was a thread which uses a Python structure whereas the memory of the structure was freed (filled with a random pattern by debug hooks on memory allocators).

Ah, either use a debug build of Python, or use PYTHONMALLOC=debug, or -X dev command line option, to fill freed memory with a specific pattern, to trigger the crash.

... Good luck.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:46:14 2019
From: report at bugs.python.org (Eric Snow)
Date: Mon, 03 Jun 2019 16:46:14 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559580374.4.0.883655005135.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Well, for this PR I actually disabled the execution of pending calls during runtime finialization.  I'd hoped it would help, but it did not. :(

Regardless, I'll need to look even more closely at what is different during runtime finalization with my PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:47:07 2019
From: report at bugs.python.org (Eric Snow)
Date: Mon, 03 Jun 2019 16:47:07 +0000
Subject: [issue33608] Add a cross-interpreter-safe mechanism to indicate that
 an object may be destroyed.
In-Reply-To: <1527017681.69.0.682650639539.issue33608@psf.upfronthosting.co.za>
Message-ID: <1559580427.24.0.451912462309.issue33608@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Also, thanks for the suggestions, Victor!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33608>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:48:36 2019
From: report at bugs.python.org (Geoffrey Sneddon)
Date: Mon, 03 Jun 2019 16:48:36 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
Message-ID: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>


New submission from Geoffrey Sneddon <geoffers+pythonbugs at gmail.com>:

The mixin methods on MappingView and its subclasses all rely on the undocumented MappingView._mapping (set in the undocumented MappingView.__init__).

This should probably be documented at least insofar as Set._from_iterable is.

----------
assignee: docs at python
components: Documentation
messages: 344447
nosy: docs at python, gsnedders
priority: normal
severity: normal
status: open
title: collections.abc.MappingView mixins rely on undocumented _mapping
type: behavior
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Mon Jun  3 12:56:29 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 16:56:29 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559580989.34.0.288545352228.issue35431@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Python needs a benevolent dictator ;-)

I'd be happy for Mark, Raymond, or me to play that role here.  If it were me, I'd drop the k <= n requirement:  both arguments must be non-negative integers.  Because a combinatorial (not factorial-, and certainly not gamma-, based) definition of `comb()` is best suited for Python's general audience, and "number of ways to pick k things out of n without regard to order" makes clear sense for any pair of non-negative k and n.  But anything beyond that does not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:00:53 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 03 Jun 2019 17:00:53 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559581253.53.0.513811619606.issue37145@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +rhettinger
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:04:35 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 03 Jun 2019 17:04:35 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559581475.64.0.227296603442.issue37135@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:

FTR Victor reverted GH-13714 that triggers this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:13:13 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 17:13:13 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559581993.2.0.360030024896.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> If it were me, I'd drop the k <= n requirement

+1 from me.

----------
versions: +Python 3.8 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:16:22 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 17:16:22 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559582182.77.0.155063201001.issue37145@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The _mapping attribute is a private implementation detail and should remain undocumented.  A user of mapping views creates that attribute via the __init__() method.

In contrast, _from_iterable is explicitly meant to be overridden because it is the only way to control object creation.

Thank you for the suggestion.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:23:12 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 17:23:12 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559582592.88.0.288562615321.issue35431@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Fine by me. The same change should be applied to `math.perm`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:26:54 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 17:26:54 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559582814.98.0.843754876357.issue37135@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> FTR Victor reverted GH-13714 that triggers this.

Given the nature of the bugs, I would recommend to watch the buildbots

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:27:29 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 03 Jun 2019 17:27:29 +0000
Subject: [issue36027] Support negative exponents in pow() where a modulus is
 specified.
In-Reply-To: <1550520659.43.0.126744170658.issue36027@roundup.psfhosted.org>
Message-ID: <1559582849.25.0.616961377507.issue36027@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

@Petr: Thanks for the quick fix!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36027>
_______________________________________

From report at bugs.python.org  Mon Jun  3 13:28:02 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Mon, 03 Jun 2019 17:28:02 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559582882.98.0.60696020178.issue37134@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:10:25 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 18:10:25 +0000
Subject: [issue37081] Test with OpenSSL 1.1.1c
In-Reply-To: <1559058292.64.0.780398663722.issue37081@roundup.psfhosted.org>
Message-ID: <1559585425.57.0.429661738032.issue37081@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:


New changeset 06651ee418b5e4e013195d6b702763a1220706a7 by Christian Heimes in branch 'master':
bpo-37081: Test with OpenSSL 1.1.1c (GH-13631)
https://github.com/python/cpython/commit/06651ee418b5e4e013195d6b702763a1220706a7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37081>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:10:40 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 03 Jun 2019 18:10:40 +0000
Subject: [issue37081] Test with OpenSSL 1.1.1c
In-Reply-To: <1559058292.64.0.780398663722.issue37081@roundup.psfhosted.org>
Message-ID: <1559585440.46.0.768209031008.issue37081@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13667
pull_request: https://github.com/python/cpython/pull/13782

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37081>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:16:17 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 03 Jun 2019 18:16:17 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1559585777.71.0.765290698471.issue37111@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I agree with Paul. Consistency with open() is the most important aspect here, and when we investigated changing that to UTF-8 it was decided to be too disruptive.

That said, I'm not opposed to adding encoding/errors to basicConfig if someone wants to do that (and the logging specialists are okay with it).

----------
resolution: not a bug -> 
stage:  -> test needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:30:40 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 03 Jun 2019 18:30:40 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559586640.34.0.956339020378.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> If you think me pushing for this change will impact somehow
> our ability to work together I will close the PR and the issue. 

Not at all.  I always enjoy working with you and appreciate the depth of thinking you bring to every task :-)

Here, we just disagree on whether changing the docs will be a net aid or net detriment to end users.  My belief is that the docs will be less usable, less intuitive, and less approachable.  People using the docs are already alone and in need of help.  Cryptic notation doesn't make this task easier.  While a person can be trained to read this notation, it is my belief that a person shouldn't have to have training to read the docs.

Unlike other decisions where predicting the future is uncertain, we already have some user testing results because the \ notation was exposed in help() via the argument clinic.  The results have not been favorable.  AFAICT not one single user has benefitted from seeing something like this output from help(len):

    len(obj, /)
        Return the number of items in a container.

The / is a stumbling block. My unscientific twitter poll had mostly WTF reactions from end-users. This wasn't limited to beginners -- Steve Holden and David Beazley have both found this notation detrimental to communication.

This week I joined a twitter thread where I needed to defend the existing docs.  The contention was that docs aren't very usable for end-users and that the existing core devs lacked writing skills and were too interested in technical details rather than plain communication. (I mostly disagree with this, but there is another core dev consistently giving this message in talks all around the world).  The essential point here is that there are already usability concerns with the documentation.  My belief is that this PR will make the situation worse.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:40:01 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 03 Jun 2019 18:40:01 +0000
Subject: [issue37081] Test with OpenSSL 1.1.1c
In-Reply-To: <1559058292.64.0.780398663722.issue37081@roundup.psfhosted.org>
Message-ID: <1559587201.17.0.868268981535.issue37081@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3344197040fe1b05a3244bdb16d429f4647f35b8 by Miss Islington (bot) in branch '3.7':
[3.7] bpo-37081: Test with OpenSSL 1.1.1c (GH-13631) (GH-13782)
https://github.com/python/cpython/commit/3344197040fe1b05a3244bdb16d429f4647f35b8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37081>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:40:18 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 18:40:18 +0000
Subject: [issue34271] Please support logging of SSL master secret by env
 variable SSLKEYLOGFILE
In-Reply-To: <1532867889.16.0.56676864532.issue34271@psf.upfronthosting.co.za>
Message-ID: <1559587218.39.0.789296996288.issue34271@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:


New changeset e35d1ba9eab07a59b98b700c5e18ceb13b2561a6 by Christian Heimes in branch 'master':
bpo-34271: Fix compatibility with 1.0.2 (GH-13728)
https://github.com/python/cpython/commit/e35d1ba9eab07a59b98b700c5e18ceb13b2561a6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34271>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:48:29 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 18:48:29 +0000
Subject: [issue34001] LibreSSL does not tolerate setting minimum_version
 greater than maximum_version
In-Reply-To: <1530288553.74.0.56676864532.issue34001@psf.upfronthosting.co.za>
Message-ID: <1559587709.47.0.416238322285.issue34001@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
pull_requests: +13668
pull_request: https://github.com/python/cpython/pull/13783

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34001>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:51:30 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 03 Jun 2019 18:51:30 +0000
Subject: [issue36868] New behavior of OpenSSL hostname verification not
 exposed, incorrectly documented
In-Reply-To: <1557425747.49.0.948212766878.issue36868@roundup.psfhosted.org>
Message-ID: <1559587890.98.0.151328836607.issue36868@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 47eb2234061524562a4b484e3a395f4fdd6c1b76 by Miss Islington (bot) (Christian Heimes) in branch 'master':
bpo-36868: Fix what's new for SSLContext.hostname_checks_common_name (GH-13248)
https://github.com/python/cpython/commit/47eb2234061524562a4b484e3a395f4fdd6c1b76


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36868>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:51:40 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 03 Jun 2019 18:51:40 +0000
Subject: [issue36868] New behavior of OpenSSL hostname verification not
 exposed, incorrectly documented
In-Reply-To: <1557425747.49.0.948212766878.issue36868@roundup.psfhosted.org>
Message-ID: <1559587900.2.0.531972251256.issue36868@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
pull_requests: +13669
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13784

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36868>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:57:15 2019
From: report at bugs.python.org (Paul Monson)
Date: Mon, 03 Jun 2019 18:57:15 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559588235.44.0.514695211159.issue37140@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

The change causing the build failure comes from this commit.
https://github.com/python/cpython/pull/3806/commits/ea8a0dcea68409d37f3ad9e60e42777c76ad903b

The commit comment says: "Fix copy of structures when passed by value."

Steve, do you recall what this change fixed?

----------
nosy: +Paul Monson, steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:58:59 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 03 Jun 2019 18:58:59 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559588339.78.0.495909885096.issue37130@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

The inconsistency is a bit weird. Looking at https://github.com/python/cpython/blob/master/Lib/pathlib.py#L825 the question is why is self.name not being set for '.' but it is for '..'. I suspect there's special-casing for '.' somewhere that sets self.name to '' for '.' but leaves it alone in all other instances.

Based on what with_name() is supposed to do I would argue that '..' shouldn't work since without a filename the with_name() method makes no sense.

----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Mon Jun  3 14:59:07 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 03 Jun 2019 18:59:07 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559588347.34.0.967041767793.issue37130@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
stage:  -> test needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:00:13 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 19:00:13 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559588413.39.0.302399787338.issue37120@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:


New changeset 78c7d527799dacca91b9ed67057cb996efe526b0 by Christian Heimes in branch 'master':
bpo-37120: Add SSLContext.num_tickets (GH-13719)
https://github.com/python/cpython/commit/78c7d527799dacca91b9ed67057cb996efe526b0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:01:15 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 19:01:15 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559588475.0.0.766825791794.issue37134@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I haven't looked at anything in this PR, so just popping in to confirm that the first time I saw stuff like:

    len(obj, /)

in the docs I had no idea at all what it was trying to say.  I thought it was a typo.

Also the second, third, fourth, ..., times I saw it.

However, because Python didn't _accept_ that syntax in my own function definitions, that may well have made it extraordinarily hard to figure out.

If the syntax is going to be accepted now, that does change things to my eyes.  It becomes a question of discoverability then.

I'll note that Googling on

    python slash in formal argument list

turns up an excellent Stackoverflow explanation as its top hit for me today, although not if "slash" is replaced with "/".

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:02:14 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 03 Jun 2019 19:02:14 +0000
Subject: [issue36868] New behavior of OpenSSL hostname verification not
 exposed, incorrectly documented
In-Reply-To: <1557425747.49.0.948212766878.issue36868@roundup.psfhosted.org>
Message-ID: <1559588534.68.0.531655245365.issue36868@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cad4ff65eb12649cd650059b15d8e12f2ae951ef by Miss Islington (bot) in branch '3.7':
bpo-36868: Fix what's new for SSLContext.hostname_checks_common_name (GH-13248)
https://github.com/python/cpython/commit/cad4ff65eb12649cd650059b15d8e12f2ae951ef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36868>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:02:50 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 19:02:50 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559588570.73.0.91791689035.issue37120@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I have merged the PR to land the feature in time for the feature freeze.

Regarding your comment on client_context.num_ticket getter: IMHO it's not a good idea to raise an exception on attribute access. It may break introspection.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:03:03 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 03 Jun 2019 19:03:03 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559588583.26.0.254517466849.issue37120@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
resolution:  -> fixed
stage: patch review -> commit review
status: open -> pending

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:24:57 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 03 Jun 2019 19:24:57 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559589897.01.0.522570745757.issue37134@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

FYI when Guido said "call on the steering council" I think he meant open an issue at https://github.com/python/steering-council/issues as this will get lost otherwise (i.e. Guido already removed himself from the nosy list so this already doesn't have the whole council participating).

Anyway, from my personal view, I think we should use the syntax. It's officially part of the language at this point and so avoiding it in the docs seems odd, like we're saying that we're ashamed of this syntax and you should pretend it doesn't exist when it does and it isn't going anywhere. Otherwise aren't we're forcing users to realize that the function definition in the docs deviates from what is definable in this one instance and that one has to read the full text to know that something is doable syntactically but we're leaving it out of the docs? It adds inconsistency in what the definition line means IMO based on how we have usually chosen to try and express things in that 'def' line in the docs as succinctly as possible to communicate the semantics of calling that function.

And I realize that Raymond's "unscientific twitter poll had mostly WTF reactions from end-users", but that's also sampling from people who have probably never used the syntax in real life or read docs regularly that use it. I've actually been wanting to use the syntax to say "the name isn't important here" as I've had to already close a PR that wanted to tweak documentation for name consistency where it actually didn't matter because the code used positional-only parameters but they weren't explicitly documented as such. Going back and saying "positional-only" to communicate that everywhere that it applies versus using the syntax we have to express that seems unnecessary to me.

Or put another way, how would you want to update:

len(obj)
        Return the number of items in a container.

to properly reflect the fact that *obj* is positional-only which is now an official concept in the language? We've been glazing over this for ages in the docs because we didn't have a way of expressing it succinctly and it only touched C-implemented code and we lacked a way to state it in Python, but now we have a way to state this fact. You could add a "The **obj** parameter is positional-only.", but to me that requires unnecessary reading of the text body if all I'm doing is checking the parameter order (and maybe the first sentence). And I realize we have gotten away with this until now, but as the concept of positional-only parameters grows that will become more of an issue.

Not using / also means that we're deviating from what help() emits, which could cause its own confusion as more people learn about the new syntax.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 15:27:08 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 03 Jun 2019 19:27:08 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559590028.14.0.914141375483.issue36964@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Changing VIRTUAL_ENV will break code, so I'm not sure if it's worth changing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:34:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 20:34:43 +0000
Subject: [issue37146] opcode cache for LOAD_GLOBAL emits false alarm in memory
 leak hunting
Message-ID: <1559594083.93.0.475089830437.issue37146@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

opcode cache for LOAD_GLOBAL introduced false alarm in memory leak hunting (python3 -m test -R 3:3 ...).

=> opcache: bpo-26219.


Before the change:

$ git checkout 91234a16367b56ca03ee289f7c03a34d4cfec4c8^
$ make && ./python -m test -R 3:3 test_pprint 
...
Tests result: SUCCESS

After the change:

$ git checkout 91234a16367b56ca03ee289f7c03a34d4cfec4c8
$ make && ./python -m test -R 3:3 test_pprint 
...
test_pprint leaked [4, 2, 4] memory blocks, sum=10
...

The problem is that at each iteration of regrtest -R 3:3 (6 iterations), a few more code objects get this opcache allocated.

There are different solutions to fix regrtest -R 3:3.


(*) Always optimize:

diff --git a/Python/ceval.c b/Python/ceval.c
index 411ba3d73c..6cd148efba 100644
--- a/Python/ceval.c
+++ b/Python/ceval.c
@@ -103,7 +103,7 @@ static long dxp[256];
 #endif
 
 /* per opcode cache */
-#define OPCACHE_MIN_RUNS 1024  /* create opcache when code executed this time */
+#define OPCACHE_MIN_RUNS 1  /* create opcache when code executed this time */
 #define OPCACHE_STATS 0  /* Enable stats */
 
 #if OPCACHE_STATS

$ make && ./python -m test -R 3:3 test_pprint 
...
Tests result: SUCCESS


(*) Never optimmize: disable opcache until a better fix can be found

diff --git a/Python/ceval.c b/Python/ceval.c
index 411ba3d73c..3c85df6fea 100644
--- a/Python/ceval.c
+++ b/Python/ceval.c
@@ -1230,6 +1230,7 @@ _PyEval_EvalFrameDefault(PyFrameObject *f, int throwflag)
     f->f_stacktop = NULL;       /* remains NULL unless yield suspends frame */
     f->f_executing = 1;
 
+#if 0
     if (co->co_opcache_flag < OPCACHE_MIN_RUNS) {
         co->co_opcache_flag++;
         if (co->co_opcache_flag == OPCACHE_MIN_RUNS) {
@@ -1244,6 +1245,7 @@ _PyEval_EvalFrameDefault(PyFrameObject *f, int throwflag)
 #endif
         }
     }
+#endif
 
 #ifdef LLTRACE
     lltrace = _PyDict_GetItemId(f->f_globals, &PyId___ltrace__) != NULL;

$ make && ./python -m test -R 3:3 test_pprint 
...
Tests result: SUCCESS


(*) Find a way to explicitly deoptimize all code objects

Modules/gcmodule.c has a clear_freelists() function called by collect() if generation == NUM_GENERATIONS-1: on when gc.collect() is collected explicitly for example.

Lib/test/libregrtest/refleak.py also has a dash_R_cleanup() function which clears many caches.

Problem: currently, code objects are not explicitly tracked (for example, they are not tracked in a double linked list).


(*) Add way more warmup iterations to regrtest in buildbots.

I dislike this option. A build on a refleak buildbot worker already takes 2 to 3 hours. Adding more warmup would make a build even way more slower.

----------
components: Interpreter Core
messages: 344469
nosy: inada.naoki, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: opcode cache for LOAD_GLOBAL emits false alarm in memory leak hunting
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37146>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:35:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 20:35:16 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559594116.57.0.972403853357.issue26219@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The opcode cache introduced an issue in reference leak hunting: see bpo-37146.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:38:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 20:38:32 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559594312.81.0.825744185457.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My change didn't fix the issue:

https://buildbot.python.org/all/#/builders/176/builds/680

test_proc_exited (test.test_asyncio.test_subprocess.SubprocessTransportTests) ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:45:13 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 03 Jun 2019 20:45:13 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559594713.05.0.165947930713.issue37124@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I have no idea. I don't ever use msilib, but there are a few people who do that don't have any way to get bugs fixed, so I'll help merge.

If it's just the test leak, probably it's in the test. I don't recall the change having any impact on resource usage. But at worst, removing the test completely is fine by me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:49:18 2019
From: report at bugs.python.org (Carol Willing)
Date: Mon, 03 Jun 2019 20:49:18 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559594958.24.0.689891356934.issue37134@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Tim's message resonated with me. Confusing users is something that I believe that we wish to minimize. I confess that I had a similar reaction as Tim when I saw functions with a trailing `/`. What I did find helpful was adding to the middle of the parameter list as was done in Serihy's earlier PRs.

Since we are balancing technical accuracy with user confusion (docs and docstrings), I propose the following: 

1. Remove the trailing / from 3.8 documentation but leave the / if it occurs in the middle of the parameter list. This increases technical accuracy from pre-3.8 and gives users more time to get comfortable with the change (since end users have found this a confusing area with args kwargs *).

2. Add to the documentation in 3.8 section on positional only parameters a note box that describes that in many/all cases where a / is not specified at the end and no * is found in the parameter list that a trailing slash would be accurate.

3. Give users time to absorb the positional only change in 3.8. Perhaps writing a blog post that explains in detail.

4. Add the trailing / in 3.9 documentation to make consistent with docstrings or improve/create a better directive for function that provides a better accuracy and less confusion. A Sphinx extension may also be made to show a simple user-friendly view and with a click the fully accurate view.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:51:08 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 03 Jun 2019 20:51:08 +0000
Subject: [issue37029] PyObject_Free is O(N) where N = # of arenas
In-Reply-To: <1558676037.99.0.0721055204531.issue37029@roundup.psfhosted.org>
Message-ID: <1559595068.96.0.0750225134751.issue37029@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Thank you, Friedl!  I appreciate the extra confirmation - and especially on even bigger test cases :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37029>
_______________________________________

From report at bugs.python.org  Mon Jun  3 16:58:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 20:58:20 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559595500.81.0.61766889989.issue37137@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13670
pull_request: https://github.com/python/cpython/pull/13786

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:00:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 21:00:25 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559595625.47.0.800064744294.issue34037@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote PR 13786 to fix this issue.

----------
versions: +Python 3.8 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:09:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 21:09:09 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559596149.75.0.111730442538.issue34037@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

"executor.shutdown(wait=False)" was added by this change:

commit 4ca7355901049ff9a873cf236091e6780d7a8126
Author: Antoine Pitrou <solipsis at pitrou.net>
Date:   Sun Oct 20 00:54:10 2013 +0200

    Issue #19299: fix refleak test failures in test_asyncio

Guido van Rossum proposed to wait for the executor. Guido proposed " executor.shutdown(wait=False)", but he didn't comment why wait=False:

https://bugs.python.org/issue19299#msg200508

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:31:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 21:31:27 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559597487.42.0.954478265449.issue34037@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0f0a30f4da4b529e0f7df857b9f575b231b32758 by Victor Stinner in branch 'master':
bpo-34037, asyncio: add BaseEventLoop.wait_executor_on_close (GH-13786)
https://github.com/python/cpython/commit/0f0a30f4da4b529e0f7df857b9f575b231b32758


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:31:37 2019
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Mon, 03 Jun 2019 21:31:37 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559597497.39.0.586201144706.issue36707@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

It's usually just custom ugly-hardcoded autotools/cmake. Nothing severe enough.  However, this change still is not documented anywhere in https://docs.python.org/dev/whatsnew/3.8.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:32:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 21:32:26 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559597546.13.0.216713911629.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I push a fix in asyncio, instead of trying to fix individual asyncio tests:

New changeset 0f0a30f4da4b529e0f7df857b9f575b231b32758 by Victor Stinner in branch 'master':
bpo-34037, asyncio: add BaseEventLoop.wait_executor_on_close (GH-13786)
https://github.com/python/cpython/commit/0f0a30f4da4b529e0f7df857b9f575b231b32758

See https://bugs.python.org/issue34037#msg344476

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:35:29 2019
From: report at bugs.python.org (Geoffrey Sneddon)
Date: Mon, 03 Jun 2019 21:35:29 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559597729.08.0.293471881106.issue37145@roundup.psfhosted.org>


Geoffrey Sneddon <geoffers+pythonbugs at gmail.com> added the comment:

How do you use ItemsView without:

 * relying on __init__ and _mapping, which are both private implementation details, or
 * reimplementing __len__, __contains__, and __iter__?

Given you can't use the mixin implementations of __len__, __contains__, and __iter__ without relying on private implementation details, should they actually be considered mixin implementations? Shouldn't they just be abstract methods given you can't actually use them?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:40:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 21:40:55 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559598055.54.0.571941195503.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My second attempt isn't fully successful :-( test_asyncio still fails with ENV_CHANGED :-(

https://buildbot.python.org/all/#/builders/185/builds/488

test_current_task_no_running_loop_implicit (test.test_asyncio.test_tasks.CCurrentLoopTests) ... Warning -- threading_cleanup() failed to cleanup -1 threads (count: 0, dangling: 1)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 17:56:55 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 03 Jun 2019 21:56:55 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559599015.5.0.326741084989.issue37134@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

I agree with Brett and Carol here.  This is part of the language syntax.  We can educate people to that effect more if desired (I like the blog post idea).  People will figure it out.

We've already got high ranked stackoverflow answers related to this when you search:
 https://stackoverflow.com/questions/24735311/python-what-does-the-slash-mean-in-help-output/
 https://stackoverflow.com/questions/28243832/what-is-the-meaning-of-a-forward-slash-in-a-python-method-signature-as-show/

Today, we don't document what is positional only, adding this notation is an improvement because it communicates that detail to anyone interested in understanding it without adding a pile of text to all sorts of function signatures.

----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:19:57 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 22:19:57 +0000
Subject: [issue37146] opcode cache for LOAD_GLOBAL emits false alarm in memory
 leak hunting
In-Reply-To: <1559594083.93.0.475089830437.issue37146@roundup.psfhosted.org>
Message-ID: <1559600397.63.0.372584536089.issue37146@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +13671
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13787

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37146>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:20:59 2019
From: report at bugs.python.org (Tim Burke)
Date: Mon, 03 Jun 2019 22:20:59 +0000
Subject: [issue37093] http.client aborts header parsing upon encountering
 non-ASCII header names
In-Reply-To: <1559172729.29.0.908018369806.issue37093@roundup.psfhosted.org>
Message-ID: <1559600459.73.0.503020187226.issue37093@roundup.psfhosted.org>


Change by Tim Burke <tim.burke at gmail.com>:


----------
keywords: +patch
pull_requests: +13672
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/13788

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37093>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:24:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 22:24:18 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559600658.77.0.0474082768011.issue36707@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> It's usually just custom ugly-hardcoded autotools/cmake. Nothing severe enough.  However, this change still is not documented anywhere in https://docs.python.org/dev/whatsnew/3.8.html

I concur that it should be documented. It's on my TODO list. But I'm not sure of what are the things impacting by ABIFLAGS="" rather than ABIFLAGS="m". Someone has to propose a PR to document that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:27:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 22:27:26 +0000
Subject: [issue37146] opcode cache for LOAD_GLOBAL emits false alarm in memory
 leak hunting
In-Reply-To: <1559594083.93.0.475089830437.issue37146@roundup.psfhosted.org>
Message-ID: <1559600846.09.0.989719348715.issue37146@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13673
pull_request: https://github.com/python/cpython/pull/13789

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37146>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:28:34 2019
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Mon, 03 Jun 2019 22:28:34 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559600914.91.0.763076336491.issue36707@roundup.psfhosted.org>


Miro Hron?ok <miro at hroncok.cz> added the comment:

I'm not sure either. So far most affected buildscripts are confused by:

/usr/include/python3.Xm -> /usr/include/python3.X
/usr/lib64/libpython3.Xm -> /usr/lib64/libpython3.X
extension.cpython-3Xm-arch-linux-gnu.so -> extension.cpython-3X-arch-linux-gnu.so

However this is pretty much Linux specific, so I wouldn't know how to explain this in an OS agnostic way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:36:47 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 22:36:47 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1559601407.1.0.772108367855.issue36889@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13674
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/13790

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:38:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 22:38:13 +0000
Subject: [issue37146] opcode cache for LOAD_GLOBAL emits false alarm in memory
 leak hunting
In-Reply-To: <1559594083.93.0.475089830437.issue37146@roundup.psfhosted.org>
Message-ID: <1559601493.12.0.983659322915.issue37146@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset eddef861b49f1635222a9e1771231c34a807debf by Victor Stinner (Inada Naoki) in branch 'master':
bpo-37146: disable opcache when Py_DEBUG is defined (GH-13787)
https://github.com/python/cpython/commit/eddef861b49f1635222a9e1771231c34a807debf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37146>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:41:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 22:41:07 +0000
Subject: [issue37146] opcode cache for LOAD_GLOBAL emits false alarm in memory
 leak hunting
In-Reply-To: <1559594083.93.0.475089830437.issue37146@roundup.psfhosted.org>
Message-ID: <1559601667.51.0.433890899055.issue37146@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

INADA-san wrote PR 13787 to disable opcache when Python is compiled in debug mode. Pablo and me approved the change, so I merged it.

Pablo wrote a more robust solution, PR 13789, to disable opcache only in regrtest, to look for memory leaks. But INADA-san had a good argument against this approach:
https://github.com/python/cpython/pull/13789#issuecomment-498449735

"The code object will be optimized only when ++co->co_opcache_flag == opcacheminruns. So decreasing min_runs by _setopcacheminruns()will cause some hot codes will be not optimized forever. I don't want to expose such switch."

I would prefer to keep this issue until a long term approach is designed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37146>
_______________________________________

From report at bugs.python.org  Mon Jun  3 18:48:57 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Mon, 03 Jun 2019 22:48:57 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1559602137.19.0.825765877205.issue5680@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

I've pushed a change for a more generic dialog for a 'Run Custom' option and I changed the keybinding to Shift-F5.  Sorry for not doing that on the initial commit; I didn't fully understand the difference between what you were asking for and the minimal version I had committed.

For this change, I also added a 'Restart shell' checkbox to the dialog, more as a proof-of-concept than anything else (although I did hook it up, so it should be functional).  Is this the type of dialog you had in mind?

I made some comments on the PR as to some of the decisions I've run into so far with the design.

Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:08:50 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 03 Jun 2019 23:08:50 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559603330.49.0.995466012422.issue35763@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +13675
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/13791

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:13:59 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:13:59 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559603639.32.0.361195472309.issue37137@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I suspect that I've added this dangling thread by https://github.com/python/cpython/blob/master/Lib/asyncio/unix_events.py#L1248-L1251 :(

----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:18:13 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 03 Jun 2019 23:18:13 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559603893.33.0.24013222837.issue33694@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13676
pull_request: https://github.com/python/cpython/pull/13787

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:21:47 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:21:47 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559604107.14.0.340763927483.issue33694@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
nosy:  -asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:26:55 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 23:26:55 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1559604415.41.0.184302737223.issue33694@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy:  -pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:27:57 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:27:57 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559604477.02.0.0641895076493.issue37137@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Working on PR

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:30:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 23:30:01 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559604601.27.0.803880982396.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I suspect that I've added this dangling thread by https://github.com/python/cpython/blob/master/Lib/asyncio/unix_events.py#L1248-L1251 :(

Can you please try to revert commit 13ed07998ad93dbdd94991ba0451b9b559f07972?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:33:44 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:33:44 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559604824.85.0.196699064375.issue37137@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13677
pull_request: https://github.com/python/cpython/pull/13792

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:35:06 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:35:06 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559604906.38.0.951370902084.issue37137@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

We have two options:
1. Apply https://github.com/python/cpython/pull/13792 to wait for dangling threads
2. Revert added watchers entirely

What do you prefer?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:38:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 23:38:33 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559605113.31.0.731847053599.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> 2. Revert added watchers entirely

I prefer this option just because we must fix all bugs as soon as possible to get the beta1 released, and this bug is just one bug in a list of bugs.

I might try to help you *later* to fix the change to prevent this bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:42:22 2019
From: report at bugs.python.org (Paul Monson)
Date: Mon, 03 Jun 2019 23:42:22 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559605342.18.0.856674823246.issue37140@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

If I undo the changes to StructUnionType_paramfunc then test_pass_by_value (ctypes.test.test_structures.StructureTestCase) fails on x64 on Windows.  Looking at the code I don't think this is specific to Windows.

This is a test for fixing this issue: https://bugs.python.org/issue29565

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:45:51 2019
From: report at bugs.python.org (Dino Viehland)
Date: Mon, 03 Jun 2019 23:45:51 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559605551.66.0.732780590111.issue36839@roundup.psfhosted.org>


Dino Viehland <dinoviehland at gmail.com> added the comment:

The 20MB of savings is actually the amount of byte code that exists in the IG code base.  I was just measuring the web site code, and not the other various Python code in the process (e.g. no std lib code, no 3rd party libraries, etc...).  The IG code base is pretty monolithic and starting up the site requires about half of the code to get imported.  So I think the 20MB per process is a pretty realistic number.

I've also created a C extension and the object implementing the buffer protocol looks like:

typedef struct {
    PyObject_HEAD
    const char* data;
    size_t size;
    Py_ssize_t hash;
    CIceBreaker *breaker;
    size_t exports;
    PyObject* code_obj; /* borrowed reference, the code object keeps us alive */
} CIceBreakerCode;

All of the modules are currently getting compiled into a single memory mapped file and then these objects get created which implement the buffer protocol for each function.  So the overhead it just takes a byte code w/ 16 opcodes before it breaks even, so it is significantly lighter weight than using a memoryview object.

It's certainly true that the byte code isn't the #1 source of memory here (the code objects themselves are pretty big), but in the serialized state it ends up representing 25% of the serialized data.  I would expect when you add in ref counts and typing information it's not quite as good, but reducing the overhead of code by 20% is still a pretty nice win.

I can't make any promises about open sourcing the import system, but I can certainly look into that as well.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:46:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 03 Jun 2019 23:46:21 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559605581.09.0.462001272741.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> FTR Victor reverted GH-13714 that triggers this.

Sadly, this revert wasn't enough. New fresh coredump on "AMD64 FreeBSD CURRENT Shared 3.x":
https://buildbot.python.org/all/#builders/168/builds/1145

Warning -- Dangling processes: {<SpawnProcess
name='SharedMemoryManager-313' pid=12404 parent=11647 started>}
Warning -- Dangling processes: {<SpawnProcess
name='SharedMemoryManager-313' pid=12404 parent=11647 started>}
Warning -- multiprocessing.process._dangling was modified by
test_multiprocessing_spawn
  Before: set()
  After:  {<weakref at 0x80273a890; to 'SpawnProcess' at 0x8029f6b40>}
Warning -- files was modified by test_multiprocessing_spawn
  Before: []
  After:  ['python.core']

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:46:42 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Mon, 03 Jun 2019 23:46:42 +0000
Subject: [issue31006] typing.NamedTuple should add annotations to its
 constructor (__new__) parameters.
In-Reply-To: <1500887267.27.0.393959457135.issue31006@psf.upfronthosting.co.za>
Message-ID: <1559605602.07.0.00145917221993.issue31006@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

Thanks! It looks like this was fixed in typing and then forward ported to CPython.

----------
resolution:  -> fixed
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31006>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:50:01 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:50:01 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559605801.24.0.240766213596.issue35621@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13678
pull_request: https://github.com/python/cpython/pull/13793

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:50:23 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 03 Jun 2019 23:50:23 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559605823.1.0.0346693277895.issue37137@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Got you. https://github.com/python/cpython/pull/13793

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:55:05 2019
From: report at bugs.python.org (Paul Monson)
Date: Mon, 03 Jun 2019 23:55:05 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559606105.2.0.647903219408.issue37140@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

Reading the related bugs more carefully I think the struct/union passing conventions are different on Windows x64 and Linux.  I have a fix which works for Windows but preserves the prior code for Linux.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 19:57:24 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 03 Jun 2019 23:57:24 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559606244.93.0.275160634371.issue37135@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

CURRENT-amd64% lldb ./python -c python.core
(lldb) target create "./python" --core "python.core"
Core file '/home/pablo/cpython/python.core' (x86_64) was loaded.
(lldb) bt
* thread #1, name = 'python', stop reason = signal SIGBUS
  * frame #0: 0x000000000035cfad python`take_gil(tstate=0x0000000802b34010) at ceval_gil.h:216:13
    frame #1: 0x000000000035d499 python`PyEval_RestoreThread(tstate=0x0000000802b34010) at ceval.c:281:5
    frame #2: 0x000000000040c045 python
    frame #3: 0x000000000047cc51 python
    frame #4: 0x000000000034f59c python`_PyMethodDef_RawFastCallKeywords(method=0x0000000802b34010, self=0x00000008011c1578, args=0x0000000000000092, nargs=2, kwnames=<unavailable>) at call.c:653:18
    frame #5: 0x000000000034e549 python`_PyCFunction_FastCallKeywords(func=0x00000008011c8280, args=<unavailable>, nargs=<unavailable>, kwnames=<unavailable>) at call.c:732:14
    frame #6: 0x000000000036d850 python`call_function(pp_stack=0x00007fffdfbfbcc8, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4673:9
    frame #7: 0x0000000000368d09 python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3294:19
    frame #8: 0x000000000036e59c python`_PyEval_EvalCodeWithName [inlined] PyEval_EvalFrameEx(f=<unavailable>, throwflag=0) at ceval.c:624:12
    frame #9: 0x000000000036e586 python`_PyEval_EvalCodeWithName(_co=<unavailable>, globals=<unavailable>, locals=<unavailable>, args=<unavailable>, argcount=2, kwnames=0x0000000000000000, kwargs=0x000000080266e5f8, kwcount=0, kwstep=1, defs=0x0000000802533558, defcount=1, kwdefs=0x0000000000000000, closure=0x0000000000000000, name=0x00000008017355f0, qualname=0x0000000802524d60) at ceval.c:4035
    frame #10: 0x000000000034e438 python`_PyFunction_FastCallKeywords(func=<unavailable>, stack=<unavailable>, nargs=<unavailable>, kwnames=<unavailable>) at call.c:435:12
    frame #11: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfc020, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #12: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #13: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=2, globals=<unavailable>) at call.c:285:14
    frame #14: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfc230, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #15: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #16: 0x000000000036e59c python`_PyEval_EvalCodeWithName [inlined] PyEval_EvalFrameEx(f=<unavailable>, throwflag=0) at ceval.c:624:12
    frame #17: 0x000000000036e586 python`_PyEval_EvalCodeWithName(_co=<unavailable>, globals=<unavailable>, locals=<unavailable>, args=<unavailable>, argcount=2, kwnames=0x0000000000000000, kwargs=0x000000080271eb58, kwcount=0, kwstep=1, defs=0x000000080251dbd8, defcount=2, kwdefs=0x0000000000000000, closure=0x0000000000000000, name=0x000000080187fd60, qualname=0x0000000802522340) at ceval.c:4035
    frame #18: 0x000000000034e438 python`_PyFunction_FastCallKeywords(func=<unavailable>, stack=<unavailable>, nargs=<unavailable>, kwnames=<unavailable>) at call.c:435:12
    frame #19: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfc520, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #20: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #21: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=2, globals=<unavailable>) at call.c:285:14
    frame #22: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfc730, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #23: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #24: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=2, globals=<unavailable>) at call.c:285:14
    frame #25: 0x000000000034f934 python`_PyObject_Call_Prepend(callable=0x00000008025b4100, obj=0x0000000801878b30, args=<unavailable>, kwargs=0x000000080267e980) at call.c:906:14
    frame #26: 0x000000000034e75f python`PyObject_Call(callable=0x00000008021008d8, args=0x00000008017a7cb0, kwargs=0x000000080267e980) at call.c:247:18
    frame #27: 0x00000000003690a9 python`_PyEval_EvalFrameDefault [inlined] do_call_core(func=<unavailable>, callargs=<unavailable>, kwdict=0x000000080267e980) at ceval.c:4775:12
    frame #28: 0x000000000036907e python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3353
    frame #29: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=1, globals=<unavailable>) at call.c:285:14
    frame #30: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfcba0, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #31: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #32: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=1, globals=<unavailable>) at call.c:285:14
    frame #33: 0x000000000036d9c7 python`call_function(pp_stack=0x00007fffdfbfcdb0, oparg=<unavailable>, kwnames=<unavailable>) at ceval.c:4721:17
    frame #34: 0x0000000000368bae python`_PyEval_EvalFrameDefault(f=<unavailable>, throwflag=<unavailable>) at ceval.c:3280:23
    frame #35: 0x000000000034ebaa python`function_code_fastcall(co=<unavailable>, args=<unavailable>, nargs=1, globals=<unavailable>) at call.c:285:14
    frame #36: 0x000000000034f934 python`_PyObject_Call_Prepend(callable=0x000000080152ff70, obj=0x0000000802681a10, args=<unavailable>, kwargs=0x0000000000000000) at call.c:906:14
    frame #37: 0x000000000034e75f python`PyObject_Call(callable=0x0000000802aa4a10, args=0x000000080106c050, kwargs=0x0000000000000000) at call.c:247:18
    frame #38: 0x00000000004b35e8 python
    frame #39: 0x00000000004049b9 python
    frame #40: 0x000000080059774b libthr.so.3`thread_start(curthread=0x0000000802b34010) at thr_create.c:291:16
(lldb) debug2: client_check_window_change: changed
debug2: channel 0: request window-change confirm 0

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:09:22 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 00:09:22 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1559606962.73.0.34634583734.issue35621@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9535aff9421f0a5639f6e4c4bb0f07a743ea8dba by Miss Islington (bot) (Andrew Svetlov) in branch 'master':
Revert "bpo-35621: Support running subprocesses in asyncio when loop is executed in non-main thread (#13630)" (GH-13793)
https://github.com/python/cpython/commit/9535aff9421f0a5639f6e4c4bb0f07a743ea8dba


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:13:26 2019
From: report at bugs.python.org (Robert Collins)
Date: Tue, 04 Jun 2019 00:13:26 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559607206.76.0.526045612485.issue36656@roundup.psfhosted.org>


Robert Collins <robertc at robertcollins.net> added the comment:

I'd like to add a few notes; please do consider Windows interactions here - Windows does not have the same model for inode replacement that Posix has.

Secondly, I note that the thread model discussed here hasn't been particular well articulated. In particular the vagaries of directories with the sticky bit set are quite different to those where attacker and victim share group permissions : TOCTTOU attacks do imply that post-atomic operation attacks will be possible, and I disagree with the analysis by Serhiy suggesting that they are necessarily so.

However I also agree with Toshio that the os module is not the right place to provide a more secure API: we have to have the basic primitive exposed to Python code somewhere, otherwise the higher level APIs such as you'd like to use are not creatable.

My suggestion is that you put a module up on PyPI that provides the secure behaviour necessary, get some feedback on that, get some cross-platform experience, and then, if desired, propose it for inclusion in shutil or similar in the stdlib.

I'm also going to retitle this - because actually, os.link and os.symlink aren't racy *per se* on Posix - its how they are used that is racy: and the very fact that a secure variant can be written (however ugly) is demonstration of that.

----------
nosy: +rbcollins
title: Race conditions due to os.link and os.symlink POSIX specification -> Please add race-free os.link and os.symlink wrapper / helper

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:27:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:27:15 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559608035.12.0.595445308292.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I looked at the coredump with Pablo. In short, the main thread is calling Py_Exit() to exit the process and so released memory, and a daemon thread does crash on calling PyEval_RestoreThread() because tstate memory was freed.

The question is now if this bug is a regression compared to Python 3.7 or not. I'm trying to reproduce it on Linux by adding "sleep(1)" before exit, but my attempts are unsuccessful so far.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:29:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:29:01 +0000
Subject: [issue37143] multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION
 on Python on x86 Windows7 3.x
In-Reply-To: <1559564865.07.0.954701975633.issue37143@roundup.psfhosted.org>
Message-ID: <1559608141.68.0.639362409181.issue37143@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New fresh crash on x86 Windows7 3.x, even after the revert:

https://buildbot.python.org/all/#/builders/58/builds/2566

======================================================================
ERROR: test_multiprocessing (test.test_venv.BasicTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 327, in test_multiprocessing
    out, err = check_output([envpy, '-c',
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 42, in check_output
    raise subprocess.CalledProcessError(
subprocess.CalledProcessError: Command '['d:\\temp\\tmp1rikh6ck\\Scripts\\python_d.exe', '-c', 'from multiprocessing import Pool; print(Pool(1).apply_async("Python".lower).get(3))']' returned non-zero exit status 3221225477.


Same on FreeBSD:
https://bugs.python.org/issue37135#msg344495

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37143>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:29:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:29:28 +0000
Subject: [issue37143] multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION
 on Python on x86 Windows7 3.x
In-Reply-To: <1559564865.07.0.954701975633.issue37143@roundup.psfhosted.org>
Message-ID: <1559608168.01.0.476588802672.issue37143@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I mark this issue as a duplicate of bpo-37135.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37143>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:30:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:30:53 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559608253.42.0.17653829765.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I marked bpo-37143 "multiprocessing crashed with EXCEPTION_ACCESS_VIOLATION on Python on x86 Windows7 3.x" as a duplicate of this issue. Even if bpo-37143 looks very different (crash in a different file, on a different operating system), I'm now quite sure that it has the same root cause.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:31:00 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 04 Jun 2019 00:31:00 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1559605551.66.0.732780590111.issue36839@roundup.psfhosted.org>
Message-ID: <CAEfz+TyCqKULQ7+O=xm_nVpa0LGTKjOWbmQ0Tr4tbd9RCVbdyw@mail.gmail.com>


Inada Naoki <songofacandy at gmail.com> added the comment:

On Tue, Jun 4, 2019 at 8:45 AM Dino Viehland <report at bugs.python.org> wrote:
>
> The 20MB of savings is actually the amount of byte code that exists in the IG code base.

Wait, do you expect you can reduce 100% saving of co_code object?
co_code takes 0byte?
You said "the overhead it just takes a byte code w/ 16 opcodes before
it breaks even" later.
So I believe you must understand there is overhead.

>  I was just measuring the web site code, and not the other various Python code in the process (e.g. no std lib code, no 3rd party libraries, etc...).  The IG code base is pretty monolithic and starting up the site requires about half of the code to get imported.  So I think the 20MB per process is a pretty realistic number.

How many MBs your application takes?  20MB of 200MB is attractive.
20MB of 20GB is not attractive.
Absolute number is not important here.  You should use ratio.

>
> It's certainly true that the byte code isn't the #1 source of memory here (the code objects themselves are pretty big), but in the serialized state it ends up representing 25% of the serialized data.

"25% of the serialized data" is misleading information.
You are trying to reduce memory usage, not serialized data size.
You should use ratio of total RAM usage, not serialized data size.

> I can't make any promises about open sourcing the import system, but I can certainly look into that as well.

Open sourcing is not necessary.  Try it by yourself and share the real
number, instead of
number of your estimation.
How much RSS is used by Python, and how much of it you can reduce by
this system, actually?

Regards,
-- 
Inada Naoki  <songofacandy at gmail.com>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:33:12 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 04 Jun 2019 00:33:12 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1559608392.27.0.410461711622.issue33416@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

So what was the conclusion about PyCode_New()? Situation is quite similar here (except that these functions are used less often). Should we just document the changes in What's New?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:40:08 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 00:40:08 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559608808.08.0.538168085891.issue37135@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Note that the core dump that we are talking about is something that we produced afterwards when trying to reproduce the issue. The core that is produced as part of the tests could be different. I am trying to get access to the test files.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:41:14 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:41:14 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559608874.2.0.605419885371.issue37135@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


Added file: https://bugs.python.org/file48387/stress.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:42:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:42:44 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559608964.41.0.352513501499.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If you apply attached sleep_at_exit.patch and run attach stress.py, you should quickly get a crash:

$ git apply sleep_at_exit.patch
$ make && ./python stress.py 
Segmentation fault (core dumped)

That's a simplified example of the multiprocessing crash.

----------
keywords: +patch
Added file: https://bugs.python.org/file48388/sleep_at_exit.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:44:20 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 04 Jun 2019 00:44:20 +0000
Subject: [issue35814] Syntax quirk with variable annotations
In-Reply-To: <1548308739.94.0.144807070146.issue35814@roundup.psfhosted.org>
Message-ID: <1559609060.99.0.871668244649.issue35814@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
pull_requests: +13679
pull_request: https://github.com/python/cpython/pull/13794

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35814>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:56:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:56:00 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559609760.61.0.102290176036.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I used git bisect and I found:

commit 396e0a8d9dc65453cb9d53500d0a620602656cfe (refs/bisect/bad)
Author: Eric Snow <ericsnowcurrently at gmail.com>
Date:   Fri May 31 21:16:47 2019 -0600

    bpo-36818: Add PyInterpreterState.runtime field. (gh-13129)
    
stress.py starts to crash at this change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 20:59:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 00:59:06 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559609946.73.0.803523998906.issue36818@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13680
pull_request: https://github.com/python/cpython/pull/13795

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:01:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:01:52 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559610112.23.0.552377526305.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> commit 396e0a8d9dc65453cb9d53500d0a620602656cfe (refs/bisect/bad)

Extract of this change:
 
 static inline void
-exit_thread_if_finalizing(_PyRuntimeState *runtime, PyThreadState *tstate)
+exit_thread_if_finalizing(PyThreadState *tstate)
 {
+    _PyRuntimeState *runtime = tstate->interp->runtime;
     /* _Py_Finalizing is protected by the GIL */
     if (runtime->finalizing != NULL && !_Py_CURRENTLY_FINALIZING(runtime, tstate)) {
         drop_gil(&runtime->ceval, tstate);
@@ -236,7 +237,7 @@ PyEval_AcquireLock(void)
         Py_FatalError("PyEval_AcquireLock: current thread state is NULL");
     }
     take_gil(ceval, tstate);
-    exit_thread_if_finalizing(runtime, tstate);
+    exit_thread_if_finalizing(tstate);
 }
 

This change is fine for regular Python threads. But for daemon threads, tstate is likely already corrupted, so it's no longer possible to get interp from interp, and so also not possible to get 'runtime'.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:06:07 2019
From: report at bugs.python.org (Windson Yang)
Date: Tue, 04 Jun 2019 01:06:07 +0000
Subject: [issue15474] Differentiate decorator and decorator factory in docs
In-Reply-To: <1343416207.69.0.71696747041.issue15474@psf.upfronthosting.co.za>
Message-ID: <1559610367.53.0.164892989515.issue15474@roundup.psfhosted.org>


Windson Yang <wiwindson at outlook.com> added the comment:

Hi, Andr?s Delfino. Are you still working on it?

----------
nosy: +Windson Yang

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15474>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:14:05 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 04 Jun 2019 01:14:05 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559610845.11.0.044212136975.issue37140@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13681
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13796

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:15:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:15:11 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559610911.9.0.922085994702.issue36818@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0fd2c300c2a85b3b227a907b2a39ef79fa86d850 by Victor Stinner in branch 'master':
Revert "bpo-36818: Add PyInterpreterState.runtime field. (gh-13129)" (GH-13795)
https://github.com/python/cpython/commit/0fd2c300c2a85b3b227a907b2a39ef79fa86d850


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:19:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:19:05 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559611145.56.0.869137171786.issue36818@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This change introduced a regression:
https://bugs.python.org/issue37135#msg344511

I had to revert the change to fix Python for 3.8 beta1 release.

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:21:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:21:32 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559611292.93.0.330736115799.issue36818@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

By the way, I have questions about the rationale of this change.

> Currently we use the _PyRuntime static global to access the runtime state in various places.  At the same time, in thread contexts we get access to the thread state from Thread-Local Storage and the interpreter state by indirection from there.  We should do the same for the runtime state instead of using the global directly.

Right now I'm confused. _PyRuntimeState contains scatted states: things which should be moved to PyInterpreterState or even PyThreadState, and things which should remain in _PyRuntimeState. My notes on this topic:
https://pythoncapi.readthedocs.io/runtime.html

Is PyInterpreterState.runtime a temporary fix until things are moved?

Or do you plan to never access _PyRuntime directly, and always through interp->runtime?

It seems like in the short term, we must continue to access "_PyRuntime" through a separated "runtime" pointer passed to functions, to handle daemon threads during Python shutdown.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:29:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:29:46 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559611786.96.0.272988158522.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Andrew! Sorry that you had to revert your change :-(

We can reconsider to merge again your change after beta1 (if our release manager is fine with that).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:44:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 01:44:37 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559612677.72.0.972234050603.issue37134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

A first enhancement would be to add an index entry for "/" at:
https://docs.python.org/dev/genindex-Symbols.html

> I'll note that Googling on: "python slash in formal argument list" ...

We have to find a cute name for the "/ operator" in function definition! Like the "walrus operator" for "x := 1" :-D Nobody is able to find "/" in Google. And I'm not sure that "slash" is accurate enough, since it has multiple meaning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 21:52:56 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 01:52:56 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559613176.0.0.465204820753.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I respectfully disagree with logic, "the language now permits this, so we should change all the docs to display it everywhere".  That moves it from optional knowledge to mandatory knowledge, from a day ten lesson to a day one lesson, from "once in a while, a user may benefit from being able to mark arguments as positional-only" to the category of "every single user will see this every time they see the docs".  There is a huge difference.

My almost daily experience with end-users regarding the \ annotation has been decidedly negative.  And my experience as a professional tech writer teaches that "people will just have to figure it out" is not a phrase to live by when it comes to documentation (it is an anti-pattern).

There is no reason that we have to do this to the docs.  Please at least go with Carol's suggestion to defer all the trailing \ annotations for at least another release so that you can get more user feedback.

I know some regard The Zen of Python as just poetry, but the "readability counts" and "beautiful is better than ugly" parts mean something.  Those key attractors to the language should not be discarded lightly.

And while a blog post might be nice, the odds are that fewer than 1% of Python users will ever see it.  Python has millions of users and blog posts are rarely seen by more than tens of thousands.  Even then, blog post knowledge is transient and quickly becomes yesterday's news.  The entire notion of training away the problem is specious; you really shouldn't have to have training to read documentation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Mon Jun  3 22:38:22 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 04 Jun 2019 02:38:22 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1559615902.87.0.840798153126.issue33416@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

It seems we're keeping the new PyCode_New() signature, so we can do the same here. Just document it; a versionchanged (if there isn't one yet) and a mention in What's New sound appropriate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Mon Jun  3 22:45:52 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Tue, 04 Jun 2019 02:45:52 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559616352.04.0.177638616761.issue37130@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Mon Jun  3 22:46:07 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 04 Jun 2019 02:46:07 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559616367.27.0.957650702029.issue37134@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

> I respectfully disagree with logic, "the language now permits this, so we should change all the docs to display it everywhere".  That moves it from optional knowledge to mandatory knowledge, from a day ten lesson to a day one lesson, from "once in a while, a user may benefit from being able to mark arguments as positional-only" to the category of "every single user will see this every time they see the docs".  There is a huge difference.

A decent part of the reasoning for the PEP was actually to create a standard way to document when arguments to a function are positional-only. By adopting the notation (already used in the numpy documentation IIRC), it makes a concise documentation clear.

Another part of the PEP's reasoning was that this notation is difficult to understand at least partially because it is rarely encountered, so "people don't understand it" as a reason to exclude it from the documentation becomes a bit of a self-fulfilling prophecy.

I am not really an expert in documentation and front-end design, but maybe it would be possible to have some sort of unobtrusive tooltip that activates on signatures that contain positional-only arguments?

----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 00:19:48 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 04 Jun 2019 04:19:48 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559621988.32.0.129347058882.issue36707@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

For FreeBSD Python language ports, the change doesn't have a big negative impact for the Python language/interpreter ports themselves

We have the following block in lang/python3? ports:

.if ${PORT_OPTIONS:MPYMALLOC}
ABIFLAGS:=      m${ABIFLAGS}
.endif

.if ${PORT_OPTIONS:MDEBUG}
ABIFLAGS:=      d${ABIFLAGS}
.endif


We then use the variable to substitute the correct suffix into the pkg-plist items:

.if !empty(ABIFLAGS)
PLIST_FILES+=   bin/python${PYTHON_VER}${ABIFLAGS} \
                bin/python${PYTHON_VER}${ABIFLAGS}-config \
                libdata/pkgconfig/python-${PYTHON_VER}${ABIFLAGS}.pc
<snip>
${INSTALL_DATA} ${WRKSRC}/Tools/gdb/libpython.py \
                ${STAGEDIR}${PREFIX}/lib/libpython${PYTHON_VER}${ABIFLAGS}.so.1.0-gdb.py

One question I have is, can/does SOABI flag removal affect any third party package/extension builds in any way, particularly affecting the names of files they produce?

We have a ton of python packages/extensions in the ports tree, so anything that affected their builds, particularly when it comes to setuptools --record output changes, would be a blocker for supporting 3.8

For example, we had to produce custom ports framework code to account for PEP488 [1] and PEP3147 [2] filename suffixes, for these filename differences, which was painful at the time:

# PEP 0488 (https://www.python.org/dev/peps/pep-0488/)
.if ${PYTHON_REL} < 3500
PYTHON_PYOEXTENSION=    pyo
.else
PYTHON_PYOEXTENSION=    opt-1.pyc
.endif


.if ${PYTHON_REL} >= 3200 && defined(_PYTHON_FEATURE_PY3KPLIST)
# When Python version is 3.2+ we rewrite all the filenames
# of TMPPLIST that end with .py[co], so that they conform
# to PEP 3147 (see https://www.python.org/dev/peps/pep-3147/)
PYMAGICTAG=             ${PYTHON_CMD} -c 'import sys; print(sys.implementation.cache_tag)'
_USES_stage+=   935:add-plist-python
add-plist-python:
        @${AWK} '\
                /\.py[co]$$/ && !($$0 ~ "/" pc "/") {id = match($$0, /\/[^\/]+\.py[co]$$/); if (id != 0) {d = substr($$0, 1, RSTART - 1); dirs[d] = 1}; sub(/\.pyc$$/,  "." mt "&"); sub(/\.pyo$$/, "." mt "." pyo); sub(/[^\/]+\.py[co]$$/, pc "/&"); print; next} \
                /^@dirrm / {d = substr($$0, 8); if (d in dirs) {print $$0 "/" pc}; print $$0; next} \
                /^@dirrmtry / {d = substr($$0, 11); if (d in dirs) {print $$0 "/" pc}; print $$0; next} \
                {print} \
                ' \
                pc="__pycache__" mt="$$(${PYMAGICTAG})" pyo="opt-1.pyc" \
                ${TMPPLIST} > ${TMPPLIST}.pyc_tmp
        @${MV} ${TMPPLIST}.pyc_tmp ${TMPPLIST}


[1] https://www.python.org/dev/peps/pep-0488/
[2] https://www.python.org/dev/peps/pep-3147/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Tue Jun  4 00:20:03 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Tue, 04 Jun 2019 04:20:03 +0000
Subject: [issue21492] email.header.decode_header sometimes returns bytes,
 sometimes str
In-Reply-To: <1399972085.94.0.85314895463.issue21492@psf.upfronthosting.co.za>
Message-ID: <1559622003.39.0.829008804188.issue21492@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

If we can't fix the behavior, it should at least be documented.

Currently the docs says "This function returns a list of (decoded_string, charset) pairs containing each of the decoded parts of the header.".  One could assume that this means that a Unicode string is returned, but and as far as I can tell, "decoded_string" means decoded from the format used by the header, not from bytes -- in fact the example below shows a byte string.
#24797 suggest an alternative solution, but there is no indications about it in the docs except an easy-to-miss note about the new API at the top.

Coincidentally as I was reporting this issue I also found the recently opened #37139.  There are also a few other reports: #24797, #37139, #32975, #6302, #4661.

If this method is not actually deprecated, I would document the current behavior (i.e. sometimes it returns bytes, sometimes unicode -- bonus points if there's a simple rule to predict which one), explain that it exists for legacy/backward-compatibility reasons, and point to the alternatives.


FWIW here are 3 more samples that show the inconsistency.

>>> from email.header import decode_header
>>> # str + None
>>> h = '\x80SOKCrGxsbw===== <hello at example.com>'; decode_header(h)
[('\x80SOKCrGxsbw===== <hello at example.com>', None)]
>>> # bytes + '', bytes + None
>>> h = '=??b?SOKCrGxsbw=====?= <hello at example.com>'; decode_header(h)
[(b'H\xe2\x82\xacllo', ''), (b' <hello at example.com>', None)]
>>> # bytes + 'utf8', bytes + None
>>> h = '=?utf8?b?SOKCrGxsbw==?= <hello at example.com>'; decode_header(h)
[(b'H\xe2\x82\xacllo', 'utf8'), (b' <hello at example.com>', None)]

----------
assignee:  -> docs at python
components: +Documentation
nosy: +docs at python, ezio.melotti, louis.abraham at yahoo.fr
resolution: duplicate -> 
stage: resolved -> needs patch
status: closed -> open
type: behavior -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21492>
_______________________________________

From report at bugs.python.org  Tue Jun  4 00:29:06 2019
From: report at bugs.python.org (Marco Sulla)
Date: Tue, 04 Jun 2019 04:29:06 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559622546.34.0.107552276669.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

> Changing VIRTUAL_ENV will break code

VIRTUAL_ENV it's the same if you don't move the venv. Moving it will be an unofficial unsupported bonus, and if you coded bad and it doesn't work, it's your fault.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 00:47:05 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 04 Jun 2019 04:47:05 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559623625.64.0.0441436820219.issue36707@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> One question I have is, can/does SOABI flag removal affect any third party package/extension builds in any way, particularly affecting the names of files they produce?

Yep, the default file names of C extension modules differ on most/all? Unix-y platforms (certainly vanilla Linux and macOS) because the SOABI is included in the file name.

$ /tmp/py38/bin/python3.7 -m pip install --no-binary :all: psutil
$ ls /tmp/py37/lib/python3.7/site-packages/psutil/*.so
/tmp/py37/lib/python3.7/site-packages/psutil/_psutil_linux.cpython-37m-i386-linux-gnu.so
/tmp/py37/lib/python3.7/site-packages/psutil/_psutil_posix.cpython-37m-i386-linux-gnu.so

$ /tmp/py38/bin/python3.8 -m pip install --no-binary :all: psutil
$ ls /tmp/py38/lib/python3.8/site-packages/psutil/*.so
/tmp/py38/lib/python3.8/site-packages/psutil/_psutil_linux.cpython-38-i386-linux-gnu.so
/tmp/py38/lib/python3.8/site-packages/psutil/_psutil_posix.cpython-38-i386-linux-gnu.so

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Tue Jun  4 00:54:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 04:54:26 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559624066.55.0.923492034736.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> Another part of the PEP's reasoning was that this notation
> is difficult to understand at least partially because it 
> is rarely encountered, so "people don't understand it" as 
> a reason to exclude it from the documentation becomes a
> bit of a self-fulfilling prophecy

We know that isn't true because people already see it frequently in the tooltips for C functions.  What I've observed is that after repeated exposures, users learn to treat it as noise and tune it out.  I've not found a single instance where a user found it to be helpful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 01:00:31 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 04 Jun 2019 05:00:31 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559624431.2.0.745365541237.issue36707@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Another user-visible difference:

$ ls /tmp/py37/bin/python*
/tmp/py37/bin/python3    /tmp/py37/bin/python3.7-config  /tmp/py37/bin/python3.7m-config
/tmp/py37/bin/python3.7  /tmp/py37/bin/python3.7m        /tmp/py37/bin/python3-config
$ ls /tmp/py38/bin/python*
/tmp/py38/bin/python3    /tmp/py38/bin/python3.8-config
/tmp/py38/bin/python3.8  /tmp/py38/bin/python3-config

Granted, these differences aren't the end of the world but:

"But I'm not sure of what are the things impacting by ABIFLAGS="" rather than ABIFLAGS="m"."

Not to beat a dead horse but - we really should not make changes like this without first understanding what the impact will be.  As it stands, this change potentially affects end-users, third-party distributors of Python, and package developers.  And, for what reason?  I don't wsee how this change provides any real value for anyone and it does cause people to have to change things, like creating conditional code for 3.7- and 3.8+.  If we were starting from scratch today, sure - "m" is not needed.  But just because we can change something doesn't mean we should.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Tue Jun  4 01:12:00 2019
From: report at bugs.python.org (Grant Jenks)
Date: Tue, 04 Jun 2019 05:12:00 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559625120.95.0.604041061355.issue37134@roundup.psfhosted.org>


Grant Jenks <grant.jenks at gmail.com> added the comment:

FWIW, I would rather not see the docs littered with "/". I've taught Python to hundreds of professional software engineers over the last five years and in all that time nobody has ever asked when the args need to be positional. It's easy to experiment to find out and it's historically been an implementation detail. I think the number of times people are surprised is far less than the number of times people never notice at all. As Raymond described, this change will elevate the feature to a day-1 topic and it's pretty useless to a day-1 user. This is another step toward making what I see as an unfortunate implementation detail into formal semantics.

----------
nosy: +grantjenks

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 01:14:58 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 04 Jun 2019 05:14:58 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1559625298.29.0.476534812488.issue36707@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

Those script names would already have code to handle name changes based on existing abiflags/soabi string (as FreeBSD does), and would be trivial to modify for 'm' removal.

For third party stuff: we use setuptools --record for 'everything', so as long as filenames are 'correct' for the files that are actually installed, and downstreams are clear what the scope of the changes are, 'm' removal is not an issue when it come so packaging third party packages/extensions.

A new file extension format or substantially more complex magic would be, on the other hand.

A new minor is a good time to make these changes, and there's nothing really blocking about a new python38 port/package, and nothing consumes it yet in downstream OS's

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Tue Jun  4 01:40:51 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Tue, 04 Jun 2019 05:40:51 +0000
Subject: [issue37141] Allow multiple separators in Stream.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559626851.36.0.421556178481.issue37141@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Tue Jun  4 01:59:30 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 04 Jun 2019 05:59:30 +0000
Subject: [issue27513] email.utils.getaddresses does not handle Header objects
In-Reply-To: <1468493411.01.0.0415400585896.issue27513@psf.upfronthosting.co.za>
Message-ID: <1559627970.9.0.147883757201.issue27513@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13682
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13797

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27513>
_______________________________________

From report at bugs.python.org  Tue Jun  4 02:01:40 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 04 Jun 2019 06:01:40 +0000
Subject: [issue27513] email.utils.getaddresses does not handle Header objects
In-Reply-To: <1468493411.01.0.0415400585896.issue27513@psf.upfronthosting.co.za>
Message-ID: <1559628100.32.0.469370544732.issue27513@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz
versions: +Python 3.7, Python 3.8 -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27513>
_______________________________________

From report at bugs.python.org  Tue Jun  4 02:16:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 04 Jun 2019 06:16:04 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559628964.97.0.17260073898.issue36839@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yet one consideration. The bytecode is actually a wordcode, a sequence of 16-bit words, and the start of the array must be properly aligned. There is no problem if it is a data of the bytes object, but if you have a mapping of the pyc file the alignment is not guarantied. You need to change also the marshal protocol or save the bytecode in other file. This is a large change.

So you need to make several large changes (changes in the import system, change in the pyc file) for using this feature. Supporting the buffer protocol in code objects is minor change to this. If you need to patch other parts of Python it is not hard to patch also the code object in your custom build. Other Python users will not have benefit from this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 03:07:01 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Tue, 04 Jun 2019 07:07:01 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1559632021.49.0.298779453278.issue21872@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

I adapted the example in msg221784:


with open('22h_ticks_bad.bi5', 'rb') as f:
    infile = f.read()

for i in range(1, 9000):
    decompressor = _lzma.LZMADecompressor()
    first_out = decompressor.decompress(infile[:i])
    first_len = len(first_out)
    last_out = decompressor.decompress(infile[i:])
    last_len = len(last_out)
    if not decompressor.eof:
        print(i, first_len, first_len + last_len, decompressor.eof)


which outputs this using both 3.7.3 and 3.8.0a3+ on macOS 10.14.4:

648 2682 45479 False
1834 7442 45479 False
2766 11667 45473 False
2767 11668 45474 False
3591 15428 45473 False
5051 21743 45473 False
5052 21745 45475 False
5589 24387 45475 False
5590 24388 45476 False
6560 28823 45476 False
6561 28824 45477 False
7327 32325 45474 False
8192 36251 45473 False
8193 36253 45475 False
8368 37283 45475 False
8369 37285 45477 False

So, yes, still an active bug.

----------
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Tue Jun  4 03:49:37 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 07:49:37 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559634577.83.0.808470480743.issue35431@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13683
pull_request: https://github.com/python/cpython/pull/13798

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Tue Jun  4 04:23:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 08:23:26 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559636606.65.0.488543054967.issue35431@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 963eb0f4738456455b9bef7eb531b46805415208 by Raymond Hettinger in branch 'master':
bpo-35431: Drop the k <= n requirement (GH-13798)
https://github.com/python/cpython/commit/963eb0f4738456455b9bef7eb531b46805415208


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Tue Jun  4 04:39:59 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 08:39:59 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559637599.29.0.153939588139.issue37145@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

The __init__ method is public.  Here is how to use ItemsView:

>>> from collections.abc import ItemsView
>>> d = dict(python='snake', ruby='gem', go='board game', c='speed of light')
>>> iv = ItemsView(d)
>>> ('python', 'snake') in iv
True
>>> list(iv)
[('python', 'snake'), ('ruby', 'gem'), ('go', 'board game'), ('c', 'speed of light')]
>>> len(iv)
4
>>> d['python'] = 'language'
>>> list(iv)
[('python', 'language'), ('ruby', 'gem'), ('go', 'board game'), ('c', 'speed of light')]

Note, there is no direct access to _mapping.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 04:54:23 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 04 Jun 2019 08:54:23 +0000
Subject: [issue37147] f-string debugging f"{x=[}" adds [filename:lineno] as
 prefix
Message-ID: <1559638463.74.0.509291608796.issue37147@roundup.psfhosted.org>


New submission from Aldwin Pollefeyt <aldwinaldwin at gmail.com>:

>From this idea [0] by Karthikeyan Singaravelan and added to his code in hack [1].

name = "karthikeyan"
print(f"{name =[}")
print(f"{name=[}")
print(f"{age = [}")
print(f"{age= [}")

[prog.py:2] name ='karthikeyan'
[prog.py:3] name='karthikeyan'
[prog.py:4] name = 'karthikeyan'
[prog.py:5] name= 'karthikeyan'


[0] https://tirkarthi.github.io/programming/2019/05/08/f-string-debugging.html

[1] https://github.com/tirkarthi/cpython/commit/d0fcbe67f6bb8ad60744b0a4973c4dc69fda65a9

----------
messages: 344533
nosy: aldwinaldwin, xtreak
priority: normal
severity: normal
status: open
title: f-string debugging f"{x=[}" adds [filename:lineno] as prefix
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37147>
_______________________________________

From report at bugs.python.org  Tue Jun  4 04:59:04 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 04 Jun 2019 08:59:04 +0000
Subject: [issue37147] f-string debugging f"{x=[}" adds [filename:lineno] as
 prefix
In-Reply-To: <1559638463.74.0.509291608796.issue37147@roundup.psfhosted.org>
Message-ID: <1559638744.59.0.308107897596.issue37147@roundup.psfhosted.org>


Change by Aldwin Pollefeyt <aldwinaldwin at gmail.com>:


----------
keywords: +patch
pull_requests: +13684
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13799

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37147>
_______________________________________

From report at bugs.python.org  Tue Jun  4 05:22:27 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 09:22:27 +0000
Subject: [issue37147] f-string debugging f"{x=[}" adds [filename:lineno] as
 prefix
In-Reply-To: <1559638463.74.0.509291608796.issue37147@roundup.psfhosted.org>
Message-ID: <1559640147.13.0.380009499376.issue37147@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I created a post about it for discussion [0]. There is no consensus on the format and to modify the existing debugging notation. There were also suggestions to include a builtin function (dbg) like breakpoint() that does this. I guess implementation can be discussed once the idea is accepted to avoid work being wasted. It certainly can go only in 3.9 if accepted given 3.8 beta release.

[0] https://discuss.python.org/t/filename-and-line-number-in-f-string-debugging-output/1650/8

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37147>
_______________________________________

From report at bugs.python.org  Tue Jun  4 05:25:41 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 04 Jun 2019 09:25:41 +0000
Subject: [issue37147] f-string debugging f"{x=[}" adds [filename:lineno] as
 prefix
In-Reply-To: <1559638463.74.0.509291608796.issue37147@roundup.psfhosted.org>
Message-ID: <1559640341.31.0.500797428851.issue37147@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Ok, didn't know about discuss.python.org. Searching on all PR and bpo's there was no reference to your hack. Will investigate this discuss.python.org. Ai ai ai, more info to read.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37147>
_______________________________________

From report at bugs.python.org  Tue Jun  4 05:40:36 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 04 Jun 2019 09:40:36 +0000
Subject: [issue37147] f-string debugging f"{x=[}" adds [filename:lineno] as
 prefix
In-Reply-To: <1559638463.74.0.509291608796.issue37147@roundup.psfhosted.org>
Message-ID: <1559641236.55.0.615278250181.issue37147@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Can use:

import logging

l = logging.Logger("")
h = logging.StreamHandler()
f = logging.Formatter(fmt="[{filename}:{lineno}] {msg}", style="{")
h.setFormatter(f)
l.addHandler(h)
l.info("Hello")

Output:

>py .\t.py
[t.py:8] Hello

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37147>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:00:03 2019
From: report at bugs.python.org (Antony Lee)
Date: Tue, 04 Jun 2019 10:00:03 +0000
Subject: [issue31006] typing.NamedTuple should add annotations to its
 constructor (__new__) parameters.
In-Reply-To: <1500887267.27.0.393959457135.issue31006@psf.upfronthosting.co.za>
Message-ID: <1559642403.37.0.106816363302.issue31006@roundup.psfhosted.org>


Change by Antony Lee <anntzer.lee at gmail.com>:


----------
nosy:  -Antony.Lee

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31006>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:08:45 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 10:08:45 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
Message-ID: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

https://buildbot.python.org/all/#/builders/1/builds/609/steps/5/logs/stdio

=====================================================================
FAIL: test_stream_reader_create_warning (test.test_asyncio.test_streams.StreamTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test_asyncio/test_streams.py", line 1233, in test_stream_reader_create_warning
    asyncio.StreamReader
AssertionError: DeprecationWarning not triggered
======================================================================
FAIL: test_stream_writer_create_warning (test.test_asyncio.test_streams.StreamTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test_asyncio/test_streams.py", line 1237, in test_stream_writer_create_warning
    asyncio.StreamWriter
AssertionError: DeprecationWarning not triggered


The problem is that when the test is repeated using the -R, asyncio has cached already StreamReader and StreamWriter into globals, not triggering the warning again.

----------
components: Tests, asyncio
keywords: buildbot
messages: 344537
nosy: asvetlov, lukasz.langa, pablogsal, vstinner, yselivanov
priority: normal
severity: normal
stage: needs patch
status: open
title: test_asyncio fails on refleaks buildbots
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:10:00 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 10:10:00 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
In-Reply-To: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>
Message-ID: <1559643000.49.0.909866577738.issue37148@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13686
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13800

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:16:19 2019
From: report at bugs.python.org (Stefan Krah)
Date: Tue, 04 Jun 2019 10:16:19 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559643379.7.0.54033521601.issue36839@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

720MB <= "3-4 dozen" * 20 MB <= 960MB.  Per server.

It has all been said. :-)


I don't understand the objections about alignment. malloc() and obmalloc()
are at least 8-byte aligned, mmap() with NULL as the first parameter
is page-aligned.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:18:41 2019
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Tue, 04 Jun 2019 10:18:41 +0000
Subject: [issue15474] Differentiate decorator and decorator factory in docs
In-Reply-To: <1343416207.69.0.71696747041.issue15474@psf.upfronthosting.co.za>
Message-ID: <1559643521.14.0.533601676138.issue15474@roundup.psfhosted.org>


Andr?s Delfino <adelfino at gmail.com> added the comment:

Hi Windson Yang! Yes, I'm still working on it. I'll have it ready by the end of June.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15474>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:19:36 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 10:19:36 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
In-Reply-To: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>
Message-ID: <1559643576.35.0.761198246149.issue37148@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I'm curious if collections.__getattr__ suffers from the same problem?

asyncio uses basically the same technique for deprecating global names on import.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:24:16 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 10:24:16 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
In-Reply-To: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>
Message-ID: <1559643856.08.0.530478366454.issue37148@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> I'm curious if collections.__getattr__ suffers from the same problem?

Very likely, the problem is that there is no test in test_collections for the deprecation warning, so this situation never happens.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:26:25 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 10:26:25 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
In-Reply-To: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>
Message-ID: <1559643985.48.0.18063734696.issue37148@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 4cdbc452ce308bb55523e53963cabdc988e3f44b by Pablo Galindo in branch 'master':
bpo-37148: Fix asyncio test that check for warning when running the test suite with huntleaks (GH-13800)
https://github.com/python/cpython/commit/4cdbc452ce308bb55523e53963cabdc988e3f44b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:26:33 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 10:26:33 +0000
Subject: [issue37148] test_asyncio fails on refleaks buildbots
In-Reply-To: <1559642925.13.0.289383724886.issue37148@roundup.psfhosted.org>
Message-ID: <1559643993.7.0.349549255281.issue37148@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37148>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:30:48 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 10:30:48 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559644248.91.0.426764284377.issue35431@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13687
pull_request: https://github.com/python/cpython/pull/13801

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:42:22 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 04 Jun 2019 10:42:22 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1559643379.7.0.54033521601.issue36839@roundup.psfhosted.org>
Message-ID: <CAEfz+Tz1Uhr5CbpfOVOak=0QNtgQyRonaZqeNnYJbb_c-N=-vw@mail.gmail.com>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Stefan Krah <stefan at bytereef.org> added the comment:
>
> 720MB <= "3-4 dozen" * 20 MB <= 960MB.  Per server.
>
> It has all been said. :-)

I don't understand what message you are replying.
I'm not interested in the number.  Who asked MBs / server?

Absolute number is not important when optimizing.

"I can reduce 3sec" is not important, unless total time is given.
3.5s -> 0.5s is great.  But 60 hours -> 59h59m57s is not great.

Hi didn't write anything about how much memory used by process.
Additionally, he measured serialized size, not memory usage.
It doesn't make any sense.

I don't trust even 20MB/process saving.  It is only in his mind.
This proposal is based on fantasy, not based on pragmatic
survey.

I think we should not take more time to discuss, until he proof the idea
by actually saving 20MB / process and provide detailed report.

>
> I don't understand the objections about alignment. malloc() and obmalloc()
> are at least 8-byte aligned, mmap() with NULL as the first parameter
> is page-aligned.
>

I think Serhiy meant alignment in pyc file.  bytes object in pyc file is not
aligned.  So it's bad idea to use mmap for pyc files.

But Instagram may use original serialize format instead of pyc files,
and it may align bytes object.  So it may be not a problem.
No one other than Instagrammer knows, because there is no
detailed information.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:43:42 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Tue, 04 Jun 2019 10:43:42 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559645022.48.0.324291229572.issue34037@roundup.psfhosted.org>


Change by ?ukasz Langa <lukasz at langa.pl>:


----------
keywords: +patch
pull_requests: +13688
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13802

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:47:48 2019
From: report at bugs.python.org (Stefan Krah)
Date: Tue, 04 Jun 2019 10:47:48 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559645268.09.0.440817334764.issue36839@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

There's no point discussing unless people develop reading skills.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 06:48:02 2019
From: report at bugs.python.org (Stefan Krah)
Date: Tue, 04 Jun 2019 10:48:02 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559645282.15.0.586562502828.issue36839@roundup.psfhosted.org>


Change by Stefan Krah <stefan at bytereef.org>:


----------
nosy:  -skrah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 07:03:36 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Tue, 04 Jun 2019 11:03:36 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559646216.27.0.863301302144.issue34037@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 7f9a2ae78051877f4d966119e2fcd27ec77eda1d by ?ukasz Langa in branch 'master':
Revert "bpo-34037, asyncio: add BaseEventLoop.wait_executor_on_close (GH-13786)" (#13802)
https://github.com/python/cpython/commit/7f9a2ae78051877f4d966119e2fcd27ec77eda1d


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Tue Jun  4 07:09:30 2019
From: report at bugs.python.org (Geoffrey Sneddon)
Date: Tue, 04 Jun 2019 11:09:30 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559646570.89.0.961776035166.issue37145@roundup.psfhosted.org>


Geoffrey Sneddon <geoffers+pythonbugs at gmail.com> added the comment:

Then I guess what I consider a bug is "__init__ is undocumented".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 07:50:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 11:50:37 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559649037.91.0.578697527832.issue34037@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

?ukasz Langa reverted my change (PR 13786). I pushed my change without any review to try to fix https://bugs.python.org/issue37137 which blocked the Python 3.8 beta1. Sadly, my change didn't fix this issue. The root cause was differently (and it's now fixed).

Andrew Svetlov asked to make some changes on my API. Yury Selivanov added "I don't like this last minute api decision. Please don't merge this.". See PR 13786 for the discussion. In short, my change was reverted because of the API.

But I still consider that calling executor.shutdown(wait=False) in loop.close() in wrong: we must wait until it finishes. Otherwise, the code "leaks" threads which continue to run and so can cause troubles. I would prefer to wait by default.

Andrew, Yury: Would you be interested to rewrite my change in the "asyncio way"?

IMHO this change can wait Python 3.9, it's not a critical bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Tue Jun  4 07:58:42 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 11:58:42 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559649522.3.0.688847544417.issue34037@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I still think that this is a valuable change but we need to discuss public API.

In fact, in my job we used to override default executor and wait for its shutdown with explicit waiting to make the system robust.

The problem is that loop.close() can "hang" for minutes if there are pending background jobs or slow DNS resolution requests.

We controlled our tasks running in the thread pool carefully and used aiodns for DNS resolving.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Tue Jun  4 07:59:26 2019
From: report at bugs.python.org (Guilloux)
Date: Tue, 04 Jun 2019 11:59:26 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
Message-ID: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>


New submission from Guilloux <bugs.python.org at guilloux-fr.net>:

On the page https://docs.python.org/3/library/tkinter.html
there is a link to "Tkinter reference: a GUI for Python" which is "https://infohost.nmt.edu/tcc/help/pubs/tkinter/web/index.html".

BIG PROBLEM : Since several days this link doesn't work any more !!!

It's really important to fix it because most of official online documentation about tkinter was provided by this way !!!

Fortunately i have a copy of the documentation (cf pdf file). I have downloaded this file thanks to the website above just before the link was failed ! (Yes, i know, i'm lucky...)

Unfortunately I can't send you this pdf because I have a message "request entity too large" :-(

----------
assignee: docs at python
components: Documentation, Tkinter
messages: 344549
nosy: docs at python, xameridu
priority: normal
severity: normal
status: open
title: link to official documentation tkinter failed  !!!
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:00:27 2019
From: report at bugs.python.org (Guilloux)
Date: Tue, 04 Jun 2019 12:00:27 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559649627.89.0.733806384821.issue37149@roundup.psfhosted.org>


Guilloux <bugs.python.org at guilloux-fr.net> added the comment:

On the page https://docs.python.org/3/library/tkinter.html
there is a link to "Tkinter reference: a GUI for Python" which is "https://infohost.nmt.edu/tcc/help/pubs/tkinter/web/index.html".

BIG PROBLEM : Since several days this link doesn't work any more !!!

It's really important to fix it because most of official online documentation about tkinter was provided by this way !!!

Fortunately i have a copy of the documentation (cf pdf file). I have downloaded this file thanks to the website above just before the link was failed ! (Yes, i know, i'm lucky...)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:06:34 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 12:06:34 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559649994.81.0.98312190446.issue37149@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

A copy of the URL is present in archive.org [0] . Perhaps the docs could be updated with it.


[0] https://web.archive.org/web/20190524140835/https://infohost.nmt.edu/tcc/help/pubs/tkinter/web/index.html

----------
nosy: +xtreak
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:08:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:08:53 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559650133.81.0.631887203366.issue34037@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> The problem is that loop.close() can "hang" for minutes if there are pending background jobs or slow DNS resolution requests.

Maybe concurrent.futures should be enhanced for that?

Or from asyncio, is it possible to poll the executor and emit a warning if some threads take longer than <threshold in esconds>? It would be great if we could display repr() of the slow job in that case.

Yury also asked for a timeout, but it's not supported by concurrent.futures yet, and I'm not sure what should be done in case of timeout? Retry? Log a warning?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:11:54 2019
From: report at bugs.python.org (Guilloux)
Date: Tue, 04 Jun 2019 12:11:54 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559650314.02.0.960487036883.issue37149@roundup.psfhosted.org>


Guilloux <bugs.python.org at guilloux-fr.net> added the comment:

The comment of Karthikeyan Singaravelan seems to be a good idea.

Question : is it possible to send a pdf (2.08 MB) to the python tracker ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:28:11 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 04 Jun 2019 12:28:11 +0000
Subject: [issue34521] Multiple tests (test_socket,
 test_multiprocessing_*) fail due to incorrect recvmsg(2) buffer
 lengths, causing failures on FreeBSD CURRENT
In-Reply-To: <1535389978.32.0.56676864532.issue34521@psf.upfronthosting.co.za>
Message-ID: <1559651291.1.0.982986404978.issue34521@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

Access to the buildbot has been restored (a while ago), and this issue being resolved (merge to 2.7) is the only test failing to get 2.7 back to green, which has been failing for months.

Can we test with Victors proposed patch in msg330654 ? I don't believe the change/fix/merge will be difficult, given the very small change scope of the master commits.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34521>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:30:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:30:18 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1559651418.53.0.817364532845.issue35121@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I added this issue to my security website:
https://python-security.readthedocs.io/vuln/cookie-domain-check.html

So it's fixed in Python 3.4.10, 3.5.7 and 3.7.3. Right now, 2.7 and 3.6 are vulnerable (but 3.6 branch is fixed).

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:37:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:37:47 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1559651867.12.0.326209540724.issue35121@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Can someone try to backport the fix to Python 2.7?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:43:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:43:27 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559652207.4.0.544541967041.issue37137@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The initial issue has been fixed.

Let's continue the discussion on https://bugs.python.org/issue35621 to maybe reapply commit 13ed07998ad93dbdd94991ba0451b9b559f07972.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:43:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:43:35 +0000
Subject: [issue37137] test_asyncio: test_cancel_gather_2() dangling thread
In-Reply-To: <1559524688.39.0.485790490316.issue37137@roundup.psfhosted.org>
Message-ID: <1559652215.17.0.094189622024.issue37137@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37137>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:46:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:46:07 +0000
Subject: [issue36818] Add PyInterpreterState.runtime.
In-Reply-To: <1557168344.92.0.643564511932.issue36818@roundup.psfhosted.org>
Message-ID: <1559652367.0.0.680187903344.issue36818@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See https://bugs.python.org/issue37135#msg344509 to reproduce https://bugs.python.org/issue37135 crash without multiprocessing: with this procedure, I reproduce the crash immediately on Linux. No need for a magic super slow buildbot.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36818>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:46:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:46:17 +0000
Subject: [issue37135] test_multiprocessing_spawn segfaults on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1559516057.97.0.679920443323.issue37135@roundup.psfhosted.org>
Message-ID: <1559652377.4.0.529443215348.issue37135@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The initial issue has been fixed by a revert.

Let's continue the discussion on bpo-36818 to maybe reapply commit 396e0a8d9dc65453cb9d53500d0a620602656cfe.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37135>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:49:06 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 12:49:06 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1559652546.87.0.644399723071.issue35121@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

> Can someone try to backport the fix to Python 2.7?

The backport to 2.7 PR 13426 is open. It would be helpful if someone can review it. I am not sure of the commit review process and who needs to review and approve it since this is assigned to Benjamin Peterson. It's a fairly straightforward backport except that http.cookiejar is cookielib in Python 2.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:50:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:50:40 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1559652640.0.0.744497292522.issue33529@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 3.6, 3.5 and 2.7 are still vulnerable. Is there someone interested to backport the fix?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:58:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:58:25 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559653105.41.0.0444487350818.issue37142@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Fixed by https://github.com/python/cpython/pull/13790

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:58:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:58:46 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559653126.2.0.0103694520114.issue37142@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 08:59:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 12:59:47 +0000
Subject: [issue36870] test_asyncio: test_drain_raises() fails randomly on
 Windows
In-Reply-To: <1557449871.52.0.351453555458.issue36870@roundup.psfhosted.org>
Message-ID: <1559653187.03.0.735622218133.issue36870@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36870>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:00:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:00:16 +0000
Subject: [issue36732] test_asyncio: test_huge_content_recvinto() fails randomly
In-Reply-To: <1556264661.54.0.31283754406.issue36732@roundup.psfhosted.org>
Message-ID: <1559653216.44.0.886902580761.issue36732@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I didn't see this issue recently. I close it.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36732>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:01:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:01:52 +0000
Subject: [issue36724] Clear _PyRuntime at exit
In-Reply-To: <1556223229.48.0.664845556761.issue36724@roundup.psfhosted.org>
Message-ID: <1559653312.65.0.144779348628.issue36724@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

bpo-36818 caused a regression: https://bugs.python.org/issue37135#msg344511

We should be careful when we modify Python finalization, especially with daemon threads.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36724>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:10:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:10:34 +0000
Subject: [issue35647] Cookie path check returns incorrect results
In-Reply-To: <1546502396.67.0.243403156352.issue35647@roundup.psfhosted.org>
Message-ID: <1559653834.64.0.326798447127.issue35647@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 2.7 is still affected, right? Is there someone interested to backport the fix?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35647>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:13:46 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 13:13:46 +0000
Subject: [issue35647] Cookie path check returns incorrect results
In-Reply-To: <1546502396.67.0.243403156352.issue35647@roundup.psfhosted.org>
Message-ID: <1559654026.85.0.615373705631.issue35647@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

> Python 2.7 is still affected, right? Is there someone interested to backport the fix?

PR 13427 fixes the issue in 2.7 :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35647>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:21:48 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 13:21:48 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559654508.94.0.729356406059.issue37142@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This still seems to hang and timeout after 25 minutes : https://buildbot.python.org/all/#/builders/168/builds/1151/steps/5/logs/stdio

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:22:00 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 13:22:00 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
Message-ID: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>


New submission from Demid <grrrr at protonmail.com>:

There is a possibility that someone (like me) accidentally will omit parentheses with FileType arguments after FileType, and parser will contain wrong file until someone will try to use it. 

Example:
parser = argparse.ArgumentParser()
parser.add_argument('-x', type=argparse.FileType)

----------
components: Library (Lib)
messages: 344568
nosy: zygocephalus
priority: normal
severity: normal
status: open
title: Do not allow to pass FileType class object instead of instance in add_argument
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:23:19 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 13:23:19 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559654599.32.0.835556909198.issue37142@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:24:21 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 13:24:21 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559654661.5.0.592108610362.issue37142@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +13689
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/13804

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:26:51 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 13:26:51 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559654811.99.0.915886387876.issue37142@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Follow-up for https://github.com/python/cpython/pull/13790 is ready

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:27:42 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 13:27:42 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559654862.31.0.300539850677.issue37150@roundup.psfhosted.org>


Change by Demid <grrrr at protonmail.com>:


----------
keywords: +patch
pull_requests: +13690
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13805

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:28:24 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 04 Jun 2019 13:28:24 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559654904.76.0.544030429259.issue37142@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I mean https://github.com/python/cpython/pull/13804

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:36:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:36:27 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1559655387.36.0.147271790873.issue37124@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 2.7 is still affected:
https://buildbot.python.org/all/#/builders/33/builds/607
test_msilib leaked [1, 1, 1] references, sum=3

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:41:33 2019
From: report at bugs.python.org (Laurie Opperman)
Date: Tue, 04 Jun 2019 13:41:33 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559655693.3.0.436396911022.issue36964@roundup.psfhosted.org>


Laurie Opperman <laurie_opperman at hotmail.com> added the comment:

If you're moving the virtual environment directory in Linux you'll also need to update the shebangs for the scripts/binaries

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:41:57 2019
From: report at bugs.python.org (SilentGhost)
Date: Tue, 04 Jun 2019 13:41:57 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559655717.99.0.985702407607.issue37150@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:44:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:44:57 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559655897.35.0.622838813187.issue37142@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 8d561092d510670ce9c038701c90c913453eac90 by Victor Stinner (Andrew Svetlov) in branch 'master':
bpo-37142: Make asyncio stream tests more robust again (GH-13804)
https://github.com/python/cpython/commit/8d561092d510670ce9c038701c90c913453eac90


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 09:47:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 13:47:34 +0000
Subject: [issue37142] test_asyncio timed out on AMD64 FreeBSD CURRENT Shared
 3.x
In-Reply-To: <1559564624.91.0.895932729881.issue37142@roundup.psfhosted.org>
Message-ID: <1559656054.63.0.621703190952.issue37142@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Close again.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37142>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:14:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 14:14:04 +0000
Subject: [issue36778] test_site.StartupImportTests.test_startup_imports fails
 if default code page is cp65001
In-Reply-To: <1556829985.34.0.069265948139.issue36778@roundup.psfhosted.org>
Message-ID: <1559657643.99.0.502813994768.issue36778@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13692
pull_request: https://github.com/python/cpython/pull/13807

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36778>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:14:42 2019
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 04 Jun 2019 14:14:42 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559657682.07.0.9983508434.issue36656@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> I'd like to add a few notes; please do consider Windows interactions 
> here - Windows does not have the same model for inode replacement that 
> Posix has.

Certainly Windows doesn't have the same model for inode replacement since it doesn't have inodes. ;-)

Like POSIX, we can't create a symlink and replace it in one step in Windows. A reparse point can only be set on an existing file. WINAPI CreateSymbolicLink thus requires two system calls: NtCreateFile (file or directory) and NtFsControlFile: FSCTL_SET_REPARSE_POINT. Sensibly, CreateSymbolicLink does not support a flag to allow replacing an existing file or empty directory, since overall the operation isn't atomic.

Like POSIX, we can do an atomic rename within a volume device. This supports replacing an existing file, but, for backward compatibility, we can't implement the replace semantics in os.rename in Windows. Instead we have os.replace. This is a single NtSetInformatonFile: FileRenameInformation system call, with ReplaceIfExists enabled. An important caveat is that this request cannot replace an open file, even if it was opened with delete-access sharing, since that would leave the replaced file nameless. To partially address this, NTFS (but not FAT32) in Windows 10 1709 supports a new FileRenameInformationEx request. This request can combine the flags FILE_RENAME_REPLACE_IF_EXISTS and FILE_RENAME_POSIX_SEMANTICS to allow replacing an open file, if and only if it's opened with delete-access sharing. The replaced file is still accessible for read and write data operations until it's closed. The requirement for delete-access sharing means this is still not quite POSIX semantics. (Most Windows programs do not open files with delete sharing, except for temp files.) But at least it's possible for aware programs and environments to implement POSIX semantics. 

Regarding os.link, WINAPI CreateHardLink is implemented via NtSetInformationFile: FileLinkInformation. This system call also supports ReplaceIfExists, but CreateHardLink doesn't expose an option or flag for this capability. Even if we supported the system call directly (unprecedented in Windows Python), the same problem exists with open files. NTFS in Windows 10 1809 supports a new FileLinkInformationEx request. The flags FILE_LINK_REPLACE_IF_EXISTS and FILE_LINK_POSIX_SEMANTICS behave as the corresponding flags for FileRenameInformationEx.

It's unrelated, but just to round this discussion out, NTFS in Windows 10 1709 supports a new FileDispositionInformationEx request to set a file's delete disposition. With the flag FILE_DISPOSITION_POSIX_SEMANTICS, the deleted file is unlinked as soon as the requesting file reference is closed, even if the file has other references. This is in contrast to the classic FileDispositionInformation request for which the file is only unlinked once all references are closed. Again, it's not quit POSIX semantics overall since the shared delete access model still applies. But this new delete operation at least addresses the problem with malware scanners and similar programs that open files with shared delete access.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:22:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 14:22:23 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559658143.19.0.817745455583.issue26826@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

shutil copy functions would definitively benefit of using copy_file_range() if available. Can someone please open a separated issue for shutil?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:40:44 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 04 Jun 2019 14:40:44 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
Message-ID: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

Now that PEP 590 has been implemented, a lot of old code can be cleaned up. In particular:

- get rid of _PyMethodDef_RawFastCallXXX() functions and replace them by vectorcall functions for each calling convention
- get rid of FastCallDict() implementations for specific types, but keep the generic _PyObject_FastCallDict()
- get rid of some specific tp_call implementations: try to use tp_call=PyVectorcall_Call in more places

----------
components: Interpreter Core
messages: 344577
nosy: Mark.Shannon, jdemeyer, petr.viktorin
priority: normal
severity: normal
status: open
title: Calling code cleanup after PEP 590
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:41:03 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 04 Jun 2019 14:41:03 +0000
Subject: [issue36924] Simplify implementation of
 classmethod_descriptor.__call__
In-Reply-To: <1557921506.83.0.125634021475.issue36924@roundup.psfhosted.org>
Message-ID: <1559659263.84.0.0877724978724.issue36924@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

I opened a more general issue #37151

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36924>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:41:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 14:41:50 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559659310.11.0.522928355851.issue26219@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13693
pull_request: https://github.com/python/cpython/pull/13809

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:43:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 14:43:53 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559659433.45.0.118355556757.issue37140@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> On Fedora, "clang" fails to build with Python 3.8

Would you mind to elaborate? It works for me on Fedora 30 with clang 8.0.0:

$ ./configure CC=clang
$ make
$ ./python -m test -v test_ctypes
...
Tests result: SUCCESS

I tested the master branch of Python.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:46:31 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Tue, 04 Jun 2019 14:46:31 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559659591.18.0.732109888133.issue26826@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

shutil.copyfile() already uses sendfile() which basically provides the same performances. sendfile() should be preferred though because it?s supported since Linux 2.6.33.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:47:10 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 04 Jun 2019 14:47:10 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1559659630.26.0.306209384828.issue37151@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13694
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13340

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:47:34 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 04 Jun 2019 14:47:34 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559659654.1.0.455653988879.issue37140@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

The issue is with building clang using Python 3.8; not building Python 3.8 using clang :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:50:00 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 14:50:00 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559659800.66.0.575373214669.issue26826@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

But copy_file_rane can leverage more filesystem features like deduplication and copy offload stuff.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 10:50:54 2019
From: report at bugs.python.org (serge-sans-paille)
Date: Tue, 04 Jun 2019 14:50:54 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559659854.6.0.278772792744.issue37140@roundup.psfhosted.org>


serge-sans-paille <serge.guelton at telecom-bretagne.eu> added the comment:

@vstinner: to reproduce the issue

```
git clone https://github.com/llvm/llvm-project.git
cd llvm-project
mkdir _build
cd _build
cmake3 ../llvm -DLLVM_ENABLE_PROJECTS="clang;clang-tools-extra" -DBUILD_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=$PWD/install -DPYTHON_EXECUTABLE=$HOME/sources/cpython/_build/install/bin/python3
make -j4
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:02:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:02:52 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559660572.91.0.567927969254.issue26826@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Giampaolo Rodola':
> shutil.copyfile() already uses sendfile() which basically provides the same performances. sendfile() should be preferred though because it?s supported since Linux 2.6.33.

Pablo Galindo Salgado:
> But copy_file_rane can leverage more filesystem features like deduplication and copy offload stuff.

We can use copy_file_range() if available, or fallback to sendfile().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:05:38 2019
From: report at bugs.python.org (carlo)
Date: Tue, 04 Jun 2019 15:05:38 +0000
Subject: [issue37152] Add AF_LOCAL alias for AF_UNIX
Message-ID: <1559660738.02.0.723341796578.issue37152@roundup.psfhosted.org>


New submission from carlo <carlo.revelli at berkeley.edu>:

both mean the same thing and are used to reference local socket files

if you do a `man socket`

one of the lines says

PF_LOCAL        Host-internal protocols, formerly called PF_UNIX,

(AF and PF mean the same thing here, but importantly it shows that PF_UNIX has been depreciated)

this change gives users the option to type socket.AF_LOCAL as well as socket.AF_UNIX when specifying the address family for the socket.

this is my first issue so lmk if there is anything I'm missing )

----------
components: Library (Lib)
messages: 344585
nosy: frosty00
priority: normal
severity: normal
status: open
title: Add AF_LOCAL alias for AF_UNIX
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37152>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:07:02 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Tue, 04 Jun 2019 15:07:02 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559660822.55.0.421342383266.issue26826@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

I think data deduplication / CoW / reflink copy is better implemented via FICLONE. "cp --reflink" uses it, I presume because it's older than copy_file_range(). I have a working patch adding CoW copy support for Linux and OSX (but not Windows). I think that should be exposed as a separate shutil.reflink() though, and copyfile() should just do a standard copy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:08:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:08:37 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559660917.69.0.569989377588.issue26219@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ea9f168957f7236aae2185f65e0dc608a9a7a37b by Victor Stinner in branch 'master':
bpo-26219: Fix compiler warning in _PyCode_InitOpcache() (GH-13809)
https://github.com/python/cpython/commit/ea9f168957f7236aae2185f65e0dc608a9a7a37b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:09:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:09:15 +0000
Subject: [issue36778] test_site.StartupImportTests.test_startup_imports fails
 if default code page is cp65001
In-Reply-To: <1556829985.34.0.069265948139.issue36778@roundup.psfhosted.org>
Message-ID: <1559660955.12.0.956500083787.issue36778@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ca612a9728b83472d9d286bbea74972d426ed344 by Victor Stinner in branch 'master':
bpo-36778: Remove outdated comment from CodePageTest (GH-13807)
https://github.com/python/cpython/commit/ca612a9728b83472d9d286bbea74972d426ed344


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36778>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:09:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:09:47 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559660987.98.0.462653868371.issue37140@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It would be great to be able to write a reproducer and then convert it into a proper unit test.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:11:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:11:44 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559661104.07.0.836411959899.issue33725@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ned Deily:
> No, it has *always* been unsafe. What's new as of 10.13/14 is that macOS tries much harder at runtime to detect such cases and more predictably cause an error rather than letter than let the process run on and possibly fail nondeterministically.

Hum, in the doc, I wrote:

.. versionchanged:: 3.8

   On macOS, *spawn* start method is now the default: *fork* start method is no
   longer reliable on macOS, see :issue:`33725`.

Should we change this text? Any proposition?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:12:27 2019
From: report at bugs.python.org (carlo)
Date: Tue, 04 Jun 2019 15:12:27 +0000
Subject: [issue37152] Add AF_LOCAL alias for AF_UNIX
In-Reply-To: <1559660738.02.0.723341796578.issue37152@roundup.psfhosted.org>
Message-ID: <1559661147.15.0.100974450087.issue37152@roundup.psfhosted.org>


Change by carlo <carlo.revelli at berkeley.edu>:


----------
keywords: +patch
pull_requests: +13695
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13810

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37152>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:15:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:15:23 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1559661323.31.0.57626323555.issue26219@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I understand that the initial issue (add an opcode cache) has been implemented. Well done Yury and INADA-san!

Please open new issues for follow-up like the new optimization ideas ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:18:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:18:17 +0000
Subject: [issue30699] Misleading class names in datetime.tzinfo usage examples
In-Reply-To: <1497824156.09.0.152108719585.issue30699@psf.upfronthosting.co.za>
Message-ID: <1559661497.52.0.513611841609.issue30699@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset f0b5ae4567637b24035ecda93a3240efc96b6dd9 by Victor Stinner (Mario Corchero) in branch 'master':
bpo-30699: Improve example on datetime tzinfo instances (GH-4290)
https://github.com/python/cpython/commit/f0b5ae4567637b24035ecda93a3240efc96b6dd9


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30699>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:18:37 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 15:18:37 +0000
Subject: [issue30699] Misleading class names in datetime.tzinfo usage examples
In-Reply-To: <1497824156.09.0.152108719585.issue30699@psf.upfronthosting.co.za>
Message-ID: <1559661517.08.0.584309406771.issue30699@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13697
pull_request: https://github.com/python/cpython/pull/13811

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30699>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:25:20 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 15:25:20 +0000
Subject: [issue30699] Misleading class names in datetime.tzinfo usage examples
In-Reply-To: <1497824156.09.0.152108719585.issue30699@psf.upfronthosting.co.za>
Message-ID: <1559661920.42.0.525527111718.issue30699@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 12c178799a23b47c5f8ebc072cbdf09a370649ae by Miss Islington (bot) in branch '3.7':
bpo-30699: Improve example on datetime tzinfo instances (GH-4290)
https://github.com/python/cpython/commit/12c178799a23b47c5f8ebc072cbdf09a370649ae


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30699>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:29:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 15:29:34 +0000
Subject: [issue30699] Misleading class names in datetime.tzinfo usage examples
In-Reply-To: <1497824156.09.0.152108719585.issue30699@psf.upfronthosting.co.za>
Message-ID: <1559662174.1.0.00318660985434.issue30699@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Mario Corchero for the doc enhancement, and Paul for the review!

Python 2.7 is not affected: datetime has no timeinfo class.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.7, Python 3.8 -Python 2.7, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30699>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:31:37 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 04 Jun 2019 15:31:37 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559662297.55.0.62722139083.issue36742@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +13698
pull_request: https://github.com/python/cpython/pull/13812

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:44:53 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 15:44:53 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559663093.19.0.45191866206.issue37150@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +paul.j3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:55:52 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 15:55:52 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559663752.35.0.332378899834.issue36742@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13699
pull_request: https://github.com/python/cpython/pull/13813

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:56:00 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Tue, 04 Jun 2019 15:56:00 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559663760.58.0.825534282833.issue36742@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 8d0ef0b5edeae52960c7ed05ae8a12388324f87e by ?ukasz Langa (Steve Dower) in branch 'master':
bpo-36742: Corrects fix to handle decomposition in usernames (#13812)
https://github.com/python/cpython/commit/8d0ef0b5edeae52960c7ed05ae8a12388324f87e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 11:56:05 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 15:56:05 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559663765.48.0.205924016326.issue36742@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13700
pull_request: https://github.com/python/cpython/pull/13814

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:04:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 04 Jun 2019 16:04:20 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559664260.03.0.856802923298.issue36742@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +13701
pull_request: https://github.com/python/cpython/pull/13815

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:10:59 2019
From: report at bugs.python.org (Senthil Kumaran)
Date: Tue, 04 Jun 2019 16:10:59 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559664659.05.0.0387208459982.issue36742@roundup.psfhosted.org>


Senthil Kumaran <senthil at uthcode.com> added the comment:

Thanks for this engagement and pull requests, Steve.
Thanks for reviews Karthikeyan.

----------
nosy: +orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:15:27 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 16:15:27 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559664927.34.0.769197672689.issue36742@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 250b62acc59921d399f0db47db3b462cd6037e09 by Miss Islington (bot) in branch '3.7':
bpo-36742: Corrects fix to handle decomposition in usernames (GH-13812)
https://github.com/python/cpython/commit/250b62acc59921d399f0db47db3b462cd6037e09


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:18:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 16:18:11 +0000
Subject: [issue36421] A possible double decref in _ctypes.c's
 PyCArrayType_new()
In-Reply-To: <1553484684.08.0.15989371051.issue36421@roundup.psfhosted.org>
Message-ID: <1559665091.79.0.030233552216.issue36421@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> just one question, how did you detect this bug?

I bet that Zackery Spytz used Svace static analyzer: http://www.ispras.ru/en/technologies/svace/

See also: https://python-security.readthedocs.io/security.html#static-analysers-of-cpython-code-base

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36421>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:18:15 2019
From: report at bugs.python.org (Greg Lindahl)
Date: Tue, 04 Jun 2019 16:18:15 +0000
Subject: [issue33762] temp file isn't IOBase
In-Reply-To: <1528059185.23.0.592728768989.issue33762@psf.upfronthosting.co.za>
Message-ID: <1559665095.75.0.494479575099.issue33762@roundup.psfhosted.org>


Greg Lindahl <lindahl at pbm.com> added the comment:

This is breaking aiohttp client file multipart uploads from temporary files. I'd be willing to bet that a lot of libraries do isinstance(foo, io.IOBase) deep in their guts.

----------
nosy: +wumpus

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33762>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:30:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 16:30:09 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
Message-ID: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

x86 Windows7 3.x:
https://buildbot.python.org/all/#/builders/58/builds/2573

0:42:21 load avg: 4.40 [283/423/1] test_venv crashed (Exit code 1)
Timeout (0:35:00)!
Thread 0x000000c0 (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1332 in _readerthread
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 865 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 923 in _bootstrap_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap

Thread 0x00000c6c (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1332 in _readerthread
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 865 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 923 in _bootstrap_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 885 in _bootstrap

Thread 0x00000350 (most recent call first):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 1015 in _wait_for_tstate_lock
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\threading.py", line 999 in join
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 1361 in _communicate
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\subprocess.py", line 999 in communicate
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 40 in check_output
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_venv.py", line 327 in test_multiprocessing
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 628 in _callTestMethod
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 671 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\case.py", line 731 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 122 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\suite.py", line 84 in __call__
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\unittest\runner.py", line 176 in run
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1984 in _run_suite
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 2080 in run_unittest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 203 in _test_module
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 228 in _runtest_inner2
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 264 in _runtest_inner
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 135 in _runtest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest.py", line 187 in runtest
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\runtest_mp.py", line 66 in run_tests_worker
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 611 in _main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 588 in main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 663 in main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\regrtest.py", line 46 in _main
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\regrtest.py", line 50 in <module>
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 85 in _run_code
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 192 in _run_module_as_main

(...)

Re-running failed tests in verbose mode
Re-running test_venv in verbose mode
test_defaults (test.test_venv.BasicTest) ... ok
test_executable (test.test_venv.BasicTest) ... ok
test_executable_symlinks (test.test_venv.BasicTest) ... skipped 'Needs symlinks'
test_isolation (test.test_venv.BasicTest) ... ok
test_multiprocessing (test.test_venv.BasicTest) ... ok
test_overwrite_existing (test.test_venv.BasicTest) ... ok
test_prefixes (test.test_venv.BasicTest) ... ok
test_prompt (test.test_venv.BasicTest) ... ok
test_symlinking (test.test_venv.BasicTest) ... skipped 'Needs symlinks'
test_unicode_in_batch_file (test.test_venv.BasicTest) ... ok
test_unoverwritable_fails (test.test_venv.BasicTest) ... ok
test_upgrade (test.test_venv.BasicTest) ... ok
test_devnull (test.test_venv.EnsurePipTest) ... ok
test_explicit_no_pip (test.test_venv.EnsurePipTest) ... ok
test_no_pip_by_default (test.test_venv.EnsurePipTest) ... ok
test_with_pip (test.test_venv.EnsurePipTest) ... ok

----------------------------------------------------------------------

Ran 16 tests in 59.907s

OK (skipped=2)

== Tests result: FAILURE then SUCCESS ==

(...)

1 re-run test:
    test_venv

Total duration: 1 hour 6 min
Tests result: FAILURE then SUCCESS
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1006, in temp_dir
    yield path
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1058, in temp_cwd
    yield cwd_dir
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 588, in main
    self._main(tests, kwargs)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 658, in _main
    sys.exit(0)
SystemExit: 0

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 329, in _force_run
    return func(*args)
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'D:\\cygwin\\home\\db3l\\buildarea\\3.x.bolen-windows7\\build\\build\\test_python_3040\\worker_3236'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 192, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\__main__.py", line 2, in <module>
    main()
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 663, in main
    Regrtest().main(tests=tests, **kwargs)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\libregrtest\main.py", line 588, in main
    self._main(tests, kwargs)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1058, in temp_cwd
    yield cwd_dir
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 1011, in temp_dir
    rmtree(path)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 451, in rmtree
    _rmtree(path)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 392, in _rmtree
    _waitfor(_rmtree_inner, path, waitall=True)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 340, in _waitfor
    func(pathname)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 389, in _rmtree_inner
    _force_run(fullname, os.rmdir, fullname)
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\support\__init__.py", line 335, in _force_run
    return func(*args)
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'D:\\cygwin\\home\\db3l\\buildarea\\3.x.bolen-windows7\\build\\build\\test_python_3040\\worker_3236'

----------
components: Tests
messages: 344600
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_venv: test_multiprocessing() hangs randomly on x86 Windows7 3.x
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:32:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 16:32:01 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
In-Reply-To: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>
Message-ID: <1559665921.55.0.448996160149.issue37153@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13702
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13816

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:32:39 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 16:32:39 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
In-Reply-To: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>
Message-ID: <1559665959.37.0.993898554686.issue37144@roundup.psfhosted.org>


Change by Demid <grrrr at protonmail.com>:


----------
nosy: +zygocephalus -dm

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:33:09 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 16:33:09 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
In-Reply-To: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>
Message-ID: <1559665989.59.0.591858570055.issue37144@roundup.psfhosted.org>


Change by Demid <grrrr at protonmail.com>:


----------
nosy: +dm

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:40:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 04 Jun 2019 16:40:20 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559666420.86.0.298076497679.issue36742@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f61599b050c621386a3fc6bc480359e2d3bb93de by Steve Dower in branch '2.7':
bpo-36742: Corrects fix to handle decomposition in usernames (GH-13812)
https://github.com/python/cpython/commit/f61599b050c621386a3fc6bc480359e2d3bb93de


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:49:36 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Tue, 04 Jun 2019 16:49:36 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559666976.15.0.146258116518.issue26826@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

Actually "man copy_file_range" claims it can do server-side copy, meaning no network traffic between client and server if *src* and *dst* live on the same network fs. So I agree copy_file_range() should be preferred over sendfile() after all. =)
I have a wrapper for copy_file_range() similar to what I did in shutil in issue33671 which I can easily integrate, but I wanted to land this one first:
https://bugs.python.org/issue37096
Also, I suppose we cannot land this in time for 3.8?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:49:50 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 16:49:50 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
In-Reply-To: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>
Message-ID: <1559666990.3.0.852928609066.issue37144@roundup.psfhosted.org>


Change by Demid <grrrr at protonmail.com>:


----------
keywords: +patch
pull_requests: +13703
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13817

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:55:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 16:55:02 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
Message-ID: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

AMD64 Fedora Rawhide Clang Installed 3.7:
https://buildbot.python.org/all/#/builders/195/builds/104


FAIL: test_env_var (test.test_utf8_mode.UTF8ModeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.7.cstratak-fedora.installed/build/target/lib/python3.7/test/test_utf8_mode.py", line 93, in test_env_var
    self.assertEqual(out, '0')
AssertionError: '1' != '0'
- 1
+ 0


On the buildbot:

vstinner at python-builder-rawhide$ env|grep -E 'LC_|LANG'
LANG=en_US.UTF-8

vstinner at python-builder-rawhide$ locale
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
(...)
LC_ALL=


Extract of the test:

        # Cannot test with the POSIX locale, since the POSIX locale enables
        # the UTF-8 mode
        if not self.posix_locale():
            # PYTHONUTF8 should be ignored if -E is used
            out = self.get_output('-E', '-c', code, PYTHONUTF8='1')
            self.assertEqual(out, '0')

The problem seems to be posix_locale() which fails if the C locale has been coerced by PEP 538:

    POSIX_LOCALES = ('C', 'POSIX')

    def posix_locale(self):
        loc = locale.setlocale(locale.LC_CTYPE, None)
        return (loc in POSIX_LOCALES)

This code doesn't work if LC_CTYPE is already coerced.

----------
components: Tests
messages: 344603
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_utf8_mode: test_env_var() fails on AMD64 Fedora Rawhide Clang Installed 3.7
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Tue Jun  4 12:57:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 16:57:16 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1559667436.09.0.656458879488.issue37154@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It seems like this buildbot has no locale, maybe they have been removed:

vstinner at python-builder-rawhide$ locale -a
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_COLLATE to default locale: No such file or directory
C
C.utf8
POSIX

----------
nosy: +cstratak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:00:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:00:49 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1559667649.18.0.498424085608.issue37154@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

glibc-all-langpacks was already installed, but glibc-langpack-en was not installed. I installed glibc-langpack-en: it worked around the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:03:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:03:16 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
In-Reply-To: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>
Message-ID: <1559667796.31.0.42387069059.issue37153@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset bc6469f79ca13217b784fb47da7ec83484a3debe by Victor Stinner in branch 'master':
bpo-37153: test_venv.test_mutiprocessing() calls pool.terminate() (GH-13816)
https://github.com/python/cpython/commit/bc6469f79ca13217b784fb47da7ec83484a3debe


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:06:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:06:41 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1559668001.98.0.0629170633691.issue37154@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Related failure on "AMD64 Fedora Rawhide Clang Installed 2.7":
https://buildbot.python.org/all/#/builders/186/builds/23

ERROR: test_setlocale_unicode (test.test_locale.TestMiscellaneous)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/buildbot/buildarea/2.7.cstratak-fedora.installed/build/target/lib/python2.7/test/test_locale.py", line 500, in test_setlocale_unicode
    user_locale = locale.setlocale(locale.LC_CTYPE, '')
  File "/home/buildbot/buildarea/2.7.cstratak-fedora.installed/build/target/lib/python2.7/locale.py", line 581, in setlocale
    return _setlocale(category, locale)
Error: unsupported locale setting

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:11:26 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 04 Jun 2019 17:11:26 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1559661104.07.0.836411959899.issue33725@roundup.psfhosted.org>
Message-ID: <D41A9031-3A04-4999-AD00-67403AE74267@python.org>


Barry A. Warsaw <barry at python.org> added the comment:

On Jun 4, 2019, at 08:11, STINNER Victor <report at bugs.python.org> wrote:
> Ned Deily:
>> No, it has *always* been unsafe. What's new as of 10.13/14 is that macOS tries much harder at runtime to detect such cases and more predictably cause an error rather than letter than let the process run on and possibly fail nondeterministically.
> 
> Hum, in the doc, I wrote:
> 
> .. versionchanged:: 3.8
> 
>   On macOS, *spawn* start method is now the default: *fork* start method is no
>   longer reliable on macOS, see :issue:`33725`.
> 
> Should we change this text? Any proposition?

Thanks Victor.  I don?t think ?reliable? is strong enough, since this will definitely lead to core dumps under certain conditions.  What about:

   On macOS, the *spawn* start method is now the default.  The *fork* start method should
   be considered unsafe as it can lead to crashes of the subprocess.  See :issue:`33725`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:13:12 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Tue, 04 Jun 2019 17:13:12 +0000
Subject: [issue36894] test_multiprocessing_spawn regression on Windows
In-Reply-To: <1557680621.73.0.0423240629914.issue36894@roundup.psfhosted.org>
Message-ID: <1559668392.64.0.0377795591909.issue36894@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:

Can this be closed?

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36894>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:18:28 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 17:18:28 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559668708.35.0.945132415815.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thank you, everyone, for expressing clearly your different opinions and concerns. Without disregarding any of the
arguments so far I want to make some further clarifications on some points and why I still think this is important.

> FWIW, I would rather not see the docs littered with "/".

Although I assume there is not the intention, there is absolutely no reason to be disrespectful to the people that
think otherwise. You can express the same idea without implying that the feature is "litter". The same thing applies
to "unfortunate implementation" in another of the sentences that was used.

> This is another step toward making what I see as an unfortunate implementation detail into formal semantics.

The feature has as much formal semantics as it is possible already: is an official part of the language.

One of the things the PEP makes a lot of emphasis is the current status of the feature and how users see the syntax
is precisely caused because of a lack of documentation, exposition and ultimately (and very important) because it was
not valid Python syntax. The fact that many people were thinking that is a typo in the documentation or "noise" is precisely
because of this and I think having it in the docs is crucial for discovery.

Regarding the usefulness of having the syntax for users: is exactly as useful as knowing that some arguments are keyword-only
and those are documented and we did not have any discussion about this. One can disagree and argue that the usefulness of the
feature, when some users consider implementing functions that use both syntaxes, is much different between positional-only and
keyword-only and that one solve more common problems that the other, but that is irrelevant for people reading the documentation:
the relevant thing is that they tell you the restrictions when calling an existing function. And at that point, it does not matter
how common something is or how common is fall into the error condition. Also, take into account that there is a serious difference
between teaching someone how to react to the syntax (you cannot use keyword parameters for these arguments), which is done almost
immediately, and teaching someone when they want to use the syntax themselves on their function. And I want to make clear that I
acknowledge that there is a cognitive burden because there are more cases to remember.

I think documenting the trailing "/" is especially important because now users will find very confusing the fact that functions
only document the "/" in some places. They may start to believe that a trailing "/" is illegal syntax or that the "/" at the end
is optional. This will lead to even more confusion IMHO. This will also perpetuate another thing that the PEP put a lot of focus
on solving, which is removing the dissonance between the signature that appears in the documentation, the one in the help() and docstrings
and the one that inspect.signature will return. Precisely failing to document all cases will make this even more confusing and will severely
alter and bias any feedback that users could provide about any related aspect.

It is possible that some users were thinking that the bare "*" for keyword-only arguments was a typo when it was introduced and maybe
they were thinking that the author meant "*args", but we can all agree that that was not a problem. I don't see why this syntax needs
to have special treatment regarding that. Another sentence of the ZEN of Python reads "Special cases aren't special enough to break the rules"
and the rules at to this point is that there were absolutely no restrictions regarding using new syntax or terminology in the documentation.

I understand the concerns and I take them into account, but for these reasons together with what other core devs are exposing, I think this
syntax should be included into the documentation (including trailing "/") as this was one core motivation for the PEP.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:36:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:36:29 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1559669789.51.0.500715932088.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New failure:

AMD64 FreeBSD CURRENT Shared 3.x:
https://buildbot.python.org/all/#/builders/168/builds/1154

...
test_thread_leak (test.test_threading.PyRLockTests) ... ok
test_timeout (test.test_threading.PyRLockTests) ... ok
test_try_acquire (test.test_threading.PyRLockTests) ... ok
test_try_acquire_contended (test.test_threading.PyRLockTests) ... ok
test_weakref_deleted (test.test_threading.PyRLockTests) ... ok
test_weakref_exists (test.test_threading.PyRLockTests) ... ok
test_with (test.test_threading.PyRLockTests) ... ok
test_acquire (test.test_threading.SemaphoreTests) ... ok
test_acquire_contended (test.test_threading.SemaphoreTests) ... ok
test_acquire_destroy (test.test_threading.SemaphoreTests) ... ok
test_acquire_timeout (test.test_threading.SemaphoreTests) ... ok
test_constructor (test.test_threading.SemaphoreTests) ... ok
test_default_value (test.test_threading.SemaphoreTests) ... ok
test_release_unacquired (test.test_threading.SemaphoreTests) ... ok
test_try_acquire (test.test_threading.SemaphoreTests) ... ok
test_try_acquire_contended (test.test_threading.SemaphoreTests) ... ok
test_with (test.test_threading.SemaphoreTests) ... ok
test_daemon_threads_fatal_error (test.test_threading.SubinterpThreadingTests) ... ok
test_threads_join (test.test_threading.SubinterpThreadingTests) ... ok
Fatal Python error: Py_EndInterpreter: not the last thread

Current thread 0x0000000800ac3000 (most recent call first):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/support/__init__.py", line 2794 in run_in_subinterp
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_threading.py", line 923 in test_threads_join_2
test_threads_join_2 (test.test_threading.SubinterpThreadingTests) ... *** Signal 6

Stop.
make: stopped in /usr/home/buildbot/python/3.x.koobs-freebsd-current/build
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 628 in _callTestMethod
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 671 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/case.py", line 731 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 122 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/suite.py", line 84 in __call__
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/unittest/runner.py", line 176 in run
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/support/__init__.py", line 1984 in _run_suite
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/support/__init__.py", line 2080 in run_unittest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 203 in _test_module
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 228 in _runtest_inner2
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 264 in _runtest_inner
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 148 in _runtest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/runtest.py", line 187 in runtest
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 291 in rerun_failed_tests
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 646 in _main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 588 in main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/libregrtest/main.py", line 663 in main
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/__main__.py", line 2 in <module>
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/runpy.py", line 85 in _run_code
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/runpy.py", line 192 in _run_module_as_main
program finished with exit code 1
elapsedTime=3523.834729

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:38:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:38:15 +0000
Subject: [issue37155] test_asyncio: test_stdin_broken_pipe() failed on AMD64
 FreeBSD CURRENT Shared 3.x
Message-ID: <1559669895.88.0.0230112144047.issue37155@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

See also bpo-33531 and bpo-30382.

AMD64 FreeBSD CURRENT Shared 3.x:
https://buildbot.python.org/all/#/builders/168/builds/1154

======================================================================
FAIL: test_stdin_broken_pipe (test.test_asyncio.test_subprocess.SubprocessFastWatcherTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_asyncio/test_subprocess.py", line 243, in test_stdin_broken_pipe
    self.assertRaises((BrokenPipeError, ConnectionResetError),
AssertionError: (<class 'BrokenPipeError'>, <class 'ConnectionResetError'>) not raised by run_until_complete

----------
components: Tests
messages: 344612
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_asyncio: test_stdin_broken_pipe() failed on AMD64 FreeBSD CURRENT Shared 3.x
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37155>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:39:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 17:39:53 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1559669993.57.0.736746633073.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

In the same build:
https://buildbot.python.org/all/#builders/168/builds/1154

0:28:57 load avg: 12.93 [208/423/1] test_threading crashed (Exit code 1) -- running: test_lib2to3 (7 min 9 sec), test_multiprocessing_spawn (1 min 36 sec)
Timeout (0:25:00)!
Thread 0x0000000800ac3000 (most recent call first):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/threading.py", line 1015 in _wait_for_tstate_lock
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/threading.py", line 999 in join
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_threading.py", line 1287 in test_interrupt_main_subthread
  (...)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:40:16 2019
From: report at bugs.python.org (paul j3)
Date: Tue, 04 Jun 2019 17:40:16 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559670016.08.0.770399401281.issue37150@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

I don't see an easy way around this.  FileType is a class, and thus is a callable.  add_argument checks that the 'type' parameter is a callable (or a string in the registry).  Otherwise it gives the programmer a lot of freedom regarding this parameter.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:41:40 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 04 Jun 2019 17:41:40 +0000
Subject: [issue35805] email package folds msg-id identifiers using RFC2047
 encoded words where it must not
In-Reply-To: <1548161762.46.0.975813554813.issue35805@roundup.psfhosted.org>
Message-ID: <1559670100.82.0.162803726906.issue35805@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset 46d88a113142b26c01c95c93846a89318ba87ffc by Barry Warsaw (Abhilash Raj) in branch 'master':
bpo-35805: Add parser for Message-ID email header. (GH-13397)
https://github.com/python/cpython/commit/46d88a113142b26c01c95c93846a89318ba87ffc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35805>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:44:34 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 04 Jun 2019 17:44:34 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
In-Reply-To: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>
Message-ID: <1559670274.35.0.36441033714.issue37144@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This was documented in c45cd167d403d7d98078d5fc4a37b16195dc7a35 but it seems a test for opening gzip file with 'w|gz' mode as in the original report was missing.

----------
nosy: +lars.gustaebel, serhiy.storchaka, xtreak
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:47:39 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 17:47:39 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559670459.35.0.826268802239.issue37145@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> Then I guess what I consider a bug is "__init__ is undocumented".

No, this just how Python works.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:48:25 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 17:48:25 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
In-Reply-To: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>
Message-ID: <1559670505.41.0.160522994786.issue37153@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13705
pull_request: https://github.com/python/cpython/pull/13819

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:52:37 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 04 Jun 2019 17:52:37 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559670757.27.0.413115325353.issue37134@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

I echo Pablo's comment about thoughtful discourse as this is discussed.

For library maintainers that are writing APIs that involve workflows across multiple projects maintained by different people, better information and documentation is very important.

We are balancing the needs of different user groups. An all or nothing approach to documenting / and positional only arguments will not serve the different groups well. What will serve them is coming up with an approach that will work (though not perfectly) for each group. In essence, balancing and compromising are critical.

I suggested an approach earlier which I would appreciate folks give a closer look to its merit.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 13:56:06 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 17:56:06 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559670966.97.0.567285398577.issue37145@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Hit <submit> too early.

In Python, the norm is that the class name is documented.  When you call the class, the __init__() method gets called automatically (as documented in the language reference and in the tutorial).

For example:

    >>> class A:
            def __init__(self, seq):
                    self._seq = seq
            def __len__(self):
                    return len(self._seq)
      
    >>> a = A('apple')
    >>> len(a)	  
    5

In this example, we document that class "A" can be called with a sequence and that len() can be called on instances of A.  The "dunder" methods are public, but are called and documented indirectly.  The "_seq" attribute is marked as private and would not be documented, since it is an implementation detail and not intended to be accessed directly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:01:00 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 18:01:00 +0000
Subject: [issue30835] AttributeError when parsing multipart email with invalid
 non-decodable Content-Transfer-Encoding
In-Reply-To: <1499089023.06.0.76757916564.issue30835@psf.upfronthosting.co.za>
Message-ID: <1559671260.25.0.103647934893.issue30835@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13706
pull_request: https://github.com/python/cpython/pull/13820

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30835>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:01:04 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 04 Jun 2019 18:01:04 +0000
Subject: [issue30835] AttributeError when parsing multipart email with invalid
 non-decodable Content-Transfer-Encoding
In-Reply-To: <1499089023.06.0.76757916564.issue30835@psf.upfronthosting.co.za>
Message-ID: <1559671264.74.0.648616322036.issue30835@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset aa79707262f893428665ef45b5e879129abca4aa by Barry Warsaw (Abhilash Raj) in branch 'master':
bpo-30835: email: Fix AttributeError when parsing invalid CTE (GH-13598)
https://github.com/python/cpython/commit/aa79707262f893428665ef45b5e879129abca4aa


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30835>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:01:10 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 04 Jun 2019 18:01:10 +0000
Subject: [issue30835] AttributeError when parsing multipart email with invalid
 non-decodable Content-Transfer-Encoding
In-Reply-To: <1499089023.06.0.76757916564.issue30835@psf.upfronthosting.co.za>
Message-ID: <1559671270.23.0.536166679984.issue30835@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13707
pull_request: https://github.com/python/cpython/pull/13821

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30835>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:03:42 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 18:03:42 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559671422.98.0.374316766581.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thank you Carol for your comment! Regarding your proposal, I find it it attractive as a compromise in order to make more gentle the introduction of the feature to users. I really appreciate the effort to balance all the different aspects and concerns.

Ccould you extend your thoughts regarding this concern that I have with respect of not including the trailing / in 3.8 but doing it in 3.9:

>I think documenting the trailing "/" is especially important because now users will find very confusing the fact that functions
only document the "/" in some places. They may start to believe that a trailing "/" is illegal syntax or that the "/" at the end
is optional. This will lead to even more confusion IMHO.

Another minor concern that I have is the fear that we will have a similar discussion in the future when the PR adding the trailing / to 3.9 would be added.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:35:54 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 04 Jun 2019 18:35:54 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559673354.34.0.495891633343.issue37149@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy: +gpolo, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:43:37 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 04 Jun 2019 18:43:37 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559673817.6.0.166466507827.issue36839@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Let's please keep this respectful. Saying people are basing things "on fantasy" or that "people need to develop reading skills" is not helpful.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 14:44:00 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 04 Jun 2019 18:44:00 +0000
Subject: [issue36742] urlsplit doesn't accept a NFKD hostname with a port
 number
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559673840.26.0.66777682953.issue36742@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset fd1771dbdd28709716bd531580c40ae5ed814468 by Ned Deily (Miss Islington (bot)) in branch '3.6':
bpo-36742: Corrects fix to handle decomposition in usernames (GH-13812) (GH-13814)
https://github.com/python/cpython/commit/fd1771dbdd28709716bd531580c40ae5ed814468


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:02:22 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 04 Jun 2019 19:02:22 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559674942.74.0.438119791821.issue36964@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

"if you coded bad and it doesn't work, it's your fault."

I disagree. Your request changes what VIRTUAL_ENV gets set to, correct? Changing it suddenly for users doesn't mean their code was bad, it means we changed something on them. Now we can do that with a good justification, but simply to make it easier to have "unofficial unsupported bonus" is not a good enough reason to upset people with requiring everyone to update their code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:03:44 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 04 Jun 2019 19:03:44 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1559675024.92.0.161215546289.issue37140@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

I added a unittest to the PR that illustrates the problem.  It doesn't pass yet.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:04:11 2019
From: report at bugs.python.org (Marco Sulla)
Date: Tue, 04 Jun 2019 19:04:11 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559675051.71.0.0663173279568.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Well, I repeat, not with 

#!/usr/bin/env python3

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:07:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 19:07:07 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
In-Reply-To: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>
Message-ID: <1559675227.59.0.95970098759.issue37153@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 5f8443eec9d54e1f74b69aa547e6810da6afa90b by Victor Stinner (Miss Islington (bot)) in branch '3.7':
bpo-37153: test_venv.test_mutiprocessing() calls pool.terminate() (GH-13816) (GH-13819)
https://github.com/python/cpython/commit/5f8443eec9d54e1f74b69aa547e6810da6afa90b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:07:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 19:07:40 +0000
Subject: [issue37153] test_venv: test_multiprocessing() hangs randomly on x86
 Windows7 3.x
In-Reply-To: <1559665809.74.0.244417716328.issue37153@roundup.psfhosted.org>
Message-ID: <1559675260.94.0.48462991328.issue37153@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I hope that my change will prevent the random failure.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37153>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:07:59 2019
From: report at bugs.python.org (Marco Sulla)
Date: Tue, 04 Jun 2019 19:07:59 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559675279.59.0.687439535115.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

The previous post was for Laurie Opperman

"upset people with requiring everyone to update their code"

I don't know why they have to be upset. Until now they can't move the folder. They want to move the folder? They have to change their code. Now they have no possibility at all to move it, so I don't know why they should be upset. 

And yes, I consider a code that depends from the path of the folder it resides a bad code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:10:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 19:10:07 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1559666976.15.0.146258116518.issue26826@roundup.psfhosted.org>
Message-ID: <CA+3bQGGQEKpmP0W7FwcSVQaE24TtcqZiaaki5MLCOU=fY86EUg@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

Please open a new issue to discuss how it can used in shutil ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:10:35 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 04 Jun 2019 19:10:35 +0000
Subject: [issue37089] `import Lib.os` works on windows (but shouldn't)
In-Reply-To: <1559163159.15.0.0136841146516.issue37089@roundup.psfhosted.org>
Message-ID: <1559675435.74.0.763505779549.issue37089@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I doubt it's meant as a feature. I don't recall anything about it. I suspect it's got to do with limitations of the Windows installer (at the time). Maybe there are other things that are siblings of "Lib" that must be importable, e.g. DLLs?

I recommend taking this up with Steve Dower, who owns the Windows installers these days.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37089>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:10:41 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 04 Jun 2019 19:10:41 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559675441.76.0.0831452674713.issue36964@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:12:15 2019
From: report at bugs.python.org (Marco Sulla)
Date: Tue, 04 Jun 2019 19:12:15 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559675535.27.0.622886204447.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Furthermore, if you destroy an old virtual env and recreate it with the new method, it continues to work as before, since VIRTUAL_ENV points to the same folder. We don't force to change the code if they continues to use the virtual environments as now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:19:55 2019
From: report at bugs.python.org (Geoffrey Sneddon)
Date: Tue, 04 Jun 2019 19:19:55 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559675995.93.0.709312136732.issue37145@roundup.psfhosted.org>


Geoffrey Sneddon <geoffers+pythonbugs at gmail.com> added the comment:

You've missed my point: the arguments that MappingView.__init__ takes are undocumented. Nowhere mentions class MappingView(mapping), as I would expect from how initializers are documented elsewhere.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:20:29 2019
From: report at bugs.python.org (Geoffrey Sneddon)
Date: Tue, 04 Jun 2019 19:20:29 +0000
Subject: [issue37145] collections.abc.MappingView mixins rely on undocumented
 _mapping
In-Reply-To: <1559580516.49.0.942559591286.issue37145@roundup.psfhosted.org>
Message-ID: <1559676029.9.0.23435885467.issue37145@roundup.psfhosted.org>


Geoffrey Sneddon <geoffers+pythonbugs at gmail.com> added the comment:

Like, where in the documentation can I learn that MappingView's initializer takes an argument "mapping"?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37145>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:27:19 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Tue, 04 Jun 2019 19:27:19 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559676438.99.0.552532886753.issue37150@roundup.psfhosted.org>


Michele Angrisano <michele.angrisano at gmail.com> added the comment:

Reading the examples in the doc, it's clear the behavior when FileType takes an argument. What's the behavior of FileType when is called without any argument?

----------
nosy: +mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 15:35:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 19:35:08 +0000
Subject: [issue35047] Better error messages in unittest.mock
In-Reply-To: <1540283736.06.0.788709270274.issue35047@psf.upfronthosting.co.za>
Message-ID: <1559676908.18.0.842529427336.issue35047@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 001d63cefaa9d84d6d59aa9db8bac66040c8f0ee by Victor Stinner (Petter Strandmark) in branch 'master':
bpo-35047: Update whatsnew/3.8 for better mock error message (GH-13746)
https://github.com/python/cpython/commit/001d63cefaa9d84d6d59aa9db8bac66040c8f0ee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35047>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:08:49 2019
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 04 Jun 2019 20:08:49 +0000
Subject: [issue37152] Add AF_LOCAL alias for AF_UNIX
In-Reply-To: <1559660738.02.0.723341796578.issue37152@roundup.psfhosted.org>
Message-ID: <1559678929.59.0.417528247321.issue37152@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The socket type is known as AF_UNIX, AF_LOCAL, Unix domain socket, and IPC (inter process communication) socket. The man page unix(7) http://man7.org/linux/man-pages/man7/unix.7.html uses three of those four terms to explain the socket type:

    The AF_UNIX (also known as AF_LOCAL) socket family is used to
    communicate between processes on the same machine efficiently.
    Traditionally, UNIX domain sockets can be [...]

The strace command also uses the name AF_UNIX and not AF_LOCAL. HTTP over AF_UNIX often uses http+unix:// or unix:// to refer to a socket file.

I'm -1 to add the alias. It just adds to the confusion. It's also against the Zen of Python: "There should be one-- and preferably only one --obvious way to do it."

----------
nosy: +christian.heimes
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37152>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:20:58 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 04 Jun 2019 20:20:58 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
Message-ID: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

Mostly a note to self to fix the tag. Right now the x64 build gets an extra suffix, which is incorrect and causes installer builds to fail.

----------
assignee: steve.dower
components: Windows
messages: 344638
nosy: paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Fix libssl DLL tag in Tools/msi project
type: compile error
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:36:25 2019
From: report at bugs.python.org (Zachary Ware)
Date: Tue, 04 Jun 2019 20:36:25 +0000
Subject: [issue34282] Enum._convert shadows members named _convert
In-Reply-To: <1532972199.25.0.56676864532.issue34282@psf.upfronthosting.co.za>
Message-ID: <1559680585.38.0.540614345511.issue34282@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
pull_requests: +13708
pull_request: https://github.com/python/cpython/pull/13823

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34282>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:39:03 2019
From: report at bugs.python.org (Brian Skinn)
Date: Tue, 04 Jun 2019 20:39:03 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559680743.89.0.945342506178.issue37134@roundup.psfhosted.org>


Change by Brian Skinn <bskinn at alum.mit.edu>:


----------
nosy: +bskinn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:44:14 2019
From: report at bugs.python.org (Josh Rosenberg)
Date: Tue, 04 Jun 2019 20:44:14 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559681054.56.0.259972330981.issue37150@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

The docs specify what argparse.FileType() does via the default parameters: https://docs.python.org/3/library/argparse.html#argparse.FileType

If you mean what does it do when you fail to call it at all (passing type=argparse.FileType), the answer is the same as any other class: It tries to construct a FileType using the user provided argument as the sole positional argument. So if the user passes a valid mode string, it works, and returns a FileType object with that mode string, otherwise it barfs and dumps an error message for passing an invalid argument for FileType.

----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 16:58:40 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Tue, 04 Jun 2019 20:58:40 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559681920.77.0.982904385542.issue37130@roundup.psfhosted.org>


N.P. Khelili <nophke at free.fr> added the comment:

in the definition of the name property https://github.com/python/cpython/blob/9ab2fb1c68a75115da92d51b8c40b74f60f88561/Lib/pathlib.py#L792 :

if len(parts) == (1 if (self._drv or self._root) else 0):
    return ''

could also become

if self.parent == self
    return ''   # why not None btw...

As I said, I'm new to python and I'll make a few tries once I build the test suite

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:01:21 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 04 Jun 2019 21:01:21 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559682081.77.0.399531463004.issue37134@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

> Could you extend your thoughts regarding this concern that I have with respect of not including the trailing / in 3.8 but doing it in 3.9:

Pablo, Sure thing. I believe that a Sphinx extension (possibly existing sphinx-tabs as suggested by @bskinn in the Steering Council issue or one we develop/find) could give us both a "technically accurate" view and "simplified" view. I wasn't sure if this could/would be ready by 3.8. But I think that it is feasible for 3.9. If we can do it for 3.8, fantastic.

If we do the 3.8/3.9 phased approach, I definitely think the 3.8 docs need to be explicit in stating the what/why/when of the / (still searching for a cute name - right now the best I have is "twig" from another name, virgule, for slash and its Latin derivation). Ultimately, 3.9 should either by Sphinx extension or edit contain the "technically accurate" version.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:03:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:03:23 +0000
Subject: [issue34282] Enum._convert shadows members named _convert
In-Reply-To: <1532972199.25.0.56676864532.issue34282@psf.upfronthosting.co.za>
Message-ID: <1559682203.81.0.19281259457.issue34282@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 19a1e1eb86115db66c1faae5927f87e3a12692fc by Victor Stinner (Zachary Ware) in branch 'master':
bpo-34282: Remove deprecated enum _convert method (GH-13823)
https://github.com/python/cpython/commit/19a1e1eb86115db66c1faae5927f87e3a12692fc


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34282>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:05:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:05:39 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1559682339.39.0.0976524034088.issue36889@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Can this issue be closed now?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:24:11 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Tue, 04 Jun 2019 21:24:11 +0000
Subject: [issue15474] Differentiate decorator and decorator factory in docs
In-Reply-To: <1343416207.69.0.71696747041.issue15474@psf.upfronthosting.co.za>
Message-ID: <1559683451.88.0.863042129378.issue15474@roundup.psfhosted.org>


Ezio Melotti <ezio.melotti at gmail.com> added the comment:

If you want some early feedback I believe you can already create a PR and mark it as work-in-progress/don't-merge.

If you need some material you can find the slides of a talk about decorators that I did at
https://www.pycon.it/media/conference/slides/understanding-decorators.pdf
Feel free to take from it whatever you need :)

----------
versions: +Python 3.7, Python 3.8, Python 3.9 -Python 2.7, Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15474>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:28:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:28:08 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559683688.64.0.720557853959.issue37134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python has many parameter types: positional-only, positional-or-keyword, keyword only, etc. Even if we don't add "/", it would be nice to have hints when we put the mouse cursor on a function parameter.

Something like:

function: demo(arg1, *, arg2, arg3=None)

arg1 hint: *arg1* is the first mandatory parameter (kind: positional-or-keyword)
arg2 hint: *arg2* is the second mandatory parameter (kind: keyword-only)
arg3 hint: *arg3* is an optional parameter (default: ``None``, kind: keyword-only)

Maybe we can also add hints on '*':

* hint: Marker for keyword-only parameter

... I have no idea how complex it would be to implement such Sphinx extenstion, or maybe even implement it in Sphinx.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:29:38 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 21:29:38 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559683778.99.0.140892804306.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I don't think inclusion in 3.9 should be automatic.  

The purpose of the deferment is to evaluate the premise, "the only reason people have found this notation confusing was that it wasn't yet valid syntax available for use in their own code."  If that premise turns out to be false, we should think seriously about whether this makes the docs less approachable for everyday users.

This extensive edit of the docs will change the appearance and texture of language from day 1 of a person's exposure to the language.  It warrants careful consideration of the costs and benefits.  Despite what we might wish to be true, the cost side of the equation is definitely not zero.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:33:06 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 21:33:06 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559683986.67.0.189124661675.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Pablo, Sure thing. I believe that a Sphinx extension (possibly existing sphinx-tabs as suggested by @bskinn in the Steering Council issue or one we develop/find) could give us both a "technically accurate" view and "simplified" view. I wasn't sure if this could/would be ready by 3.8. But I think that it is feasible for 3.9. If we can do it for 3.8, fantastic.

Thanks for the quick response and for clarifying that. This looks like a very interesting approach. Would the "simplify" view remove keyword-only argument markers as well? What other features should be hidden in this simplified view?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:36:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:36:40 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
Message-ID: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

bpo-26826 added a new os.copy_file_range() function:
https://docs.python.org/dev/library/os.html#os.copy_file_range

As os.sendfile(), this new Linux syscall avoids memory copies between kernel space and user space. It matters for performance, especially since Meltdown vulnerability required Windows, Linux, FreeBSD, etc. to use a different address space for the kernel (like Linux Kernel page-table isolation, KPTI).

shutil has been modified in Python 3.8 to use os.sendfile() on Linux:
https://docs.python.org/dev/whatsnew/3.8.html#optimizations

But according to Pablo Galindo Salgado, copy_file_range() goes further:
"But copy_file_rane can leverage more filesystem features like deduplication and copy offload stuff."

https://bugs.python.org/issue26826#msg344582

Giampaolo Rodola' added:

"I think data deduplication / CoW / reflink copy is better implemented via FICLONE. "cp --reflink" uses it, I presume because it's older than copy_file_range(). I have a working patch adding CoW copy support for Linux and OSX (but not Windows). I think that should be exposed as a separate shutil.reflink() though, and copyfile() should just do a standard copy."

"Actually "man copy_file_range" claims it can do server-side copy, meaning no network traffic between client and server if *src* and *dst* live on the same network fs. So I agree copy_file_range() should be preferred over sendfile() after all. =)
I have a wrapper for copy_file_range() similar to what I did in shutil in issue33671 which I can easily integrate, but I wanted to land this one first:
https://bugs.python.org/issue37096
Also, I suppose we cannot land this in time for 3.8?"

https://bugs.python.org/issue26826#msg344586

--

There was already a discussion about switching shutil to copy-on-write:
https://bugs.python.org/issue33671#msg317989

One problem is that modifying the "copied" file can suddenly become slower if it was copied using "cp --reflink".

It seems like adding a new reflink=False parameter to file copy functions to control clone/CoW copies is required to prevent bad surprises.

----------
components: Library (Lib)
messages: 344648
nosy: giampaolo.rodola, pablogsal, vstinner
priority: normal
severity: normal
status: open
title: shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:37:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:37:49 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559684269.48.0.192856902499.issue26826@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created bpo-37157: "shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)".

--

The new os.copy_file_range() should be documented at:
https://docs.python.org/dev/whatsnew/3.8.html#os

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:42:32 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 21:42:32 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559684552.63.0.0326018985757.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

>  If that premise turns out to be false, we should think seriously about whether this makes the docs less approachable for everyday users.

We have not done such a thing for any other feature of the language. I think that since this is now a part of the language, it has all the right to be part of the documentation (possibly in some phased process). The contrary will be extremely unfair to the feature and to the PEP process: not a single other case had to fight separately to be included in the language and the documentation. 

And we even have an analogous case: keyword-only argument.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:51:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 21:51:31 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559685091.83.0.518908232506.issue37157@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Random notes.

Extract of Linux manual page of "cp":

       --reflink[=WHEN]
              control clone/CoW copies. See below


       When --reflink[=always] is specified, perform a lightweight copy, where
       the data blocks are copied only when modified.  If this is not possible
       the copy fails, or if --reflink=auto is specified, fall back to a stan?
       dard copy.  Use --reflink=never to ensure a standard copy is performed.

--

"Why is cp --reflink=auto not the default behaviour?":
https://unix.stackexchange.com/questions/80351/why-is-cp-reflink-auto-not-the-default-behaviour

--

reflinks are supported by BTRFS and OCFS2.

XFS seems to have an experimental support for reflink, 2 years old article:
https://strugglers.net/~andy/blog/2017/01/10/xfs-reflinks-and-deduplication/

Linux version of ZFS doesn't support reflink yet:
https://github.com/zfsonlinux/zfs/issues/405

--

Python binding using cffi to get reflink:
https://gitlab.com/rubdos/pyreflink
"Btrfs, XFS, OCFS2 reflink support. Btrfs is tested the most.
Apple macOS APFS clonefile support. Little testing, be careful. It might eat data."

--

"reflink for Windows":
https://github.com/0xbadfca11/reflink
"Windows Server 2016 introduce Block Cloning feature."
=> https://docs.microsoft.com/en-us/windows-server/storage/refs/block-cloning


"ReFS v2 is only available in Windows Server 2016 and Windows 10 version 1703 (build 15063) or later.
Windows 10 version 1607 (build 14393) and earlier Windows only can use ReFS v1."

--

Linux has 2 ioctl:

       #include <sys/ioctl.h>
       #include <linux/fs.h>

       int ioctl(int dest_fd, FICLONERANGE, struct file_clone_range *arg);
       int ioctl(int dest_fd, FICLONE, int src_fd);

http://man7.org/linux/man-pages/man2/ioctl_ficlonerange.2.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Tue Jun  4 17:57:29 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 04 Jun 2019 21:57:29 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559685449.2.0.451931870406.issue37134@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Language features don't have rights.  People do.  :-)

FWIW, there is precedent.  We have type annotations in the language but don't use them throughout the docs.

In the end, all that matters is usability. If a notion fails a usability test, then we should adapt accordingly.

When it comes to documentation, we also try to minimize how much a person needs to know in order a mentally parse a piece in isolation.  That is a core principle of documentation (the MS Excel docs are an excellent example; a counter-example is Wikipedia's use of the IPA pronunciation notation which is technically superior but is only readable/usable by very few of the readers.).  

P.S. I hope you don't come to personally identify with this patch. I'm a big admirer of your work and am already promoting the feature to my 50,000+ twitter follows.  In this tracker issue, I hope for us a have a dispassionate, honest evaluation of what makes for the best documentation of the language.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 18:09:49 2019
From: report at bugs.python.org (=?utf-8?q?Andr=C3=A9s_Delfino?=)
Date: Tue, 04 Jun 2019 22:09:49 +0000
Subject: [issue15474] Differentiate decorator and decorator factory in docs
In-Reply-To: <1343416207.69.0.71696747041.issue15474@psf.upfronthosting.co.za>
Message-ID: <1559686189.76.0.809272589192.issue15474@roundup.psfhosted.org>


Andr?s Delfino <adelfino at gmail.com> added the comment:

Great! I'll definitely give it a look.

I prefer not to make a PR until everything is in its place. You can check the status though:

https://github.com/andresdelfino/cpython/tree/decorators-howto

Fred was very helpful with his insight :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15474>
_______________________________________

From report at bugs.python.org  Tue Jun  4 18:18:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 22:18:05 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559686685.4.0.853641510405.issue37134@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords:  -easy
title: [EASY] Use PEP570 syntax in the documentation -> Use PEP570 syntax in the documentation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 18:19:51 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 22:19:51 +0000
Subject: [issue37134] [EASY] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559686791.66.0.0591085607455.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> FWIW, there is precedent.  We have type annotations in the language but don't use them throughout the docs.

Although there is some distance between both cases, I think this is an extremely good point to take into account that I have not thought about.

> P.S. I hope you don't come to personally identify with this patch. I'm a big admirer of your work and am already promoting the feature to my 50,000+ twitter follows.  In this tracker issue, I hope for us a have a dispassionate, honest evaluation of what makes for the best documentation of the language.

Not at all :). I will be happy whatever solution we end agreeing to, knowing that we are going through a very thorough discussion. But thank you very much for stopping the discussion to check. I actually apologize if any of my responses have been more passionate than it should have been. I (really!) appreciate your words here and the fact that even if you disagree with this change and the cost of the feature regarding the advantages, you are making a lot of effort to explain the feature to users. Thank you very much for caring about the language, users and having a healthy and productive discussion.

----------
keywords: +easy
title: Use PEP570 syntax in the documentation -> [EASY] Use PEP570 syntax in the documentation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 18:20:06 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 04 Jun 2019 22:20:06 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559686806.16.0.297151646308.issue37134@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
title: [EASY] Use PEP570 syntax in the documentation -> Use PEP570 syntax in the documentation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 18:48:25 2019
From: report at bugs.python.org (Julien Palard)
Date: Tue, 04 Jun 2019 22:48:25 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559688505.22.0.668817709249.issue37134@roundup.psfhosted.org>


Julien Palard <julien+python at palard.fr> added the comment:

FWIW here's my feedback (as a Python teacher and doc guy):

I find that newcomers are good to ignore what they don't understand, so a newcomer exposed to "foo(a, b, /)" will no run away nor cry, he will just ignore the slash and understand that "foo takes two parameters, a and b" and be happy with it.

Then I think that for more advanced people it's nice to have it:

- It's a way to discover it's a valid syntax
- It's a usefull information to use
- It does not take a lot of space
- It's the truth (I mean, displaying "foo(a, b)" for "foo(a, b, /)" is a kind of a lie, I don't like it)

So I'm +1 for using PEP570 syntax in the documentation.

----------
nosy: +mdk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 19:10:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 04 Jun 2019 23:10:35 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559689835.34.0.906374215653.issue37134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Tim Peters: "I haven't looked at anything in this PR, so just popping in to confirm that the first time I saw stuff like: len(obj, /) in the docs I had no idea at all what it was trying to say.  I thought it was a typo. (...)"

Carol Willing: "I confess that I had a similar reaction as Tim when I saw functions with a trailing `/`."

I'm quite sure that many users have same reaction the first time they meet "@decorator", "*args", "def func(*, arg)", etc. PEP 570 introduces a syntax which was still illegal in Python 3.7, so it's normal to be surprised when we meet a new syntax.

In a few years, people will be used to that, but will be surprised by yet another new syntax ;-)

The best we can do is to enhance the documentation to properly document "/", directly in the reference documentation. Sphinx is a great help to add links. And we can maybe extend Sphinx to add even more inline hints.

--

The "/" character was discussed in length in the PEP 570. Many people complained... but nobody succeed to came up with a better syntax. The PEP has been accepted and its now part of the *Python language*.

As explained in length in the PEP 570, the "/" syntax is *not* new. For example, it is used for years in Python docstrings. Paul Ganssle also mentioned that this notation is "already used in the numpy documentation IIRC".

--

I don't think that we must hide some syntax like "*args" or "def func(*, arg)" from the doc, just because people learning Python might be surprised at the first read. I don't think that the reference documentation should be used to learn Python. They are way better resources than that to learn Python. Moreover, it's not really written like a tutorial. We have some https://docs.python.org/dev/howto/ for that.

>From my point of view, the *reference* documentation is more used by people who are already used to Python and so know the Python syntax. Trying to hide the real API in the *reference* documentation sounds weird (wrong) to me. The doc should document the real behavior. The PEP 570 makes is possible, whereas previously, the doc was lying.

If you consider that "len(obj, /)" is a typo, maybe we must fix len to accept obj as a keyword parameter? But they are good reasons why it's a positional only parameter. I don't think that anyone wants to change that. The current trend is more the opposite: convert some positional-or-keyword parameters to positional-only parameters, especially for functions taking a single parameter.

In short, I concur with Brett who wrote:

> Anyway, from my personal view, I think we should use the syntax. It's officially part of the language at this point and so avoiding it in the docs seems odd, like we're saying that we're ashamed of this syntax and you should pretend it doesn't exist when it does and it isn't going anywhere. Otherwise aren't we're forcing users to realize that the function definition in the docs deviates from what is definable in this one instance and that one has to read the full text to know that something is doable syntactically but we're leaving it out of the docs? It adds inconsistency in what the definition line means IMO based on how we have usually chosen to try and express things in that 'def' line in the docs as succinctly as possible to communicate the semantics of calling that function.

--

By the way, PR 13743 doesn't modify every single function of the documentation. Only a few files are modified, simply because only few functions accept positional-only parameters. My expectation is more that nobody will notice :-)

----------
keywords:  -easy
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Tue Jun  4 19:35:16 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Tue, 04 Jun 2019 23:35:16 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559691316.95.0.971863145911.issue37150@roundup.psfhosted.org>


Michele Angrisano <michele.angrisano at gmail.com> added the comment:

Yes, I meant that. Thanks! :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 19:50:25 2019
From: report at bugs.python.org (Demid)
Date: Tue, 04 Jun 2019 23:50:25 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559676438.99.0.552532886753.issue37150@roundup.psfhosted.org>
Message-ID: <j66cZmZYcb2DXA9iGBg5-gCEBUWn44yKjejj6lE4Wmx4OH-MoCdYhGqce50s_6g7oXut8b1rgcds1T7HLQvabc377TA4y1VVw_Iqt8TLK_E=@protonmail.com>


Demid <grrrr at protonmail.com> added the comment:

If you will run `python test.py hello.txt, where test.py is:

import argparse

parser = argparse.ArgumentParser()
parser.add_argument('echo', type=argparse.FileType)
args = parser.parse_args()
print(args.echo)

You will receive:
FileType('hello.txt')

I think that can be confusing for someone who will forget to invoke FileType constructor.

??????? Original Message ???????
On Tuesday, June 4, 2019 10:27 PM, Michele Angrisano <report at bugs.python.org> wrote:

>
>
> Michele Angrisanomichele.angrisano at gmail.com added the comment:
>
> Reading the examples in the doc, it's clear the behavior when FileType takes an argument. What's the behavior of FileType when is called without any argument?
>
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> nosy: +mangrisano
>
> Python tracker report at bugs.python.org
> https://bugs.python.org/issue37150

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 20:26:26 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 05 Jun 2019 00:26:26 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559694386.88.0.624845081827.issue35763@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
type: enhancement -> behavior
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 20:36:30 2019
From: report at bugs.python.org (Laurie Opperman)
Date: Wed, 05 Jun 2019 00:36:30 +0000
Subject: [issue36602] Recursive directory list with pathlib.Path.iterdir
In-Reply-To: <1554980374.32.0.410571505677.issue36602@roundup.psfhosted.org>
Message-ID: <1559694990.48.0.6223161019.issue36602@roundup.psfhosted.org>


Change by Laurie Opperman <laurie_opperman at hotmail.com>:


----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36602>
_______________________________________

From report at bugs.python.org  Tue Jun  4 20:37:10 2019
From: report at bugs.python.org (Josh Rosenberg)
Date: Wed, 05 Jun 2019 00:37:10 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559695030.66.0.680752208835.issue37150@roundup.psfhosted.org>


Josh Rosenberg <shadowranger+python at gmail.com> added the comment:

Ah, right. It doesn't actually validate the mode string (it just stores it for when open is called, assuming open will validate it). So yeah, it silently accepts any string, not just valid mode strings. Not a contractual guarantee or anything, just how FileType.__init__ is implemented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Tue Jun  4 20:54:41 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 05 Jun 2019 00:54:41 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559696081.56.0.338578171228.issue36839@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I'm sorry, I thought "fantasy" was good metaphor.
I just meant "the estimation seems too optimistic and rough. discussion should not based on it".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Tue Jun  4 21:30:53 2019
From: report at bugs.python.org (=?utf-8?b?VmVkcmFuIMSMYcSNacSH?=)
Date: Wed, 05 Jun 2019 01:30:53 +0000
Subject: [issue36827] Overriding __new__ method with itself changes behaviour
 of the class
In-Reply-To: <1557229328.38.0.306180402683.issue36827@roundup.psfhosted.org>
Message-ID: <1559698253.09.0.0774094806428.issue36827@roundup.psfhosted.org>


Vedran ?a?i? <vedgar at gmail.com> added the comment:

The point is, constructing via __new__ and initializing via __init__ are two mechanisms that aren't really orthogonal, and various heuristics are trying to guess whether the arguments you call your class with are meant for __new__ or for __init__. [Usually, immutable objects are __new__able, and mutable ones are __init__able -- and crucially, objects are usually not both. For example, list is __init__able, but tuple is __new__able.] Those heuristics assume you won't have both __init__ and __new__ implemented on your object. It mostly works if you have a hierarchy of __new__able objects, or a hierarchy of __init__able objects, but as you noticed, it usually breaks if you have an __init__able class derived from a __new__able one, or vice versa. If you're really trying for a most general solution, please note that __init__ is redundant: everything __init__ does can be done with __new__ (but not vice versa). So, you should just have a hierarchy of __new__able classes.

----------
nosy: +veky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36827>
_______________________________________

From report at bugs.python.org  Tue Jun  4 21:55:41 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 05 Jun 2019 01:55:41 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559699741.14.0.765729450519.issue35763@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 949fe976d5c62ae63ed505ecf729f815d0baccfc by Terry Jan Reedy in branch 'master':
 bpo-35763: Make IDLE calltip note about '/' less obtrusive (GH-13791)
https://github.com/python/cpython/commit/949fe976d5c62ae63ed505ecf729f815d0baccfc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 21:56:01 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 01:56:01 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559699761.41.0.432763016265.issue35763@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13709
pull_request: https://github.com/python/cpython/pull/13830

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 21:56:09 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 01:56:09 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559699769.73.0.478544891507.issue35763@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13710
pull_request: https://github.com/python/cpython/pull/13831

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 22:11:47 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 02:11:47 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559700707.93.0.73119107184.issue35763@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 39346ff60ac14bb83521c7e4f87304d0ad6478c2 by Miss Islington (bot) in branch '3.8':
bpo-35763: Make IDLE calltip note about '/' less obtrusive (GH-13791)
https://github.com/python/cpython/commit/39346ff60ac14bb83521c7e4f87304d0ad6478c2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 22:15:54 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 02:15:54 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559700954.18.0.523034995791.issue35763@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3d75bd15ac82575967db367c517d7e6e703a6de3 by Miss Islington (bot) in branch '3.7':
bpo-35763: Make IDLE calltip note about '/' less obtrusive (GH-13791)
https://github.com/python/cpython/commit/3d75bd15ac82575967db367c517d7e6e703a6de3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Tue Jun  4 22:37:44 2019
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 05 Jun 2019 02:37:44 +0000
Subject: [issue37089] `import Lib.os` works on windows (but shouldn't)
In-Reply-To: <1559163159.15.0.0136841146516.issue37089@roundup.psfhosted.org>
Message-ID: <1559702264.85.0.148348180632.issue37089@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

sys.prefix is usually argv0_path, but in a virtual environment argv0_path is set from "home" in pyvenv.cfg in order to find the standard library, and, if the site module is imported, sys.prefix is set to the virtual environment directory. Since for Windows site.getsitepackages() also includes sys.prefix, and since argv0_path and sys.prefix are different in this case, sys.path ends up with both of them. AFAIK, it needs neither of them.

Adding argv0_path to sys.path is a vestige of the NT installation scheme in the 1990s. The old scheme had a "Bin" directory that contained "python.exe" and I presume the Python DLL and standard-library extension modules. The old setup.py installer [1] had the following code to set the value of the "PythonPath" registry key:

    path = []
    pwd = nt.getcwd()
    for i in ["Bin",
          "Lib",
          "Lib\\win",
          "Lib\\tkinter",
          "Lib\\test",
          "Lib\\dos_8x3"]:
        i = pwd + "\\" + i
        path.append(i)
    sys.path[1:] = path
    pathvalue = strop.join(path, ";")
    #print "Setting PythonPath to", pathvalue
    win32api.RegSetValue(corehandle, "PythonPath", win32con.REG_SZ, pathvalue)

Note the presence of the "Bin" directory in the list.

Early NT releases used PC/getpath_nt.c [2], which was inconsistent with Modules/getpath.c in several ways. PC/getpathp.c was added in 1997. Early on, code was added to PC/getpathp.c to include the application directory in sys.path [3] in order to "make it work on NT". This was before it supported the registry "PythonPath" value that would have included the "Bin" directory.

[1] https://github.com/python/cpython/blob/8f1b6519803ffa7aef45beb58bda654533cb1fa8/PC/setup_nt/setup.py
[2] https://github.com/python/cpython/blob/8f1b6519803ffa7aef45beb58bda654533cb1fa8/PC/getpath_nt.c
[3] https://github.com/python/cpython/commit/8f1b6519803ffa7aef45beb58bda654533cb1fa8

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37089>
_______________________________________

From report at bugs.python.org  Wed Jun  5 00:01:19 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 05 Jun 2019 04:01:19 +0000
Subject: [issue35763] IDLE calltips: make positional note less obtrusive
In-Reply-To: <1547755288.11.0.42128686161.issue35763@roundup.psfhosted.org>
Message-ID: <1559707279.4.0.895517125935.issue35763@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35763>
_______________________________________

From report at bugs.python.org  Wed Jun  5 00:38:46 2019
From: report at bugs.python.org (Grant Jenks)
Date: Wed, 05 Jun 2019 04:38:46 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559709526.92.0.659971555285.issue37134@roundup.psfhosted.org>


Grant Jenks <grant.jenks at gmail.com> added the comment:

Pablo, I never intended disrespect toward you personally. And I am sorry my words came across that way. I would rather the feature be one of Python's more esoteric qualities.

I think Carol has described the most reasonable way forward. And in particular, I like this creative idea:

> A Sphinx extension may also be made to show a simple user-friendly view and with a click the fully accurate view.

I agree too with Raymond in this point:

> I don't think inclusion in 3.9 should be automatic.

As anecdata: I showed the PEP and feature to an intermediate class of 15 professional software engineers today. The first question I got was, "when should I use that in my Python code?" And I think the answer is rarely. We reviewed the motivating cases in the PEP and those made sense to them. But I was left feeling concern that if it were prominent and frequent in the docs then people will be likely to imitate, not least of which through simple copy/paste, what they see there without understanding the C-API and why it is that way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:02:24 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 05:02:24 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559710944.6.0.337423483032.issue37157@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

I'm attaching an initial PoC using FICLONE on Linux and clonefile(3) on OSX. It is also possible to support Windows but it requires a ReFS partition to test against which I currently don't have.  I opted for exposing reflink() as a separate function, mostly because:

- conceptually standard copy and CoW copy are 2 different things
- shutil already provides a distinction between copy functions (copy(), copy2(), copyfile()) which can be used as callbacks for copytree() and move(). As such one can follow the same approach and do:

   >>> copytree(src, dst, copy_function=reflink).

This initial patch provides a callback=None parameter in case the CoW operation fails because not supported by the underlying filesystems but this is debatable because we can get different errors depending on the platform (which is not good). As such a more generic ReflinkNotSupportedError exception is probably a better choice.

----------
keywords: +patch
Added file: https://bugs.python.org/file48390/cow.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:06:15 2019
From: report at bugs.python.org (Ma Lin)
Date: Wed, 05 Jun 2019 05:06:15 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1559711175.37.0.881605958892.issue21872@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

fix-bug.diff fixes this bug, I will submit a PR after thoroughly understanding the problem.

----------
keywords: +patch
Added file: https://bugs.python.org/file48391/fix-bug.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:07:05 2019
From: report at bugs.python.org (Tal Einat)
Date: Wed, 05 Jun 2019 05:07:05 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559711225.35.0.689442897751.issue36624@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Michael, your willingness to help, and the work on this issue and PR, are greatly appreciated!

Reading through the discussion here again, and the one referenced by Ned, I tend to agree with the point that having *yet another* spelling for OS checking is perhaps not a good idea.  The point that needing to see exactly which check is done in certain edge-cases is another good point against adding such new constants.  Moreover, regardless of my opinion, there isn't a consensus and at this point I don't think there will be.

Considering the above, perhaps it would be better to use only a single, "canonical" idiom throughout the tests, or at least from this point forward (to avoid a codebase-wide change)? Steve Dower said he would "prefer sys.platform to be canonical".

I do suffer from having all of os.name, sys.platform and platform.system() used in various places, and it not being clear when one should be used instead of another.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:24:04 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 05:24:04 +0000
Subject: [issue37158] Speed-up statistics.fmean()
Message-ID: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

fmean() can be sped-up by converting count() from a function to a generator and by using enumerate() to do the counting.

-- Baseline ---
$ ./python.exe -m timeit -r11 -s 'from statistics import fmean' -s 'data=list(map(float, range(1000)))' 'fmean(iter(data))'
2000 loops, best of 11: 108 usec per loop

-- Patched -- 
$ ./python.exe -m timeit -r11 -s 'from statistics import fmean' -s 'data=list(map(float, range(1000)))' 'fmean(iter(data))'
5000 loops, best of 11: 73.1 usec per loop

----------
assignee: steven.daprano
components: Library (Lib)
messages: 344670
nosy: rhettinger, steven.daprano
priority: normal
severity: normal
status: open
title: Speed-up statistics.fmean()
type: performance
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:24:51 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 05:24:51 +0000
Subject: [issue37159] Have shutil.copyfile() use copy_file_range()
Message-ID: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>


New submission from Giampaolo Rodola' <g.rodola at gmail.com>:

This is a follow up of issue33639 (zero-copy via sendfile()) and issue26828 (os.copy_file_range()). On [Linux 4.5 / glib 2.27] shutil.copyfile() will use os.copy_file_range() instead of os.sendfile(). According to my benchmarks performances are the same but when dealing with NFS copy_file_range() is supposed to attempt doing a server-side copy, meaning there will be no exchange of data between client and server, making the copy operation an order of magnitude faster.

Before proceeding unit-tests for big-file support should be added first (issue37096). We didn't hit the 3.8 deadline but I actually prefer to land this in 3.9 as I want to experiment with it a bit (copy_file_range() is quite new, issue26828 is still a WIP).

----------
components: Library (Lib)
files: patch.diff
keywords: patch
messages: 344671
nosy: giampaolo.rodola
priority: normal
severity: normal
status: open
title: Have shutil.copyfile() use copy_file_range()
type: performance
versions: Python 3.9
Added file: https://bugs.python.org/file48392/patch.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:26:14 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 05:26:14 +0000
Subject: [issue26826] Expose new copy_file_range() syscall in os module.
In-Reply-To: <1461325239.41.0.30054024313.issue26826@psf.upfronthosting.co.za>
Message-ID: <1559712374.9.0.782275497976.issue26826@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

> Please open a new issue to discuss how it can used in shutil ;-)

Use copy_file_range() in shutil.copyfile():
https://bugs.python.org/issue37159

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26826>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:26:32 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 05:26:32 +0000
Subject: [issue37159] Have shutil.copyfile() use copy_file_range()
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559712392.55.0.219674825103.issue37159@roundup.psfhosted.org>


Change by Giampaolo Rodola' <g.rodola at gmail.com>:


----------
nosy: +StyXman, desbma, facundobatista, martin.panter, ncoghlan, neologix, pablogsal, petr.viktorin, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:29:23 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 05:29:23 +0000
Subject: [issue37159] Use copy_file_range() in shutil.copyfile() (server-side
 copy)
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559712563.22.0.161327850707.issue37159@roundup.psfhosted.org>


Change by Giampaolo Rodola' <g.rodola at gmail.com>:


----------
title: Have shutil.copyfile() use copy_file_range() -> Use copy_file_range() in shutil.copyfile() (server-side copy)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:31:44 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 05:31:44 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559712704.13.0.133310269591.issue37158@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +13711
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13832

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:45:57 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 05:45:57 +0000
Subject: [issue36373] Deprecate explicit loop parameter in all public asyncio
 APIs
In-Reply-To: <1553025335.55.0.640410639085.issue36373@roundup.psfhosted.org>
Message-ID: <1559713557.76.0.815910367205.issue36373@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6d64a8f49eb321116f585c4b036c81bb976d2d5c by Miss Islington (bot) (Emmanuel Arias) in branch 'master':
bpo-36373:  Deprecate explicit loop parameter in all public asyncio APIs [streams] (GH-13671)
https://github.com/python/cpython/commit/6d64a8f49eb321116f585c4b036c81bb976d2d5c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36373>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:46:20 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 05:46:20 +0000
Subject: [issue36373] Deprecate explicit loop parameter in all public asyncio
 APIs
In-Reply-To: <1553025335.55.0.640410639085.issue36373@roundup.psfhosted.org>
Message-ID: <1559713580.22.0.384383072476.issue36373@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13712
pull_request: https://github.com/python/cpython/pull/13833

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36373>
_______________________________________

From report at bugs.python.org  Wed Jun  5 01:48:55 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 05 Jun 2019 05:48:55 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559713735.17.0.755194424702.issue34767@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13713
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13834

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 02:01:04 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 06:01:04 +0000
Subject: [issue36373] Deprecate explicit loop parameter in all public asyncio
 APIs
In-Reply-To: <1553025335.55.0.640410639085.issue36373@roundup.psfhosted.org>
Message-ID: <1559714464.77.0.960507449925.issue36373@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8899b11b95f08e2e03478f2acad336ad5933a2d1 by Miss Islington (bot) in branch '3.8':
bpo-36373:  Deprecate explicit loop parameter in all public asyncio APIs [streams] (GH-13671)
https://github.com/python/cpython/commit/8899b11b95f08e2e03478f2acad336ad5933a2d1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36373>
_______________________________________

From report at bugs.python.org  Wed Jun  5 02:09:16 2019
From: report at bugs.python.org (orlnub123)
Date: Wed, 05 Jun 2019 06:09:16 +0000
Subject: [issue36827] Overriding __new__ method with itself changes behaviour
 of the class
In-Reply-To: <1557229328.38.0.306180402683.issue36827@roundup.psfhosted.org>
Message-ID: <1559714956.91.0.681558422853.issue36827@roundup.psfhosted.org>


orlnub123 <orlnub123 at gmail.com> added the comment:

The comments in object's source explain the rationale behind this:

/* You may wonder why object.__new__() only complains about arguments
   when object.__init__() is not overridden, and vice versa.

   Consider the use cases:

   1. When neither is overridden, we want to hear complaints about
      excess (i.e., any) arguments, since their presence could
      indicate there's a bug.

   2. When defining an Immutable type, we are likely to override only
      __new__(), since __init__() is called too late to initialize an
      Immutable object.  Since __new__() defines the signature for the
      type, it would be a pain to have to override __init__() just to
      stop it from complaining about excess arguments.

   3. When defining a Mutable type, we are likely to override only
      __init__().  So here the converse reasoning applies: we don't
      want to have to override __new__() just to stop it from
      complaining.

   4. When __init__() is overridden, and the subclass __init__() calls
      object.__init__(), the latter should complain about excess
      arguments; ditto for __new__().

   Use cases 2 and 3 make it unattractive to unconditionally check for
   excess arguments.  The best solution that addresses all four use
   cases is as follows: __init__() complains about excess arguments
   unless __new__() is overridden and __init__() is not overridden
   (IOW, if __init__() is overridden or __new__() is not overridden);
   symmetrically, __new__() complains about excess arguments unless
   __init__() is overridden and __new__() is not overridden
   (IOW, if __new__() is overridden or __init__() is not overridden).

   However, for backwards compatibility, this breaks too much code.
   Therefore, in 2.6, we'll *warn* about excess arguments when both
   methods are overridden; for all other cases we'll use the above
   rules.

*/

----------
nosy: +orlnub123

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36827>
_______________________________________

From report at bugs.python.org  Wed Jun  5 02:14:37 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 05 Jun 2019 06:14:37 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1559715277.0.0.387562069343.issue36889@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Please keep it until new streams will be documented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Wed Jun  5 02:33:51 2019
From: report at bugs.python.org (Nathaniel Smith)
Date: Wed, 05 Jun 2019 06:33:51 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1559716431.43.0.172380615907.issue37120@roundup.psfhosted.org>


Nathaniel Smith <njs at pobox.com> added the comment:

> Regarding your comment on client_context.num_ticket getter: IMHO it's not a good idea to raise an exception on attribute access. It may break introspection.

Hmm, I see what you mean.

Basically my intuition is: it's a bit weird to make the attribute's existence "sort of" depend on whether it's a client or server context. It would make sense to me to have it entirely disappear on client contexts (from __dir__, read-access, and write-access), and it would make sense to me to have it always be present, just a no-op. But having it present, and almost the same as on server contexts, except that assigning to it fails... that feels a little weird.

----------
status: pending -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Wed Jun  5 02:44:27 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 06:44:27 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559717067.0.0.0978745635766.issue37134@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

You need to use the PEP 570 syntax if your function/method have a var-keyword parameter, takes arbitrary keyword arguments, and has other parameters beside the var-keyword parameter ("self" counts). And of course the minimal supported Python version should be 3.8.

In PR 13700 the PEP 570 syntax was added in the documentation of functions that use it in the code (like partial() and getcallargs()) and also in the examples of user code where it is needed (like LRU, Callback and Namespace).

PR 13743 adds it the documentation of functions which do not accept arbitrary keywords, but take some of arguments as positional only and others as positional or keyword. It may be surprising, so I think it is better to document this explicitly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 03:14:33 2019
From: report at bugs.python.org (David Carlier)
Date: Wed, 05 Jun 2019 07:14:33 +0000
Subject: [issue37160] thread native id netbsd support
Message-ID: <1559718873.81.0.214455069797.issue37160@roundup.psfhosted.org>


Change by David Carlier <dcarlier at afilias.info>:


----------
components: Interpreter Core
nosy: David Carlier
priority: normal
pull_requests: 13714
severity: normal
status: open
title: thread native id netbsd support
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun  5 03:29:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 07:29:41 +0000
Subject: [issue37159] Use copy_file_range() in shutil.copyfile() (server-side
 copy)
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559719781.8.0.449325522943.issue37159@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh, I already created https://bugs.python.org/issue37157

Can we move the discussion there?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 03:32:06 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 07:32:06 +0000
Subject: [issue37159] Use copy_file_range() in shutil.copyfile() (server-side
 copy)
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559719926.77.0.744003573309.issue37159@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

issue37157 is for reflink / CoW copy, this one is not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 03:39:45 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 07:39:45 +0000
Subject: [issue17576] PyNumber_Index() is not int-subclass friendly (or
 operator.index() docos lie)
In-Reply-To: <1364595911.19.0.826873230127.issue17576@psf.upfronthosting.co.za>
Message-ID: <1559720385.55.0.532067464244.issue17576@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Mark, I think you can reopen the PR and merge it in 3.9 now.

As for my proposition to use the FutureWarning first, I think it is not necessary. The behavior change is very subtle and will affects only int subclasses with overridden __index__. Similar changes (preferring __index__ over __int__) have been made in 3.8 without preceding FutureWarning. And similar minor changes were made in the past.

On other hand, I am not sure that __index__ should be used for int subclasses. We already have the int content, so we can create an exact int with _PyLong_Copy().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17576>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:24:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 08:24:31 +0000
Subject: [issue36894] test_multiprocessing_spawn regression on Windows
In-Reply-To: <1557680621.73.0.0423240629914.issue36894@roundup.psfhosted.org>
Message-ID: <1559723071.82.0.124194809565.issue36894@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I close the issue.

----------
nosy: +vstinner
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36894>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:27:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 08:27:39 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1559723259.29.0.675485704763.issue35537@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 3.8 beta 1 is released with this feature. I documented the change. Thnaks everybody who was involved to make this possible. I close the issue. Open new issues for follow-up.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:28:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 08:28:40 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559723320.11.0.16841623089.issue37138@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:32:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 08:32:19 +0000
Subject: [issue37098] test_memfd_create() test failure
In-Reply-To: <1559202482.0.0.225844714186.issue37098@roundup.psfhosted.org>
Message-ID: <1559723539.96.0.0608423748621.issue37098@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37098>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:33:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 08:33:13 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559723593.25.0.243468637795.issue26836@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It seems like this issue can now be closed, no?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:46:01 2019
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 05 Jun 2019 08:46:01 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559724361.1.0.125566181573.issue26836@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Yes, the feature is implemented and buildbots are green.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 04:58:01 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 05 Jun 2019 08:58:01 +0000
Subject: [issue34037] asyncio: BaseEventLoop.close() shutdowns the executor
 without waiting causing leak of dangling threads
In-Reply-To: <1530658646.63.0.56676864532.issue34037@psf.upfronthosting.co.za>
Message-ID: <1559725081.99.0.151400367792.issue34037@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I prefer postponing to think about it until all required 3.8 tasks are done :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34037>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:30:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 09:30:35 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1559727035.62.0.940653404219.issue37154@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The locales disappeared from this buildbot because of a recent glibc change and it's a glibc bug (it's being fixed).

https://bugzilla.redhat.com/show_bug.cgi?id=1716710

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:31:05 2019
From: report at bugs.python.org (daniel hahler)
Date: Wed, 05 Jun 2019 09:31:05 +0000
Subject: [issue37011] pdb: restore original tracing function instead of
 sys.settrace(None)
In-Reply-To: <1558529084.78.0.178705379805.issue37011@roundup.psfhosted.org>
Message-ID: <1559727065.78.0.982396519935.issue37011@roundup.psfhosted.org>


daniel hahler <python-bugs at thequod.de> added the comment:

Just for reference: I've just spent quite some time debugging missing coverage with pytest, and it turned out that part of it is because of this issue.  Most of the pdb related tests run in a subprocess (via pexpect), but not all of them.

I am using a wrapper now to restore this manually (https://github.com/pytest-dev/pytest/pull/5406).

Even though I was aware of this issue, it took me quite a while, mainly because this started out with slash related issues for Windows only, and I was debugging this on/via CI only at first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37011>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:32:12 2019
From: report at bugs.python.org (Florian Weimer)
Date: Wed, 05 Jun 2019 09:32:12 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1559727132.03.0.48020356907.issue37154@roundup.psfhosted.org>


Florian Weimer <fweimer at redhat.com> added the comment:

Just to be clear: glibc-all-langpacks normally contains the data from glibc-langpack-en, but a packaging bug caused removal of the /usr/lib/locale/locale-archive file during upgrades.  This only applies to upgrades.  New installations are fine.

Details here: https://bugzilla.redhat.com/show_bug.cgi?id=1716710

----------
nosy: +fweimer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:33:29 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 09:33:29 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559727209.85.0.89520126495.issue34767@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9aa78566fbeeb8cdaa669ad22f92cf63765f4135 by Miss Islington (bot) (Zackery Spytz) in branch 'master':
bpo-34767: Do not always create a collections.deque() in asyncio.Lock() (GH-13834)
https://github.com/python/cpython/commit/9aa78566fbeeb8cdaa669ad22f92cf63765f4135


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:33:51 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 09:33:51 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559727231.46.0.551833260941.issue34767@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13715
pull_request: https://github.com/python/cpython/pull/13837

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:38:25 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 05 Jun 2019 09:38:25 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559727505.23.0.205317852098.issue34767@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:46:58 2019
From: report at bugs.python.org (Dobatymo)
Date: Wed, 05 Jun 2019 09:46:58 +0000
Subject: [issue37005] bz2 module doesn't write end-of-stream marker
In-Reply-To: <1558496168.36.0.56962236665.issue37005@roundup.psfhosted.org>
Message-ID: <1559728018.26.0.71120494402.issue37005@roundup.psfhosted.org>


Change by Dobatymo <the-real-hazzard at outlook.com>:


----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37005>
_______________________________________

From report at bugs.python.org  Wed Jun  5 05:53:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 09:53:20 +0000
Subject: [issue37159] Use copy_file_range() in shutil.copyfile() (server-side
 copy)
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559728400.08.0.852534631504.issue37159@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> issue37157 is for reflink / CoW copy, this one is not.

Oh sorry, it seems like I misunderstood copy_file_range(). So it doesn't use/support CoW?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:00:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 10:00:25 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559728825.05.0.0727633791363.issue37157@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

cow.diff: I'm not sure that attempt to call unlink() if FICLONE fails is a good idea. unlink() can raise a new exception which can be confusing. IMHO it's up to the caller to deal with that. Said differently, I dislike the *fallback* parameter of reflink().

Why not exposing clonefile() as os.clonefile() but os._clonefile()?

+#if defined(MAC_OS_X_VERSION_10_12)
+#include <sys/clonefile.h>
+#define HAVE_CLONEFILE
+#endif

Is Python compiled to target macOS 10.12 and newer? Mac/BuildScript/build-installer.py contains:

# $MACOSX_DEPLOYMENT_TARGET -> minimum OS X level
DEPTARGET = '10.5'

But I don't know well macOS. "#if defined(MAC_OS_X_VERSION_10_12)" is a check at build time. Does it depend on DEPTARGET? Would it be possible to use a runtime check?

You might open a dedicated issue to expose clonefile() since it seems like every tiny detail of this issue is very subtle and should be properly discussed ;-) (I like the idea of exposing native functions like clonefile() directly in the os module!)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:04:13 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 10:04:13 +0000
Subject: [issue37159] Use copy_file_range() in shutil.copyfile() (server-side
 copy)
In-Reply-To: <1559712291.98.0.707685827942.issue37159@roundup.psfhosted.org>
Message-ID: <1559729053.9.0.676188238738.issue37159@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

Nope, it doesn't (see man page). We can simply use FICLONE (cp does the same).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37159>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:10:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 10:10:06 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559729406.28.0.429231954818.issue37157@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> This initial patch provides a callback=None parameter in case the CoW operation fails because not supported by the underlying filesystems but this is debatable because we can get different errors depending on the platform (which is not good). As such a more generic ReflinkNotSupportedError exception is probably a better choice.

(Oh, my laptop only uses btrfs. Hum, I created a loop device to test an ext4 partition :-))

On an ext4 partition, cp --reflink simply fails with an error: it doesn't fallback on a regular copy.

vstinner at apu$ dd if=/dev/urandom of=urandom bs=1k count=1k
1024+0 records in
1024+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123142 s, 85.2 MB/s

vstinner at apu$ cp --reflink urandom urandom2
'urandom' -> 'urandom2'
cp: failed to clone 'urandom2' from 'urandom': Operation not supported

vstinner at apu$ file urandom2
urandom2: empty
vstinner at apu$ stat urandom2
  File: urandom2
  Size: 0         	Blocks: 2          IO Block: 1024   regular empty file
Device: 700h/1792d	Inode: 13          Links: 1
Access: (0664/-rw-rw-r--)  Uid: ( 1000/vstinner)   Gid: ( 1000/vstinner)
Context: unconfined_u:object_r:unlabeled_t:s0
Access: 2019-06-05 12:08:23.000000000 +0200
Modify: 2019-06-05 12:08:23.000000000 +0200
Change: 2019-06-05 12:08:23.000000000 +0200
 Birth: -


Not only it fails, but it leaves an empty file.

I suggest to mimick the Linux cp command: don't automatically fallback (there are too many error conditions, too many risks of raising a new error while handling the previous error) and don't try to remove the created empty file if reflink() fails.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:17:50 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 10:17:50 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559729870.7.0.612199647077.issue34767@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 87a865ec15fa899a1f12be81f41a4c5e649a2833 by Miss Islington (bot) in branch '3.8':
bpo-34767: Do not always create a collections.deque() in asyncio.Lock() (GH-13834)
https://github.com/python/cpython/commit/87a865ec15fa899a1f12be81f41a4c5e649a2833


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:18:33 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 05 Jun 2019 10:18:33 +0000
Subject: [issue34767] Optimize asyncio.Lock
In-Reply-To: <1537545284.93.0.956365154283.issue34767@psf.upfronthosting.co.za>
Message-ID: <1559729913.18.0.192320635177.issue34767@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thanks, Zackery!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34767>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:19:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 10:19:25 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559729965.86.0.569763499176.issue26836@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13716
pull_request: https://github.com/python/cpython/pull/13838

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:22:17 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 10:22:17 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559730137.72.0.105038405171.issue37157@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

> I'm not sure that attempt to call unlink() if FICLONE fails is a good idea
Agreed.


> I dislike the *fallback* parameter of reflink().

Me too. A specific exception is better.


> Why not exposing clonefile() as os.clonefile() but os._clonefile()?

Mmm... I'm not sure it's worth it. The only reason one may want to use clonefile() directly is for passing CLONE_NOFOLLOW and CLONE_NOOWNERCOPY flags (the only possible ones):
 
- CLONE_NOFOLLOW can be exposed via "follow_symlinks=True" (like other shutil.* functions) and used internally
- CLONE_NOOWNERCOPY should also be passed internally by default because all other functions of shutil do not copy ownership (there's a warning at the top of the doc), so I think it makes sense for reflink() to do the same.
 

> +#if defined(MAC_OS_X_VERSION_10_12): Would it be possible to use a runtime check?

Good point. It should definitively be loaded at runtime. I will look into that (but not soon).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:23:41 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 10:23:41 +0000
Subject: [issue30835] AttributeError when parsing multipart email with invalid
 non-decodable Content-Transfer-Encoding
In-Reply-To: <1499089023.06.0.76757916564.issue30835@psf.upfronthosting.co.za>
Message-ID: <1559730221.78.0.520422289001.issue30835@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f62a372928fbf6a2ba722f12f069b75ca6ad16fb by Miss Islington (bot) in branch '3.7':
bpo-30835: email: Fix AttributeError when parsing invalid CTE (GH-13598)
https://github.com/python/cpython/commit/f62a372928fbf6a2ba722f12f069b75ca6ad16fb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30835>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:24:55 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 10:24:55 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559730295.68.0.447481341943.issue26836@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ccf0efbb21f6bbf6efd5f8cb560fed11079ce1a2 by Miss Islington (bot) (Victor Stinner) in branch 'master':
bpo-26836: Document os.memfd_create() name parameter (GH-13838)
https://github.com/python/cpython/commit/ccf0efbb21f6bbf6efd5f8cb560fed11079ce1a2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:25:22 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 10:25:22 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559730322.34.0.00772949155807.issue26836@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13717
pull_request: https://github.com/python/cpython/pull/13839

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:31:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 10:31:04 +0000
Subject: [issue37034] Argument Clinic omits name of keyword-only parameter on
 _PyArg_BadArgument() call
In-Reply-To: <1558693785.23.0.512986851321.issue37034@roundup.psfhosted.org>
Message-ID: <1559730664.6.0.285161539248.issue37034@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This is a bug. I intentionally committed the simpler code, but forgot to fix it later.

----------
type:  -> behavior
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37034>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:40:49 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Wed, 05 Jun 2019 10:40:49 +0000
Subject: [issue37161] Pre-populate user editable text in input()
Message-ID: <1559731249.86.0.916028878199.issue37161@roundup.psfhosted.org>


New submission from Steven D'Aprano <steve+python at pearwood.info>:

When asking for user input, it is often very helpful to be able to pre-populate the user's input string and allow them to edit it, rather than expecting them to re-type the input from scratch.

I propose that the input() built-in take a second optional argument, defaulting to the empty string. The first argument remains the prompt, the second argument is the initial value of the editable text.

Example use-case:

    pathname = "~/Documents/untitled.txt"
    pathname = input("Save the file as...? ", pathname)


On POSIX systems, this can be done with readline:


import readline
def myinput(prompt, initial=''):
    readline.set_startup_hook(lambda: readline.insert_text(initial))
    try:
        response = input(prompt)
    finally:
        readline.set_startup_hook(None)
    return response


but it requires readline (doesn't exist on Windows), and it clobbers any pre-existing startup hook the caller may have already installed.

----------
messages: 344701
nosy: steven.daprano
priority: normal
severity: normal
status: open
title: Pre-populate user editable text in input()
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37161>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:45:13 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Wed, 05 Jun 2019 10:45:13 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559731513.77.0.286993975828.issue37157@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

Adding a new patch (still a PoC, will create a PR when I have something more solid).

----------
Added file: https://bugs.python.org/file48393/cow2.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 06:55:09 2019
From: report at bugs.python.org (Matthias Klose)
Date: Wed, 05 Jun 2019 10:55:09 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
Message-ID: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>


New submission from Matthias Klose <doko at debian.org>:

compared to 3.8 alpha4, beta1's importlib has three new dependencies csv, email and zipfile.  Is this intended, or should the toplevel imports in importlib.metadata be moved into the functions where these are once used?

----------
components: Library (Lib)
messages: 344703
nosy: brett.cannon, doko, eric.snow, ncoghlan
priority: normal
severity: normal
status: open
title: new importlib dependencies csv, email and zipfile
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:13:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 11:13:04 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
Message-ID: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

>>> from dataclasses import *
>>> @dataclass
... class D:
...     obj: object
... 
>>> replace(D(123), obj='abc')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: replace() got multiple values for argument 'obj'

----------
components: Library (Lib)
messages: 344704
nosy: eric.smith, serhiy.storchaka
priority: normal
severity: normal
status: open
title: dataclasses.replace() fails with the field named "obj"
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:16:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 11:16:04 +0000
Subject: [issue26836] Add memfd_create to os module
In-Reply-To: <1461506163.13.0.0180353008827.issue26836@psf.upfronthosting.co.za>
Message-ID: <1559733364.05.0.673840646174.issue26836@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset b496c2672131ea51a55b5a414aeda271562f18d3 by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-26836: Document os.memfd_create() name parameter (GH-13838) (GH-13839)
https://github.com/python/cpython/commit/b496c2672131ea51a55b5a414aeda271562f18d3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26836>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:18:12 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 05 Jun 2019 11:18:12 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1559711225.35.0.689442897751.issue36624@roundup.psfhosted.org>
Message-ID: <c44ad6de-fb71-ab4e-f2ec-731c66d33131@felt.demon.nl>


Michael Felt <aixtools at felt.demon.nl> added the comment:

On 05/06/2019 07:07, Tal Einat wrote:
> Tal Einat <taleinat at gmail.com> added the comment:
>
> Michael, your willingness to help, and the work on this issue and PR, are greatly appreciated!
>
> Reading through the discussion here again, and the one referenced by Ned, I tend to agree with the point that having *yet another* spelling for OS checking is perhaps not a good idea.  The point that needing to see exactly which check is done in certain edge-cases is another good point against adding such new constants.  Moreover, regardless of my opinion, there isn't a consensus and at this point I don't think there will be.
>
> Considering the above, perhaps it would be better to use only a single, "canonical" idiom throughout the tests, or at least from this point forward (to avoid a codebase-wide change)? Steve Dower said he would "prefer sys.platform to be canonical".
>
> I do suffer from having all of os.name, sys.platform and platform.system() used in various places, and it not being clear when one should be used instead of another.

>From experience, for AIX, and I think also for windows, not sure about
darwin, oops - macos (or is that macOS) the confusion I faced was that
sys.platform returns the value the system was built on, not what it is
running on. If I was an application developer I would be more interested
in the platform it is running on. "Lucky me!" - starting with Python3.8
sys.platform will say "aix" rather than aixX. Likely there could have
been differences between aix3 and aix4 (e.g., the kernel changed from
"static" to "dynamic" driver extensions) that might have influenced
Python - but not since AIX5 - and AIX "binary compatibility" assurances
when using shared libraries (from IBM, e.g. libc).

More to the point - we all suffer - and some kind of direction is
needed. Beyond my pay grade - so I'll accept whatever is decided (even
if that is indecesion). As I said before - "lucky me", the core is
"resolved" for AIX (platform.system() == 'AIX', and sys.platform ==
'aix') - just as it is for "linux". This remains 'not resolved' for many
other platforms.

Further, imho - having it defined as a "constant" is not "yet another
spelling". Instead, it moves us towards a "canonical" idiom.

I have said before, and I'll say again - I am willing to do the manual
backport, learn more about git as I do so (;P) - and I'll even
"maintain" this, should this be any additional "help" is working towards
a canonical/uniform (or should I say PEP) to establish the RUNNING platform.

Regards,

Michael

> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue36624>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:20:18 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 05 Jun 2019 11:20:18 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559733618.53.0.133612225716.issue37162@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +barry, jaraco

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:21:59 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 05 Jun 2019 11:21:59 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1559733719.91.0.342346458088.issue37163@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Possibly a use for positional-only parameters. Backward compatibility is the question, of course.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:54:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 11:54:27 +0000
Subject: [issue37034] Argument Clinic omits name of keyword-only parameter on
 _PyArg_BadArgument() call
In-Reply-To: <1558693785.23.0.512986851321.issue37034@roundup.psfhosted.org>
Message-ID: <1559735667.22.0.691573568599.issue37034@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> This is a bug. I intentionally committed the simpler code, but forgot to fix it later.

I suggest to also apply the fix to 3.8 in that case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37034>
_______________________________________

From report at bugs.python.org  Wed Jun  5 07:58:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 11:58:37 +0000
Subject: [issue37157] shutil: add reflink=False to file copy functions to
 control clone/CoW copies (use copy_file_range)
In-Reply-To: <1559684200.61.0.18008315195.issue37157@roundup.psfhosted.org>
Message-ID: <1559735917.61.0.464346525501.issue37157@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I'm curious: is it possible to query the filesystem to check if a copied is copied using CoW? I guess that it's possible, it will be non portable. So I guess that it's better to avoid checking that in unit tests.

vstinner at apu$ dd if=/dev/urandom of=urandom bs=1k count=1k
1024+0 records in
1024+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309671 s, 33.9 MB/s
vstinner at apu$ cp --reflink urandom urandom2
'urandom' -> 'urandom2'

vstinner at apu$ stat urandom
  File: urandom
  Size: 1048576   	Blocks: 2048       IO Block: 4096   regular file
Device: 31h/49d	Inode: 16265363    Links: 1
Access: (0664/-rw-rw-r--)  Uid: ( 1000/vstinner)   Gid: ( 1000/vstinner)
Context: unconfined_u:object_r:user_home_t:s0
Access: 2019-06-05 13:56:21.381196972 +0200
Modify: 2019-06-05 13:56:21.412197007 +0200
Change: 2019-06-05 13:56:21.412197007 +0200
 Birth: 2019-06-05 13:56:21.381196972 +0200

vstinner at apu$ stat urandom2
  File: urandom2
  Size: 1048576   	Blocks: 2048       IO Block: 4096   regular file
Device: 31h/49d	Inode: 16265364    Links: 1
Access: (0664/-rw-rw-r--)  Uid: ( 1000/vstinner)   Gid: ( 1000/vstinner)
Context: unconfined_u:object_r:user_home_t:s0
Access: 2019-06-05 13:56:24.487200453 +0200
Modify: 2019-06-05 13:56:24.496200463 +0200
Change: 2019-06-05 13:56:24.496200463 +0200
 Birth: 2019-06-05 13:56:24.487200453 +0200

Using stat command line tool, I don't see anything obvious saying that the two files share the same data on disk.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37157>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:01:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:01:39 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559736099.26.0.615413044679.issue36624@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:05:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:05:25 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559736325.78.0.840350829652.issue33725@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13718
pull_request: https://github.com/python/cpython/pull/13841

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:05:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:05:53 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559736353.92.0.615417429694.issue33725@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Thanks Victor.  I don?t think ?reliable? is strong enough, since this will definitely lead to core dumps under certain conditions.  What about: (...)

That sounds better: I wrote PR 13841.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:07:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:07:33 +0000
Subject: [issue36935] bpo-35813 introduced usage of the deprecated
 PyErr_SetFromWindowsErrWithUnicodeFilename() function
In-Reply-To: <1557983600.93.0.891686339403.issue36935@roundup.psfhosted.org>
Message-ID: <1559736453.07.0.0886761881224.issue36935@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36935>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:08:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:08:54 +0000
Subject: [issue22117] Rewrite pytime.h to work on nanoseconds
In-Reply-To: <1406848093.52.0.5184372094.issue22117@psf.upfronthosting.co.za>
Message-ID: <1559736534.09.0.183930249899.issue22117@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

@Jeroen Demeyer: Both mentionned PRs are merged, so I understand that you found your answer. Commenting closed issues is not the most efficient way to get an answer ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22117>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:19:39 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 05 Jun 2019 12:19:39 +0000
Subject: [issue22117] Rewrite pytime.h to work on nanoseconds
In-Reply-To: <1406848093.52.0.5184372094.issue22117@psf.upfronthosting.co.za>
Message-ID: <1559737179.31.0.0277823142294.issue22117@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Commenting closed issues is not the most efficient way to get an answer ;-)

Serious question: why is that? I got an email from bugs.python.org with your comment, so why should commenting on closed issues be any worse than commenting on open issues? Especially if the people on the issue are still active core developers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22117>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:41:40 2019
From: report at bugs.python.org (Andrei Zene)
Date: Wed, 05 Jun 2019 12:41:40 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559738500.35.0.551074724581.issue28708@roundup.psfhosted.org>


Change by Andrei Zene <andrei.zene at outlook.com>:


----------
keywords: +patch
pull_requests: +13719
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13842

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:42:00 2019
From: report at bugs.python.org (Andrei Zene)
Date: Wed, 05 Jun 2019 12:42:00 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559738520.78.0.211268208271.issue28708@roundup.psfhosted.org>


Andrei Zene <andrei.zene at outlook.com> added the comment:

We would also need this limit to be raised. We are using a server that was implemented using tornado, and tornado uses select.select. 

> It looks like Modules/selectmodule.c already has the handling for when this gets large (and we really want to stop allocating the static array on the stack), which is a plus, but I'd want to see the performance cost to small selects if suddenly we're allocating 100s of KB on the heap rather than small and cheap stack allocations.

I gave this a try. The code I used for the server and the client for taken from this page: https://steelkiwi.com/blog/working-tcp-sockets/. I just added some code to measure the time it stays in the "select" call. To measure the time I used time.process_time(). I then connected/disconnected only 1 client 10.000 times in a row, discarding the measurements of the first 1000 iterations (warm-up).

Here are the results:
FD_SETSIZE = 16384 bytes
Time elapsed (avg ns):  20029.566224207087
Time elapsed (max ns):  15625000
Time elapsed (min ns):  0

FD_SETSIZE = 512 bytes
Time elapsed (avg ns):  14671.361502347418
Time elapsed (max ns):  15625000
Time elapsed (min ns):  0

> However, I see no reason why this couldn't be totally dynamic, at least on Windows. Redefining that value just changes a static array definition, but the array size never gets passed in to the OS AFAICT, so there's no reason we couldn't stack allocate for small select()s and heap allocate for big select()s. That's considerably more work than anyone had in mind, I'd wager.
I'm not sure this can be totally dynamic on Windows. The problem is the fd_set struct which is defined in Winsock2.h

typedef struct fd_set {
        u_int fd_count;               /* how many are SET? */
        SOCKET  fd_array[FD_SETSIZE];   /* an array of SOCKETs */
} fd_set;

The heap-allocated pylists are converted into fd_set structs which are always allocated on the stack btw. The problem is there's no way to create a fd_set of a desired FD_SETSIZE at runtime.

I have also submitted a PR with the change for convenience: https://github.com/python/cpython/pull/13842.

----------
nosy: +andzn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:42:33 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 12:42:33 +0000
Subject: [issue36675] Doctest directives and comments missing from code samples
In-Reply-To: <1555757030.56.0.8094269644.issue36675@roundup.psfhosted.org>
Message-ID: <1559738553.4.0.370627563313.issue36675@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

;tldr;   There is a global configuration flag to show all the doctest directives for all the docs that are built.  The default is to suppress the doctest directives.  If a global setting isn't desired, then each doctest example will have to be changed individually.


I've looked at the Sphinx documentation for this and there are a few points to reference. 

* `::` defines a Literal block in reST. [1]  A literal block doesn't do anything special except from the last paragraph is this section of the docs: 
   "Code highlighting can be enabled for these literal blocks on a document-wide basis using the `highlight` directive and on a project-wide basis using the `highlight_language` configuration option. The code-block directive can be used to set highlighting on a block-by-block basis. These directives are discussed later."  CPython has the `highlight-language` set to python3.  

* A doctest block does not need to be in a Literal Block. [2]  They are identified automatically. [3]  According to the doc, doctest directives are suppressed from presentation:

    Also, you can give inline doctest options, like in doctest:

    >>> datetime.date.now()   # doctest: +SKIP
    datetime.date(2008, 1, 1)

    They will be respected when the test is run, but stripped from presentation output.

* Any section (doesn't need the single colon (`:`) can have the `code-block` directive on it. [4]  The `code-block` directive can define the language for highlighting.  

Note that in the Sphinx doctest [4] documentation, there is a config option `trim_doctest_flags`, which is True by default.  Setting this to False will show all the doctest directives for all the doctests in the documentation.

The nice thing about the doc build recognizing a section as a doctest is that it adds the toggle in the upper right of the block to 'Hide the toggle and output' so that the example can be copy and pasted more easily.  Changing it into something other than a doctest (like using a `code-block` directive, takes away this option.  Using `trim_doctest_flags=False` retains the hide button.

Options:
1.  Change global setting to false to show all doctest directives.
2.  Change only the blocks where the doctest directives need to be shown, but this makes them lose the 'Hide prompt and output' button.
3.  Add a new option under 'code-block' to control the displaying of the doctest directives at the code-block level. This would override the global setting.  I think this option could be added locally, but may need to be done upstream in Sphinx.



[1] http://www.sphinx-doc.org/en/stable/usage/restructuredtext/basics.html#literal-blocks
[2] http://www.sphinx-doc.org/en/stable/usage/restructuredtext/basics.html#doctest-blocks
[3] http://www.sphinx-doc.org/en/stable/usage/extensions/doctest.html
[4] http://www.sphinx-doc.org/en/stable/usage/restructuredtext/directives.html#showing-code-examples

----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36675>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:44:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 12:44:38 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559738678.12.0.594760166342.issue28708@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Would it be possible to make FD_SETSIZE configurable at runtime, at least on Windows? IMHO it would be a better approach.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 08:53:53 2019
From: report at bugs.python.org (Andrei Zene)
Date: Wed, 05 Jun 2019 12:53:53 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559739233.13.0.969823738901.issue28708@roundup.psfhosted.org>


Andrei Zene <andrei.zene at outlook.com> added the comment:

> Would it be possible to make FD_SETSIZE configurable at runtime, at least on Windows? IMHO it would be a better approach.

That would be awesome, but it doesn't look like it would be possible. As I have already pointed out in my previous comment:

> I'm not sure this can be totally dynamic on Windows. The problem is the fd_set struct which is defined in Winsock2.h
>
> typedef struct fd_set {
>         u_int fd_count;               /* how many are SET? */
>         SOCKET  fd_array[FD_SETSIZE];   /* an array of SOCKETs */
> } fd_set;
>
> The heap-allocated pylists are converted into fd_set structs which are always allocated on the stack btw. The problem is there's no way to create a fd_set of a desired FD_SETSIZE at runtime.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:14:00 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 13:14:00 +0000
Subject: [issue22117] Rewrite pytime.h to work on nanoseconds
In-Reply-To: <1406848093.52.0.5184372094.issue22117@psf.upfronthosting.co.za>
Message-ID: <1559740440.32.0.223322065547.issue22117@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Because this reduces the number of people which can notice your comment. Active core developers receive too much messages. Currently I have 473 unread messages from b.p.o (out of 22425) and 299 unread messages from GitHub (out of 20476). And this is only for open and recently closed issues (messages for closed issues are manually moved to other folders). There are also separate folders for other projects, mailing lists, etc. It is not surprising if I miss some messages.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22117>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:18:48 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 05 Jun 2019 13:18:48 +0000
Subject: [issue22117] Rewrite pytime.h to work on nanoseconds
In-Reply-To: <1406848093.52.0.5184372094.issue22117@psf.upfronthosting.co.za>
Message-ID: <1559740728.47.0.848950875142.issue22117@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Right, but my question was very specifically about a test added for this issue. So asking it here first made sense to me. If nobody would reply, I could still ask somewhere else.

In the end, Petr solved the problem anyway, so the question is irrelevant now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22117>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:19:44 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 13:19:44 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559740784.84.0.097752741837.issue37149@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

This reference was hosted at a university called New Mexico Tech.  I've been trying to determine if this server is just offline or if it's being sunsetted.  Many google search results still point to infohost.mnt.edu or redirect to that page (not just the tkinter link).  Also, their main webpage (www.nmt.edu) also has a search that redirects results to infohost, so those links are all broken as well.

It seems to me that they just haven't stood up the new site yet or else they haven't changed their redirect, so I would assume that once they find they have broken links, they will fix this.  However, I also found an article that the creator of the tkinter docs has passed away [1].  If the infohost subdomain was his, then they might be moving all of it.

Anyway, I think we should leave the docs as they are for now with the hope they the university will fix the redirect.  If it doesn't get resolved, then we probably need to reach out to them.  Since the author is deceased, I'm not sure how it would work to try to host it somewhere else.  It would be a shame to lose this valuable reference and work.

[1] https://www.nmt.edu/news/2019/nmt_dedicates_shipman_plaque.php

----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:32:12 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 05 Jun 2019 13:32:12 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559741532.55.0.236745660472.issue28708@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I believe the number still can be configurable but requires more work.

The idea is:
FD_* macroses should be replaced with custom fd_set manipulation functions.
on select.select() call we can calculate the number of the highest used socket and use this number plus 1 as fd_set structure size.

Did not try to prototype it though.

----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:33:32 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 05 Jun 2019 13:33:32 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559741612.32.0.813817348938.issue36624@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

The reason I'd prefer sys.platform in most cases is because it's a compile-time constant, based on the one that includes/excludes APIs near completely, and most of our tests ought to be switching on these.

I personally don't see any need to switch on os.name, except perhaps in the tests for that module.

But if we start skipping tests based on platform(), then we will miss out on seeing new failures on new platforms. This is a real concern, as I have colleagues currently adding Windows on ARM and ARM64 support, and since the API is the same we expect everything to work. It doesn't, of course, but that's what specific exclusions are for.

If I were to propose a consistent scheme for this, I'd suggest:
* include tests based on sys.platform
* skip tests based on platform module

So if some functionality only exists when MS_WINDOWS was defined, we check sys.platform == win32. But if it doesn't work on ARM, we check platform.platform == (whatever the value is).

That way, adding new platforms will get the maximum amount of tests initially.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:38:07 2019
From: report at bugs.python.org (Ernest W. Durbin III)
Date: Wed, 05 Jun 2019 13:38:07 +0000
Subject: [issue2771] Test issue
In-Reply-To: <1210005645.74.0.283923986194.issue2771@psf.upfronthosting.co.za>
Message-ID: <1559741887.89.0.573334822641.issue2771@roundup.psfhosted.org>


Ernest W. Durbin III <ernest at python.org> added the comment:

test comment

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2771>
_______________________________________

From report at bugs.python.org  Wed Jun  5 09:47:43 2019
From: report at bugs.python.org (Ernest W. Durbin III)
Date: Wed, 05 Jun 2019 13:47:43 +0000
Subject: [issue2771] Test issue
In-Reply-To: <1210005645.74.0.283923986194.issue2771@psf.upfronthosting.co.za>
Message-ID: <1559742463.04.0.336254695384.issue2771@roundup.psfhosted.org>


Ernest W. Durbin III <ernest at python.org> added the comment:

test comment

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2771>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:09:46 2019
From: report at bugs.python.org (Demid)
Date: Wed, 05 Jun 2019 14:09:46 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559695030.66.0.680752208835.issue37150@roundup.psfhosted.org>
Message-ID: <im2xWEUBGivm7XpmeUuZLxkmy6M5iCLkyPV7kNhOJkWswA5XUgztrMfCFsk6PYl6X5pme7eHHTod5bctjW4kBVcPfa1DWJ03iaV1w2_Q2Jc=@protonmail.com>


Demid <grrrr at protonmail.com> added the comment:

What if I will add mode check in FileType.__init__?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:22:27 2019
From: report at bugs.python.org (Guilloux)
Date: Wed, 05 Jun 2019 14:22:27 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559744547.96.0.269773967492.issue37149@roundup.psfhosted.org>


Guilloux <bugs.python.org at guilloux-fr.net> added the comment:

I have read Cheryl Sabella's comment. So I have sent this e-mail :

Objet:	Request about a broken link on your website.
Date:	2019-06-05 16:20
De:	xavier at guilloux-fr.net
?:	thomas.guengerich at nmt.edu, webmaster at nmt.edu, help at nmt.edu


Hello,

For several days the link "https://infohost.nmt.edu/tcc/help/pubs/tkinter/web/index.html" has stopped working. But this link provided access to a prodigious technical documentation related to a Python language module (tkinter).

Can you put this link back in working order (or place a redirect to the new link)?

I draw your attention to the fact that this documentation contributes significantly to the international recognition of your university.

Thanks a lot for the continuation that you will give to this request.

Regards.

Xavier Guilloux.

(following is the same message but in my natural language - French -)

Bonjour,

Depuis plusieurs jours le lien "https://infohost.nmt.edu/tcc/help/pubs/tkinter/web/index.html" ne fonctionne plus. Or ce lien permettait d'acc?der ? une prodigieuse documentation technique en rapport avec un module du langage Python (tkinter).

Pouvez-vous remettre ce lien en ?tat de fonctionnement (ou placer une redirection vers le nouveau lien) ?

J'attire votre attention sur le fait que cette documentation contribue de mani?re importante ? la reconnaissance internationale de votre universit?.

Merci par avance pour la suite que vous donnerez ? cette requ?te.

Cordialement.

Xavier Guilloux.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:38:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 14:38:26 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559745506.25.0.0675570615713.issue35431@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:40:00 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 14:40:00 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559745600.83.0.648194948998.issue37158@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 6c01ebcc0dfc6be22950fabb46bdc10dcb6202c9 by Raymond Hettinger in branch 'master':
bpo-37158: Simplify and speed-up statistics.fmean() (GH-13832)
https://github.com/python/cpython/commit/6c01ebcc0dfc6be22950fabb46bdc10dcb6202c9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:40:07 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 14:40:07 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559745607.18.0.137241277801.issue37158@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13720
pull_request: https://github.com/python/cpython/pull/13843

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:41:10 2019
From: report at bugs.python.org (Guilloux)
Date: Wed, 05 Jun 2019 14:41:10 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559745670.65.0.646719479373.issue37149@roundup.psfhosted.org>


Guilloux <bugs.python.org at guilloux-fr.net> added the comment:

I have received the answer :

Objet:	Re: Request about a broken link on your website.
Date:	2019-06-05 16:39
De:	New Mexico Tech <help at nmt.edu>
?:	xavier at guilloux-fr.net
Cc:	thomas.guengerich at nmt.edu, webmaster at nmt.edu



Hello,
Unfortunately infohost.nmt.edu has been shut down and we will no longer be supporting that website. The website will not be coming back up. Sorry for the inconvenience.  

-Dorothy 

ITC-UC
NMIMT
Socorro, NM 87801
575-835-5700

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:43:36 2019
From: report at bugs.python.org (Jason R. Coombs)
Date: Wed, 05 Jun 2019 14:43:36 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559745816.2.0.963156587558.issue37162@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

I imagine that importlib.metadata isn?t imported at bootstrap time, only after the import infrastructure is ready. I think an early failure to import one of those dependencies is desirable. What is the reasoning behind deferring the imports and why does it apply to this module?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 10:51:24 2019
From: report at bugs.python.org (Dane Howard)
Date: Wed, 05 Jun 2019 14:51:24 +0000
Subject: [issue37164] dict creation with converted zip objects produces
 inconsistent behavior
Message-ID: <1559746284.31.0.288092384603.issue37164@roundup.psfhosted.org>


New submission from Dane Howard <dane.howard at rockwellcollins.com>:

confirmed on the following versions:
3.6.3 (Windows 10)
3.7.0 (Debian 9 & Windows 10)
3.7.1 (Debian 9)
a dictionary created with the dict() function will not always return the appropriate dictionary object. The following code produces the bug on all stated versions except 3.6.3/Win10, which exhibits slightly different behavior.

a = ['1','2','3']
b = [1,2,3]
c = zip(a,b)
print(dict(list(c))) #gives empty dict
print(dict(list(zip(a,b)))) #gives {'1':1,'2':2,'3':3}
d = zip(b,a)
print(dict(list(d))) #gives {1:'1',':'2',3:'3'}

----------
components: Windows
files: pybug.png
messages: 344729
nosy: Dane Howard, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: dict creation with converted zip objects produces inconsistent behavior
versions: Python 3.6, Python 3.7
Added file: https://bugs.python.org/file48394/pybug.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37164>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:00:03 2019
From: report at bugs.python.org (Paul Moore)
Date: Wed, 05 Jun 2019 15:00:03 +0000
Subject: [issue37164] dict creation with converted zip objects produces
 inconsistent behavior
In-Reply-To: <1559746284.31.0.288092384603.issue37164@roundup.psfhosted.org>
Message-ID: <1559746803.65.0.153127331257.issue37164@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

Works fine for me:

Python 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> a = ['1','2','3']
>>> b = [1,2,3]
>>> c = zip(a,b)
>>> print(dict(list(c)))
{'1': 1, '2': 2, '3': 3}
>>> print(dict(list(zip(a,b))))
{'1': 1, '2': 2, '3': 3}
>>> d = zip(b,a)
>>> print(dict(list(d)))
{1: '1', 2: '2', 3: '3'}

Are you sure you didn't try to use c twice? If you do, it will start up from where it left off (at the end) and so generate no further values:

>>> print(dict(list(c)))
{}

You need to remember that c is an iterator, and this is how iterators work. (If you're coming from Python 2, this is new behaviour in Python 3).

----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37164>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:14:14 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 05 Jun 2019 15:14:14 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559747654.12.0.656723706746.issue37162@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

at least for debian, the motivation is to provide a `pythonX.X-minimal` and a `pythonX.X` package -- the former ~mostly just contains the interpreter and the latter includes the stdlib

(I'm interested as well, hit this packaging 3.8 for deadsnakes)

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:16:22 2019
From: report at bugs.python.org (Dane Howard)
Date: Wed, 05 Jun 2019 15:16:22 +0000
Subject: [issue37164] dict creation with converted zip objects produces
 inconsistent behavior
In-Reply-To: <1559746284.31.0.288092384603.issue37164@roundup.psfhosted.org>
Message-ID: <1559747782.69.0.340861847468.issue37164@roundup.psfhosted.org>


Dane Howard <dane.howard at rockwellcollins.com> added the comment:

Yes, that seems to be it - in every case I was checking the value of c with `list(c)` and assuming that wouldn't change anything.

thanks!

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37164>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:18:26 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 15:18:26 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559747906.62.0.96667870413.issue37158@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 9ddb77741e041966d64739353393bcba33cc3bdd by Raymond Hettinger (Miss Islington (bot)) in branch '3.8':
bpo-37158: Simplify and speed-up statistics.fmean() (GH-13832) (GH-13843)
https://github.com/python/cpython/commit/9ddb77741e041966d64739353393bcba33cc3bdd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:22:38 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 15:22:38 +0000
Subject: [issue37116] Use PEP 570 syntax for positional-only parameters
In-Reply-To: <1559314061.29.0.391357031696.issue37116@roundup.psfhosted.org>
Message-ID: <1559748158.18.0.665646406696.issue37116@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 142566c028720934325f0b7fe28680afd046e00f by Serhiy Storchaka in branch 'master':
[3.9] bpo-37116: Use PEP 570 syntax for positional-only parameters. (GH-12620)
https://github.com/python/cpython/commit/142566c028720934325f0b7fe28680afd046e00f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37116>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:24:23 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 15:24:23 +0000
Subject: [issue37116] Use PEP 570 syntax for positional-only parameters
In-Reply-To: <1559314061.29.0.391357031696.issue37116@roundup.psfhosted.org>
Message-ID: <1559748263.1.0.11294253096.issue37116@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Separate issues should be open for remaining cases. For example issue37163 is open for dataclasses.replace().

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37116>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:36:16 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 05 Jun 2019 15:36:16 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559748976.01.0.362953378916.issue36974@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13721
pull_request: https://github.com/python/cpython/pull/13844

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:36:57 2019
From: report at bugs.python.org (carlo)
Date: Wed, 05 Jun 2019 15:36:57 +0000
Subject: [issue37152] Add AF_LOCAL alias for AF_UNIX
In-Reply-To: <1559660738.02.0.723341796578.issue37152@roundup.psfhosted.org>
Message-ID: <1559749017.67.0.489048926378.issue37152@roundup.psfhosted.org>


carlo <carlo.revelli at berkeley.edu> added the comment:

> I'm -1 to add the alias. It just adds to the confusion. It's also against the Zen of Python: "There should be one-- and preferably only one --obvious way to do it."

Agreed with the zen of python.

This is my first PR / issue, thanks for the fast reply.

You may close this issue )

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37152>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:39:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 15:39:04 +0000
Subject: [issue22117] Rewrite pytime.h to work on nanoseconds
In-Reply-To: <1406848093.52.0.5184372094.issue22117@psf.upfronthosting.co.za>
Message-ID: <1559749144.44.0.158258759286.issue22117@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Right, but my question was very specifically about a test added for this issue.

This issue is about nanoseconds. I looked again and I found the commit  https://hg.python.org/cpython/rev/b0b4c4d365b1 related to this issue.

So to reply to your question, honestly, I don't recall why I had to replace sleep() with gmtime(): all I know is written in the comment. But Python internals changed *a lot* since 2015...

My comment is more general: closed issues are hidden from bugs.python.org home page, so only people in the nosy list get a notification. The discussion is "hidden". Since issue is 4 years old, some people in the nosy list no longer contribute to Python.

Moreover, the bug tracker is usually not a good place to ask a question. I prefer to only use it to discuss bugs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22117>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:39:27 2019
From: report at bugs.python.org (Christian Heimes)
Date: Wed, 05 Jun 2019 15:39:27 +0000
Subject: [issue37152] Add AF_LOCAL alias for AF_UNIX
In-Reply-To: <1559660738.02.0.723341796578.issue37152@roundup.psfhosted.org>
Message-ID: <1559749167.63.0.399338120848.issue37152@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

You are welcome! :)

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37152>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:46:19 2019
From: report at bugs.python.org (Brian Skinn)
Date: Wed, 05 Jun 2019 15:46:19 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559749579.78.0.427145892824.issue37134@roundup.psfhosted.org>


Brian Skinn <bskinn at alum.mit.edu> added the comment:

First, for anyone interested, there are screenshots and links to docs versions at the SC GH issue (https://github.com/python/steering-council/issues/12#issuecomment-498856524, and following) where we're exploring what the tabbed approach to the PEP570 docs might look like.

Second, I'd like to suggest an additional aspect of the docs situation for consideration.

Regardless of which specific approach is decided upon here, it seems likely the consensus will be a course of action requiring touching the majority (entirety?) of the stdlib API docs. Currently, all of the API docs are manually curated in the .rst, at minimum for the reasons laid out by Victor in bpo25461 (https://bugs.python.org/issue25461#msg253381). If there's any chance that the balance of factors has changed such that using autodoc (or similar) *would* now be preferable, IWSTM that now is a good time to have that discussion, so that an autodoc conversion could be done at the same time as the PEP570 rework.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 11:56:42 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 15:56:42 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559750202.09.0.180501198054.issue37162@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I have not found zipfile here.

email is used for parsing METADATA and PKG-INFO. It replaces the rfc822 module.

cvs is used for parsing RECORD and SOURCES.txt. Actually using it for for parsing SOURCES.txt is improper as it might contain double quotes or backslashes (unlikely but possible).

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:01:35 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 05 Jun 2019 16:01:35 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1559750495.65.0.695454937456.issue37163@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I propose to add a deprecation warning in 3.8 and use the PEP 570 syntax in 3.9 (which means a TypeError if obj is passed by keyword argument).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:07:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 16:07:03 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559750823.83.0.956339657978.issue28708@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13722
pull_request: https://github.com/python/cpython/pull/13845

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:07:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 16:07:35 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559750855.79.0.339055475275.issue28708@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote a proof-of-concept: PR 13845.

... but now I'm confused. How does select() know the FD_SETSIZE? Is it hardcoded in select() ABI? Does this PR work? Or does it make no sense?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:17:07 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 16:17:07 +0000
Subject: [issue34222] Email message serialization enters an infinite loop when
 folding non-ASCII headers with long words
In-Reply-To: <1532523404.04.0.56676864532.issue34222@psf.upfronthosting.co.za>
Message-ID: <1559751427.35.0.311439606829.issue34222@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> [security] Infinite loop on folding email (_fold_as_ew()) if an header has no spaces

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34222>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:17:36 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 16:17:36 +0000
Subject: [issue34222] Email message serialization enters an infinite loop when
 folding non-ASCII headers with long words
In-Reply-To: <1532523404.04.0.56676864532.issue34222@psf.upfronthosting.co.za>
Message-ID: <1559751456.73.0.644117902282.issue34222@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

Thanks for the report, @maxking.

----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34222>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:21:33 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 05 Jun 2019 16:21:33 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559751693.85.0.187275917436.issue28708@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> How does select() know the FD_SETSIZE?

It doesn't have to. The actual number of descriptors is passed in, and the API presumably assumes that FD_SETSIZE is bigger than that (or else the caller would have crashed writing to invalid memory).

I don't see why we'd make it a parameter though. If we have all the descriptors, just allocate a big enough array and pass it in?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:35:23 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 05 Jun 2019 16:35:23 +0000
Subject: [issue37089] `import Lib.os` works on windows (but shouldn't)
In-Reply-To: <1559163159.15.0.0136841146516.issue37089@roundup.psfhosted.org>
Message-ID: <1559752523.36.0.0179540553957.issue37089@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

There are certainly people relying on sys.prefix being in sys.path (for .pth files and embedding), but probably not so many that we couldn't remove it in a major release. It is a bit strange in a venv, where there's typically nothing in the root of the environment (when we discovered this, we decided we could stop copying all the modules over, as they weren't being used anyway).

I think in every supported distribution we make though, there's no need for it. But we'd probably have to just remove it and see what breaks - most of the people relying on it probably have no idea, but they're also probably bundling it in some way that makes it easy to detect and fix.

All that said, I'm not particularly offended by this. It's namespace packages working as intended, and since it seems to be a highly complex interaction of configuration settings to get sys.prefix on sys.path in a variety of circumstances (we're not relying on registry settings here any more) I'd want to see changes and tests before assuming we can do it without regressing real scenarios.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37089>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:45:20 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Wed, 05 Jun 2019 16:45:20 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559753120.84.0.799594061968.issue37158@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Nice! On my computer, I get about 30% speed up. Thanks Raymond.

The two PRs are status "merged". Does this mean we can close this ticket or is there more to do? (The git workflow is still a mystery to me.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:49:57 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 16:49:57 +0000
Subject: [issue37158] Speed-up statistics.fmean()
In-Reply-To: <1559712244.32.0.839962107784.issue37158@roundup.psfhosted.org>
Message-ID: <1559753397.17.0.219174164466.issue37158@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I can close it now :-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37158>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:51:37 2019
From: report at bugs.python.org (hai shi)
Date: Wed, 05 Jun 2019 16:51:37 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1559753497.75.0.987184804675.issue18299@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

>it's a pain to extend the API (I don't want to use yet another __xxx custom keyword)
Adding __xxx in run_python_until_end function would increase the complexity but it looks like a unified function.

----------
nosy: +shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:55:07 2019
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 05 Jun 2019 16:55:07 +0000
Subject: [issue35551] Encoding and alias issues
In-Reply-To: <1545386892.27.0.788709270274.issue35551@psf.upfronthosting.co.za>
Message-ID: <1559753707.55.0.70332311614.issue35551@roundup.psfhosted.org>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

1. Background for "tactis":

https://github.com/python/cpython/commit/4fd73f0465ba11c22f0986d04cf91b387ed22c47

    # The codecs for these encodings are not distributed with the
    # Python core, but are included here for reference, since the
    # locale module relies on having these aliases available.

This codec was available as separate package at the time. Later the CJK codecs got added to the stdlib, but this codec was not.

I guess it's fine to remove the alias.

2. If the mappings are identical, just leaving one and making the other an alias is fine. Same for aliases of those mapping names.

3. I think we had already resolved this some time ago.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35551>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:56:38 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 05 Jun 2019 16:56:38 +0000
Subject: [issue21315] email._header_value_parser does not recognise in-line
 encoding changes
In-Reply-To: <1398009498.59.0.139606640186.issue21315@psf.upfronthosting.co.za>
Message-ID: <1559753798.66.0.528861465556.issue21315@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset 66c4f3f38b867d8329b28c032bb907fd1a2f22d2 by Barry Warsaw (Abhilash Raj) in branch 'master':
bpo-21315: Fix parsing of encoded words with missing leading ws. (#13425)
https://github.com/python/cpython/commit/66c4f3f38b867d8329b28c032bb907fd1a2f22d2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21315>
_______________________________________

From report at bugs.python.org  Wed Jun  5 12:56:45 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 16:56:45 +0000
Subject: [issue21315] email._header_value_parser does not recognise in-line
 encoding changes
In-Reply-To: <1398009498.59.0.139606640186.issue21315@psf.upfronthosting.co.za>
Message-ID: <1559753805.45.0.139310479752.issue21315@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13723
pull_request: https://github.com/python/cpython/pull/13846

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21315>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:11:49 2019
From: report at bugs.python.org (hai shi)
Date: Wed, 05 Jun 2019 17:11:49 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1559754709.18.0.614700368193.issue18299@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +13724
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13847

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:21:22 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 05 Jun 2019 17:21:22 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1559755282.47.0.971022585161.issue37163@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

+1 for Serhiy's suggestion

----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:26:01 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 05 Jun 2019 17:26:01 +0000
Subject: [issue36839] Support the buffer protocol in code objects
In-Reply-To: <1557258986.94.0.539165158195.issue36839@roundup.psfhosted.org>
Message-ID: <1559755561.51.0.78980068882.issue36839@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

"I'm sorry, I thought "fantasy" was good metaphor."

No problem! Saying something is "fantasy" like "it's based on fantasy" -- in North America at least -- is like saying "you're fooling yourself" or "you're delusional".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36839>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:35:47 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 05 Jun 2019 17:35:47 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559756147.05.0.127952475429.issue37134@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

To help short-circuit this discussion and focus on the desired solution, the steering council came to a decision that can be seen at https://github.com/python/steering-council/issues/12#issuecomment-498874939 :

- for Python 3.8 specifically, we think it makes sense to continue to leave the slashes out of the documentation for the all parameters are positional-only case (i.e. "... , /)") and the all parameters are positional-only & keyword-only case (i.e. "..., /, *, ..." and "..., /, *args, ..."). This question can then be revisited for Python 3.9.

- however, we actively want to see them added for the cases where an API has a mixture of positional-only and positional-or-keyword args (i.e. "..., /, ...")

- we'd like to see the rendered documentation for function signatures enhanced to use tooltips to name the positional-only (bare "/"), keyword-only (bare "*"), additional positional args (named "*"), and additional keyword args (named "**") notations (hyperlinking to a glossary entry could also be interesting, but may be too visually noisy based on how the hyperlinks get rendered)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:37:42 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 05 Jun 2019 17:37:42 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559756262.68.0.278042086032.issue37162@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

The imports are on purpose but they are not required for import to run, just like importlib.resources isn't necessary.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:58:03 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 17:58:03 +0000
Subject: [issue37068] Emit SyntaxWarning for f-strings without expressions ?
In-Reply-To: <1558984274.64.0.992654624102.issue37068@roundup.psfhosted.org>
Message-ID: <1559757483.78.0.86224703594.issue37068@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Adding my agreement that this is a feature, not a bug.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37068>
_______________________________________

From report at bugs.python.org  Wed Jun  5 13:58:31 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 05 Jun 2019 17:58:31 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559757511.7.0.131052510553.issue28708@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

>From my understanding Steve is right.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:03:10 2019
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 05 Jun 2019 18:03:10 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559757790.46.0.285854545002.issue28708@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> It doesn't have to. The actual number of descriptors is passed in, and 

To clarify, this is the fd_count in each fd_set, i.e. Winsock uses a counted SOCKET array instead of the bitmask that's found on other platforms. Winsock select() ignores nfds [1].

If Python's select module used a dynamic fd_set in Windows, this entails directly initializing fd_count and fd_array. The FD_SET macro can't be used since it's intended for the static definition and limited to FD_SETSIZE. FD_ZERO, FD_ISSET, and FD_CLR should still work.

[1] https://docs.microsoft.com/en-us/windows/desktop/api/winsock2/nf-winsock2-select

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:04:19 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Wed, 05 Jun 2019 18:04:19 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559757859.1.0.67652704984.issue28708@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

> The actual number of descriptors is passed in

Yes, but:

"""The nfds parameter is included only for compatibility with Berkeley sockets."""

... according to https://docs.microsoft.com/en-us/windows/desktop/api/Winsock2/nf-winsock2-select

So it's really FD_SETSIZE that matters, and it's a compile-time constant.

Note that Anaconda has been doing this for a long time:
https://github.com/AnacondaRecipes/python-feedstock/blob/master/recipe/0004-Win32-Change-FD_SETSIZE-from-512-to-2048.patch

----------
nosy:  -eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:04:26 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Wed, 05 Jun 2019 18:04:26 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559757866.93.0.835777164303.issue28708@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:45:07 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 18:45:07 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
Message-ID: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

This lets _count_elements use METH_FASTCALL.

----------
components: Library (Lib)
messages: 344759
nosy: rhettinger
priority: normal
severity: normal
status: open
type: performance
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:47:37 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 18:47:37 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
In-Reply-To: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>
Message-ID: <1559760457.73.0.292025709767.issue37165@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +13725
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13848

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Wed Jun  5 14:56:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 05 Jun 2019 18:56:16 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559760976.42.0.0760552179314.issue28708@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> So it's really FD_SETSIZE that matters, and it's a compile-time constant.

The only way this constant can matter is if the array has to end with an empty slot, which doesn't appear to be the case. The pre-compiled function can't tell how you compiled the code calling it, and the only place where FD_SETSIZE is used is in the macros to set them.

Dynamic allocation ought to be just fine, and likely faster for big arrays.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun  5 15:46:26 2019
From: report at bugs.python.org (Tim Hatch)
Date: Wed, 05 Jun 2019 19:46:26 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
Message-ID: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>


New submission from Tim Hatch <tim at timhatch.com>:

inspect.findsource() can trigger IndexError when co_firstlineno is larger than len(linecache.getlines()).

If you have a situation where the file that linecache finds doesn't match the imported module, then you're not guaranteed that co_firstlineno on the code objects makes any sense.  We hit this in a special kind of par file, but it could be triggered by shortening the file, like doing a git checkout of an older version while it's running.

a.py (3 lines):
    # line 1
    # line 2
    def foo(): pass  # co_firstlineno=3

a.py.v2 (1 line):
    def foo(): pass

repro:
    import a
    # modification happens, cp a.py.v2 a.py
    inspect.getsource(a.foo)


Although linecache.getline() does bounds checking, `inspect.findsource()` (which is used by various other functions, including `inspect.stack()`) grabs all the lines and loops through them.  The bug is in this section of `inspect.py`:

    if iscode(object):
        if not hasattr(object, 'co_firstlineno'):
            raise OSError('could not find function definition')
        lnum = object.co_firstlineno - 1
        pat = re.compile(r'^(\s*def\s)|(\s*async\s+def\s)|(.*(?<!\w)lambda(:|\s))|^(\s*@)')
        while lnum > 0:
            if pat.match(lines[lnum]): break
            lnum = lnum - 1
        return lines, lnum
    raise OSError('could not find code object')

Found through future.utils.raise_from which actually doesn't need to be using `inspect.stack()`, it can switch to `sys._getframe(2)` or so.  We should have a PR ready shortly, but wondering if this can be backported to at least 3.6?

----------
components: Library (Lib)
messages: 344761
nosy: lisroach, thatch, vstinner
priority: normal
severity: normal
status: open
title: inspect.findsource doesn't handle shortened files gracefully
versions: Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Wed Jun  5 15:46:40 2019
From: report at bugs.python.org (Tim Hatch)
Date: Wed, 05 Jun 2019 19:46:40 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1559764000.45.0.0725032137712.issue37166@roundup.psfhosted.org>


Change by Tim Hatch <tim at timhatch.com>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Wed Jun  5 15:59:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 19:59:58 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559764798.06.0.569348980992.issue33725@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 1e77ab0a35cf95318bb4893f7253a30f73201163 by Victor Stinner in branch 'master':
bpo-33725, multiprocessing doc: rephase warning against fork on macOS (GH-13841)
https://github.com/python/cpython/commit/1e77ab0a35cf95318bb4893f7253a30f73201163


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:01:23 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 20:01:23 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559764883.23.0.118092374148.issue33725@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13726
pull_request: https://github.com/python/cpython/pull/13849

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:07:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 20:07:09 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559765229.22.0.472944308929.issue37134@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:07:24 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 20:07:24 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1559765244.35.0.195461633281.issue33725@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d74438b633184bbd8d775d7118d6f12f6f825a96 by Miss Islington (bot) in branch '3.8':
bpo-33725, multiprocessing doc: rephase warning against fork on macOS (GH-13841)
https://github.com/python/cpython/commit/d74438b633184bbd8d775d7118d6f12f6f825a96


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:08:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 05 Jun 2019 20:08:36 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559765316.91.0.44989629455.issue37134@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:09:53 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 05 Jun 2019 20:09:53 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559765393.74.0.621211616904.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thank you very much, everyone, for sharing your comments, views and concerns and thanks to the steering council for helping to reach a conclusion. 

I have updated PR13743 to only modify the functions that fall into the second point of Brett's message as indicated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:16:45 2019
From: report at bugs.python.org (SilentGhost)
Date: Wed, 05 Jun 2019 20:16:45 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1559765805.83.0.0959606778233.issue37166@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

3.6 is in security-only mode, this doesn't look like a security issue to me

----------
nosy: +SilentGhost, yselivanov
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:24:31 2019
From: report at bugs.python.org (Carol Willing)
Date: Wed, 05 Jun 2019 20:24:31 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559766271.59.0.556327300481.issue37134@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:


New changeset 54edb04aa688c8247570b4f59b5145e3fa417576 by Carol Willing (Pablo Galindo) in branch 'master':
bpo-37134: Add PEP570 notation to the documentation (GH-13743)
https://github.com/python/cpython/commit/54edb04aa688c8247570b4f59b5145e3fa417576


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:30:03 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 05 Jun 2019 20:30:03 +0000
Subject: [issue37167] Cannot build Windows python_d.exe in master branch
Message-ID: <1559766603.61.0.264760022754.issue37167@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

In master, pcbuild/build -e -d (the 2nd run) gave the errors in build_errors.txt. Many or most were like

f:\dev\3x\externals\xz-5.2.2\src\liblzma\common\block_encoder.h(1): error C2018
: unknown character '0x2' [F:\dev\3x\PCbuild\liblzma.vcxproj]

>chkdsk found no problems.

A fix is high priority for me because my most recent 3.8.0a4 build in master, on 6/2, no longer imports tkinter.  Hence IDLE fails also.

>>> import tkinter
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "F:\dev\3x\lib\tkinter\__init__.py", line 36, in <module>
    import _tkinter # If this fails your Python may not be configured for Tk
ImportError: Module use of python39_d.dll conflicts with this version of Python.

Building python_d.exe for 3.8 and 3.7 had no problem.

----------
components: Build, Windows
files: build_errors.txt
messages: 344768
nosy: paul.moore, steve.dower, terry.reedy, tim.golden, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Cannot build Windows python_d.exe in master branch
type: compile error
versions: Python 3.9
Added file: https://bugs.python.org/file48395/build_errors.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37167>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:35:01 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Wed, 05 Jun 2019 20:35:01 +0000
Subject: [issue37129] Add RWF_APPEND flag
Message-ID: <1559766901.38.0.639806424761.issue37129@roundup.psfhosted.org>


Change by YoSTEALTH <ritesh at stealthcentral.com>:


----------
nosy: +YoSTEALTH

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37129>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:36:00 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 05 Jun 2019 20:36:00 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559766960.05.0.660954041528.issue37134@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
nosy:  -gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:47:25 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 05 Jun 2019 20:47:25 +0000
Subject: [issue37167] Cannot build Windows python_d.exe in master branch
In-Reply-To: <1559766603.61.0.264760022754.issue37167@roundup.psfhosted.org>
Message-ID: <1559767645.2.0.425348730073.issue37167@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I looked more carefully and all the errors were for files in the external xz-5.2.2 directory.  I deleted it to force a fresh download and a rebuild worked fine. Sorry for the noise.

----------
resolution:  -> not a bug
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37167>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:57:56 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Wed, 05 Jun 2019 20:57:56 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559768276.23.0.778816776197.issue37130@roundup.psfhosted.org>


N.P. Khelili <nophke at free.fr> added the comment:

The idea in my last post was quite bad,
setting name to None breaks a lot of functions
that expect name to be a string.

Path('.').parent and Path('..').parent both return '.'.

Even if it is not stupid (regarding them as special dirs
pointing to somewhere else but still being inside the directory).

I don't know why anyone would rely on such a behaviour...

The tests expect Path('..').stem() to be '..'
and expect Path('.').stem() to be ''

Once again, I don't know why anyone should rely on it but
I fear I can't do a lot without breaking this one part of the test.

I'm working on it and posting something by the end of the Week.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun  5 17:45:06 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 05 Jun 2019 21:45:06 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559771106.62.0.87592524915.issue37134@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

IIUC sum() should also have a slash in the middle.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 17:59:36 2019
From: report at bugs.python.org (Michael Bejda)
Date: Wed, 05 Jun 2019 21:59:36 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1559771976.34.0.196276946352.issue37166@roundup.psfhosted.org>


Change by Michael Bejda <mbejda at gmail.com>:


----------
keywords: +patch
pull_requests: +13727
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13850

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:05:21 2019
From: report at bugs.python.org (Phil Frost)
Date: Wed, 05 Jun 2019 22:05:21 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
Message-ID: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>


New submission from Phil Frost <phil.frost at postmates.com>:

We've observed instances of Decimal divisions being incorrect a few times per day in a web application serving millions of requests daily. I've been unable to reproduce the issue but have been investigating core dumps which suggest either some issue in the C Python implementation or its execution environment.

Python 2.7.15 on Alpine Linux Docker containers.

A slightly modified decimal.py is attached. It's been modified to check that the answer is approximately correct and dumps core if not. It also has a few local variables added to provide additional insight. I've annotated the file with values from the core dump and my reasoning about what should happen.

The crux of the problem is the loop at line 1389. There are 3 ways to determine how many times this loop executed:

1. the number of zeros removed from coeff
2. the number of times exp is incremented
3. the number of times division_counter is incremented

Oddly, #1 and #3 indicate the loop happened 27 times, while #2 indicates the loop happened 28 times.

One possible explanation (which makes about as much sense as any other) is that `exp += 1` sometimes adds 2 instead of 1. This means the loop happens 1 time fewer than it should, leaving `coeff` 10 times bigger than it should properly be. Or (very rarely) this happens twice and the result is 100 times bigger.

I find it very odd that something as basic as `+= 1` should not work, but at the moment it is the best explanation I have.

Unfortunately I can't share the core dump, as I've only been able to observe the issue in production so the core contains private information. But I'd welcome any ideas for further exploration. Or perhaps someone is aware of an existing bug that would explain this behavior.

----------
components: Interpreter Core
files: decimal.py
messages: 344772
nosy: Phil Frost
priority: normal
severity: normal
status: open
title: Decimal divisions sometimes 10x or 100x too large
versions: Python 2.7
Added file: https://bugs.python.org/file48396/decimal.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:13:21 2019
From: report at bugs.python.org (Zachary Ware)
Date: Wed, 05 Jun 2019 22:13:21 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559772801.14.0.503924823032.issue37168@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
nosy: +facundobatista, mark.dickinson, rhettinger, skrah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:18:14 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 22:18:14 +0000
Subject: [issue35551] Encoding and alias issues
In-Reply-To: <1545386892.27.0.788709270274.issue35551@psf.upfronthosting.co.za>
Message-ID: <1559773094.54.0.754959524403.issue35551@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:


New changeset c4c15ed7a2c7c2a1983e88b89c244d121eb3e512 by Cheryl Sabella (Ashwin Ramaswami) in branch 'master':
bpo-35551: encodings update (GH-11446)
https://github.com/python/cpython/commit/c4c15ed7a2c7c2a1983e88b89c244d121eb3e512


----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35551>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:20:09 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 05 Jun 2019 22:20:09 +0000
Subject: [issue35551] Encoding and alias issues
In-Reply-To: <1545386892.27.0.788709270274.issue35551@psf.upfronthosting.co.za>
Message-ID: <1559773209.37.0.870262636645.issue35551@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35551>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:36:25 2019
From: report at bugs.python.org (Phil Frost)
Date: Wed, 05 Jun 2019 22:36:25 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559774185.9.0.25903652602.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

I should note that while we do observe this issue with Decimal, my troubleshooting so far indicates the logic in decimal.py is fine. It seems instead the instructions in decimal.py aren't being correctly executed.

I'm not sure if the problem is limited to only Decimal, or if we just notice it there because it's correlated with financial code, which when encountering the bug, introduces an error which is eventually caught by the accounting department. There could very well be errors happening at least frequently elsewhere which simply go unnoticed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:54:47 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 05 Jun 2019 22:54:47 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559775287.41.0.332341074072.issue37134@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13728
pull_request: https://github.com/python/cpython/pull/13851

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:56:16 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Wed, 05 Jun 2019 22:56:16 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1559775376.06.0.0439714460756.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Only deleting from the local filesystem seems reasonable to me. In the context of a temporary directory tree, I don't see a semantic difference between "unmounting a mount point" and "removing a subdirectory entry" -- i.e. they both remove the offending subdirectory tree from the temporary directory tree.

Internally, tempfile.TemporaryDirectory() calls shutil.rmtree() with a custom error handler. The handler tries to reset the permissions on the offending entry and calls os.unlink(). If this throws an error, it recursively calls shutil.rmtree() on the offending entry (ignoring the temp directory entry itself). This seems like where a mounted directory tree would get deleted.

shutil.rmtree() follows the "rm -rf" semantics and refuses to delete a mount point. It seems reasonable to me to add special handling for mount points to the error handler in tempfile.TemporaryDirectory(). The high-level logic would be something like:

if os.path.ismount(path):
    try:
        unmount_func(path)
        _shutil.rmtree(path)
    except FileNotFoundError:
        pass

The tricky part is implementing unmount_func() in a portable manner since there is no such functionality currently implemented in the Python library.

Also, what would be the appropriate behavior when unmount_func() fails (e.g. for a permission error)? Right now, any exceptions other than IsADirectoryError, IsADirectoryError, and FileNotFoundError are passed on to the caller.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Wed Jun  5 18:59:10 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Wed, 05 Jun 2019 22:59:10 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1559775550.63.0.871340966461.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

(correcting typos)

What would be the appropriate behavior when unmount_func() fails (e.g. for a permission error)? Right now, any exceptions other than IsADirectoryError, PermissionError, and FileNotFoundError are passed on to the caller.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:02:40 2019
From: report at bugs.python.org (Stefan Krah)
Date: Wed, 05 Jun 2019 23:02:40 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559775760.83.0.498403283445.issue37168@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

Thank you for the detailed report. So, in an attempt to summarize,
this is the crucial passage:

>>> ideal_exp = -1
>>> exp = -29
>>> coeff = 150000000000000000000000000000
>>> division_counter = 0
>>> while exp < ideal_exp and coeff % 10 == 0:
...     coeff //= 10
...     exp += 1
...     division_counter += 1
... 
>>> coeff
15L
>>> exp
-1
>>> division_counter
28



But you sometimes get coeff==150 and division_counter==27 instead.
Is that correct?


The first thing to consider is whether Alpine Linux uses a patched
Python version or if you can reproduce this on Python 2.7.15 compiled
from source.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:05:31 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 05 Jun 2019 23:05:31 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
In-Reply-To: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>
Message-ID: <1559775931.66.0.459604886801.issue37165@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset e985804207473796a1326585b3e1b9e18c764345 by Raymond Hettinger in branch 'master':
bpo-37165: Convert _count_elements to the argument clinic (GH-13848)
https://github.com/python/cpython/commit/e985804207473796a1326585b3e1b9e18c764345


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:05:54 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 23:05:54 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
In-Reply-To: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>
Message-ID: <1559775954.69.0.698547366322.issue37165@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13729
pull_request: https://github.com/python/cpython/pull/13853

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:11:49 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 05 Jun 2019 23:11:49 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559776309.24.0.801922161845.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset c4c421d619baf2ff2f7e09f55b7ae22b8f863c7b by Pablo Galindo in branch 'master':
bpo-37134: Use PEP570 syntax for sum() (GH-13851)
https://github.com/python/cpython/commit/c4c421d619baf2ff2f7e09f55b7ae22b8f863c7b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:15:22 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 23:15:22 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559776522.19.0.647034523894.issue37134@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13730
pull_request: https://github.com/python/cpython/pull/13854

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:21:01 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 23:21:01 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
In-Reply-To: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>
Message-ID: <1559776861.04.0.688153720746.issue37165@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 21ce2454de57caaa532d11d76544632608f4b86b by Miss Islington (bot) in branch '3.8':
bpo-37165: Convert _count_elements to the argument clinic (GH-13848)
https://github.com/python/cpython/commit/21ce2454de57caaa532d11d76544632608f4b86b


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:21:11 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 05 Jun 2019 23:21:11 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559776871.23.0.301769751057.issue37134@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 23f41a64ea668296fa89e25f3cfa11f63026ecac by Miss Islington (bot) in branch '3.8':
bpo-37134: Use PEP570 syntax for sum() (GH-13851)
https://github.com/python/cpython/commit/23f41a64ea668296fa89e25f3cfa11f63026ecac


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:51:51 2019
From: report at bugs.python.org (Matej Cepl)
Date: Wed, 05 Jun 2019 23:51:51 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
Message-ID: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>


New submission from Matej Cepl <mcepl at cepl.eu>:

When building openSUSE package for Python-3.8.0b1 (on x86_64 build system with the latest openSUSE/Tumbleweed) in the package which previously worked all the way up to 3.8.0.a4, I get this test failing:

[ 5771s] ======================================================================
[ 5771s] FAIL: test_pyobject_is_freed_free (test.test_capi.PyMemMallocDebugTests)
[ 5771s] ----------------------------------------------------------------------
[ 5771s] Traceback (most recent call last):
[ 5771s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/test_capi.py", line 729, in test_pyobject_is_freed_free
[ 5771s]     self.check_pyobject_is_freed('pyobject_freed')
[ 5771s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/test_capi.py", line 720, in check_pyobject_is_freed
[ 5771s]     assert_python_ok('-c', code, PYTHONMALLOC=self.PYTHONMALLOC)
[ 5771s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py", line 157, in assert_python_ok
[ 5771s]     return _assert_python(True, *args, **env_vars)
[ 5771s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py", line 143, in _assert_python
[ 5771s]     res.fail(cmd_line)
[ 5771s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py", line 70, in fail
[ 5771s]     raise AssertionError("Process return code is %d\n"
[ 5771s] AssertionError: Process return code is 1
[ 5771s] command line: ['/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/python', '-X', 'faulthandler', '-c', '\nimport gc, os, sys, _testcapi\n# Disable the GC to avoid crash on GC collection\ngc.disable()\nobj = _testcapi.pyobject_freed()\nerror = (_testcapi.pyobject_is_freed(obj) == False)\n# Exit immediately to avoid a crash while deallocating\n# the invalid object\nos._exit(int(error))\n']
[ 5771s] 
[ 5771s] stdout:
[ 5771s] ---
[ 5771s] 
[ 5771s] ---
[ 5771s] 
[ 5771s] stderr:
[ 5771s] ---
[ 5771s] 
[ 5771s] ---
[ 5771s] 
[ 5771s] ----------------------------------------------------------------------

----------
components: Interpreter Core
messages: 344782
nosy: mcepl
priority: normal
severity: normal
status: open
title: test_pyobject_is_freed_free fails with 3.8.0beta1
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:52:30 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Wed, 05 Jun 2019 23:52:30 +0000
Subject: [issue35669] tar symlink
In-Reply-To: <1546765691.35.0.523415727187.issue35669@roundup.psfhosted.org>
Message-ID: <1559778750.03.0.465683999999.issue35669@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35669>
_______________________________________

From report at bugs.python.org  Wed Jun  5 19:57:24 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Wed, 05 Jun 2019 23:57:24 +0000
Subject: [issue33010] os.path.isdir() returns True for broken directory
 symlinks or junctions
In-Reply-To: <1520329654.61.0.467229070634.issue33010@psf.upfronthosting.co.za>
Message-ID: <1559779044.7.0.821468511203.issue33010@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33010>
_______________________________________

From report at bugs.python.org  Wed Jun  5 20:06:25 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 06 Jun 2019 00:06:25 +0000
Subject: [issue24231] os.makedirs('/', exist_ok=True) fails on Darwin
In-Reply-To: <1431969821.39.0.237201791785.issue24231@psf.upfronthosting.co.za>
Message-ID: <1559779585.03.0.953433903747.issue24231@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24231>
_______________________________________

From report at bugs.python.org  Wed Jun  5 16:09:45 2019
From: report at bugs.python.org (Aaron Meurer)
Date: Wed, 05 Jun 2019 20:09:45 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1559765385.64.0.571278581934.issue32912@roundup.psfhosted.org>


Aaron Meurer <asmeurer at gmail.com> added the comment:

I agree with Raymond that third party libraries are not ready for this. 

My biggest issue is that the way Python warns about this makes it very difficult for library authors to fix this. Most won't even notice. The problem is the warnings are only shown once, when the file is compiled. So if you run the code in any way that causes Python to compile it, a further run of 'python -Wd' will show nothing. I don't know if it's reasonable, but it would be nice if Python recompiled when given -Wd, or somehow saved the warning so it could be shown if that flag is given later.

As an anecdote, for SymPy's CI, we went through five (if I am counting correctly) iterations of trying to test this. Each of the first four were subtly incorrect, until we finally managed to find the correct one (for reference, 'python -We:invalid -m compileall -f -q module/').  So most library authors who will attempt to add tests against this will get it wrong. Simply adding -Wd as you would expect is wrong. If the code is already compiled (which it probably is, e.g., if you ran setup.py), it won't show the warnings. At the very least the "correct" way to test this should be documented. 

Things would probably be improved if the warnings were always shown, as at least then devs will see the error once (although most will probably be confused when the warning doesn't repeat).

Another problem is the information in the warnings. It seems the line number of the string is now shown, which is an improvement (https://bugs.python.org/issue28128). It would be nice if it showed the actual line and column number in the file of the invalid escape. This is especially annoying when an escape appears in a docstring. It just shows """ as the offending line. 

We have a lot of LaTeX in our docstrings in SymPy, so we had quite a few of these to fix. SymPy doesn't have invalid escapes anymore because I was proactive about it, but from what I've seen, most library authors haven't been.

By the way, this looks like a bug (python 3.8b1):

$ cat test.py

"""
a
\p
"""
$ python -We:invalid test.py
  File "test.py", line 2
    
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                ^
SyntaxError: invalid escape sequence \p
$

It might not be possible to see in what I pasted, but it filled my terminal with spaces.

----------
nosy: +asmeurer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Wed Jun  5 22:31:27 2019
From: report at bugs.python.org (Brian Skinn)
Date: Thu, 06 Jun 2019 02:31:27 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559788287.5.0.515673440062.issue37134@roundup.psfhosted.org>


Brian Skinn <bskinn at alum.mit.edu> added the comment:

Brett, to be clear, this sounds like the tabbed solution is not going to be used at this point? If so, I'll pull down the tabbed docs I'm hosting.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Wed Jun  5 23:14:56 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Thu, 06 Jun 2019 03:14:56 +0000
Subject: [issue32884] Adding the ability for getpass to print asterisks when
 passowrd is typed
In-Reply-To: <1519122533.37.0.467229070634.issue32884@psf.upfronthosting.co.za>
Message-ID: <1559790896.72.0.519682154379.issue32884@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

See also #36566. (Thanks Cheryl.)

I think the usability improvement for this far outweigh the decrease in security.

The days where somebody looking over your shoulder watching you type your password was the major threat are long gone. Hiding the length of the password against a shoulder-surfing adversary is so-1970s :-)

For old-school Unix types we ought to default to hiding the password. But I'm +1 in allowing developers to choose to trade off a tiny decrease in security against a major increase in usability.

The bottom line is that if you have a weak password, hiding the length won't save you; if you have a strong password, hiding the length doesn't add any appreciable difficulty to the attacker.

----------
nosy: +steven.daprano
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32884>
_______________________________________

From report at bugs.python.org  Wed Jun  5 23:26:25 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 06 Jun 2019 03:26:25 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1559791585.72.0.0854090884073.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Since tempfile.TemporaryDirectory() already returns some exceptions to the caller when it can't figure out how to delete a directory item, I don't see a problem with throwing PermissionError when encountering a mount point. This would preserve the 'rm -rf' semantics of the underlying shutil.rmtree() calls.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Wed Jun  5 23:35:55 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 06 Jun 2019 03:35:55 +0000
Subject: [issue35551] Encoding and alias issues
In-Reply-To: <1545386892.27.0.788709270274.issue35551@psf.upfronthosting.co.za>
Message-ID: <1559792155.0.0.0674789211425.issue35551@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13731
pull_request: https://github.com/python/cpython/pull/13856

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35551>
_______________________________________

From report at bugs.python.org  Thu Jun  6 00:14:01 2019
From: report at bugs.python.org (Matthias Klose)
Date: Thu, 06 Jun 2019 04:14:01 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559794441.75.0.72393747308.issue37162@roundup.psfhosted.org>


Matthias Klose <doko at debian.org> added the comment:

yes, that's for the minimal package.

zipfile is found in Lib/importlib/_bootstrap_external.py

Again, it's just a question here, having found an unmotivated distutils import before in one of the standard modules.

----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Thu Jun  6 00:58:09 2019
From: report at bugs.python.org (Tim Peters)
Date: Thu, 06 Jun 2019 04:58:09 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559797089.2.0.884659781596.issue37168@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Also basic:  run hardware CPU and memory stress diagnostics, and/or try running the same thing on a different machine.  Hardware isn't infallible, and can fail in nearly arbitrary ways.  For example, perhaps a smidgen of silicon has gone flaky, so that one time in a billion bit 0 "leaks" into bit 1 in a register.  That can effectively change the integer 1 to the integer 2.

Is that likely?  No.  But a loop doing mutually inconsistent things to the variables it's changing is impossible ;-)

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 01:39:04 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 06 Jun 2019 05:39:04 +0000
Subject: [issue35551] Encoding and alias issues
In-Reply-To: <1545386892.27.0.788709270274.issue35551@psf.upfronthosting.co.za>
Message-ID: <1559799544.33.0.141563062251.issue35551@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset cb65202520e7959196a2df8215692de155bf0cc8 by Inada Naoki in branch 'master':
bpo-35551: remove mac_centeuro encoding (GH-13856)
https://github.com/python/cpython/commit/cb65202520e7959196a2df8215692de155bf0cc8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35551>
_______________________________________

From report at bugs.python.org  Thu Jun  6 02:52:41 2019
From: report at bugs.python.org (Antti Haapala)
Date: Thu, 06 Jun 2019 06:52:41 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
Message-ID: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>


New submission from Antti Haapala <antti at haapala.name>:

Hi, while checking the longobject implementation for a Stack Overflow answer, I noticed that the functions `_PyLong_AsUnsignedLongLongMask` and `PyLong_AsUnsignedLongLongMask` erroneously return `(unsigned long)-1` on error when bad internal call is thrown.

First case: https://github.com/python/cpython/blob/cb65202520e7959196a2df8215692de155bf0cc8/Objects/longobject.c#L1379

static unsigned long long
_PyLong_AsUnsignedLongLongMask(PyObject *vv)
{
    PyLongObject *v;
    unsigned long long x;
    Py_ssize_t i;
    int sign;

    if (vv == NULL || !PyLong_Check(vv)) {
        PyErr_BadInternalCall();
        return (unsigned long) -1; <<<<
    }

Second case: https://github.com/python/cpython/blob/cb65202520e7959196a2df8215692de155bf0cc8/Objects/longobject.c#L1407

They seem to have been incorrect for quite some time, the other one blames back to the SVN era. The bug seems to be in 2.7 alike: https://github.com/python/cpython/blob/20093b3adf6b06930fe994527670dfb3aee40cc7/Objects/longobject.c#L1025

The correct return value should of course be `(unsigned long long)-1`

----------
components: Interpreter Core
messages: 344789
nosy: ztane
priority: normal
severity: normal
status: open
title: Wrong return value from PyLong_AsUnsignedLongLongMask on PyErr_BadInternalCall
type: behavior
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 02:54:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 06:54:48 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559804088.48.0.772535483982.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

-1 is documented: https://docs.python.org/dev/c-api/long.html#c.PyLong_AsUnsignedLongLongMask

It's not a bug but a deliberate behavior. See also the general behavior described at:
https://docs.python.org/dev/c-api/long.html#integer-objects

----------
nosy: +vstinner
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 02:56:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 06:56:05 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559804165.74.0.801128329185.issue37168@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 03:19:18 2019
From: report at bugs.python.org (Antti Haapala)
Date: Thu, 06 Jun 2019 07:19:18 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559805558.03.0.913137767612.issue37170@roundup.psfhosted.org>


Antti Haapala <antti at haapala.name> added the comment:

Victor, as a friendly reminder, (unsigned long)-1 is not necessarily the same number as (unsigned long long)-1. The documentation means the latter.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 03:56:55 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 07:56:55 +0000
Subject: [issue37075] Error message improvement for AsyncMock
In-Reply-To: <1559037010.51.0.223468847551.issue37075@roundup.psfhosted.org>
Message-ID: <1559807815.55.0.269301372062.issue37075@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37075>
_______________________________________

From report at bugs.python.org  Thu Jun  6 04:22:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 08:22:19 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1559809339.41.0.644212408649.issue36763@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13732
pull_request: https://github.com/python/cpython/pull/13857

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun  6 04:30:19 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 08:30:19 +0000
Subject: [issue36848] autospec fails with AttributeError when mocked class has
 __signature__ non-writeable
In-Reply-To: <1557298633.85.0.260410761482.issue36848@roundup.psfhosted.org>
Message-ID: <1559809819.25.0.901314756589.issue36848@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

The jira issue in pyside2 is closed as fixed. I am closing this as third party.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36848>
_______________________________________

From report at bugs.python.org  Thu Jun  6 04:39:46 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 08:39:46 +0000
Subject: [issue35022] MagicMock should support `__fspath__`
In-Reply-To: <1539908991.05.0.788709270274.issue35022@psf.upfronthosting.co.za>
Message-ID: <1559810386.89.0.327394532193.issue35022@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Closing this as resolved since this is merged for 3.8. Thank you all.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35022>
_______________________________________

From report at bugs.python.org  Thu Jun  6 04:45:14 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 08:45:14 +0000
Subject: [issue32644] unittest.mock.call len() error
In-Reply-To: <1516776758.4.0.467229070634.issue32644@psf.upfronthosting.co.za>
Message-ID: <1559810714.58.0.68717092837.issue32644@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

call objects inherit from tuple and here the reported argument is a dict with 3 items returning len of 3. I am closing this as part of triaging since there is no additional information from @snakevil on reproducing this. Feel free to reopen this if there is more information on reproducing the issue.

./python.exe
Python 3.9.0a0 (heads/master:cb65202520, Jun  6 2019, 11:15:04)
[Clang 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from unittest.mock import call
>>> c = call('solution', 'foo', {'__spots__': {}, '__event__': None, '__solution__': None})
>>> len(c.args[2])
3
>>> len(c)
3
>>> c.args
('solution', 'foo', {'__spots__': {}, '__event__': None, '__solution__': None})
>>> c.kwargs
{}

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32644>
_______________________________________

From report at bugs.python.org  Thu Jun  6 04:47:03 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 08:47:03 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559810823.9.0.491055975748.issue37169@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 05:05:13 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 09:05:13 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1559811913.01.0.19945429216.issue36974@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13733
pull_request: https://github.com/python/cpython/pull/13858

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Thu Jun  6 05:52:06 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 06 Jun 2019 09:52:06 +0000
Subject: [issue37171] Documentation mismatch contextvars module vs PEP-567
Message-ID: <1559814726.03.0.917763473922.issue37171@roundup.psfhosted.org>


New submission from Dima Tisnek <dimaqq at gmail.com>:

PEP-567 states that user "must call Context.run()" while 

`contextvars` docs don't mention `.run()`

`contextvars.Context().run(arg)` exists, but there's no documentation, for example what the required argument is.

----------
components: asyncio
messages: 344795
nosy: Dima.Tisnek, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Documentation mismatch contextvars module vs PEP-567
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37171>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:04:00 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 06 Jun 2019 10:04:00 +0000
Subject: [issue37171] Documentation mismatch contextvars module vs PEP-567
In-Reply-To: <1559814726.03.0.917763473922.issue37171@roundup.psfhosted.org>
Message-ID: <1559815440.59.0.382909779123.issue37171@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Is this different from the docs at https://docs.python.org/3/library/contextvars.html#contextvars.Context.run?

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37171>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:13:13 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 10:13:13 +0000
Subject: [issue2661] Mapping tests cannot be passed by user implementations
In-Reply-To: <1208642973.7.0.825847798287.issue2661@psf.upfronthosting.co.za>
Message-ID: <1559815993.72.0.856789672896.issue2661@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6af230359e57122708247dac970e05e05529cde6 by Miss Islington (bot) (Walter D?rwald) in branch 'master':
bpo-2661: Make mapping tests better usable for custom mapping classes. (GH-11157)
https://github.com/python/cpython/commit/6af230359e57122708247dac970e05e05529cde6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2661>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:14:31 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Thu, 06 Jun 2019 10:14:31 +0000
Subject: [issue2661] Mapping tests cannot be passed by user implementations
In-Reply-To: <1208642973.7.0.825847798287.issue2661@psf.upfronthosting.co.za>
Message-ID: <1559816071.46.0.308970269005.issue2661@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue2661>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:16:48 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 06 Jun 2019 10:16:48 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559816208.59.0.555832720462.issue37170@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +13734
pull_request: https://github.com/python/cpython/pull/13860

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:29:59 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 06 Jun 2019 10:29:59 +0000
Subject: [issue37172] Odd error awating a Future
Message-ID: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>


New submission from Dima Tisnek <dimaqq at gmail.com>:

Let's start with correct code:


import asyncio


async def writer():
    await asyncio.sleep(1)
    g1.set_result(41)

async def reader():
    await g1

async def test():
    global g1
    g1 = asyncio.Future()
    await asyncio.gather(reader(), writer())

asyncio.run(test())


No error, as expected.

Now let's mess it up a bit:


import asyncio

g1 = asyncio.Future()


async def writer():
    await asyncio.sleep(1)
    g1.set_result(41)

async def reader():
    await g1

async def test():
    await asyncio.gather(reader(), writer())

asyncio.run(test())


Fails with RuntimeError ... attached to a different loop

The error makes sense, although it's sad that I can't create global futures / there was no even loop when Future was creates, it was not a *different* event loop / maybe I wish .run() didn't force a new event loop?

A nit (IMO), but I can live with it.

Let's mess the code up a bit more:


import asyncio

g1 = asyncio.Future()


async def writer():
    await asyncio.sleep(1)
    g1.set_result(41)

async def reader():
    await g1

async def test():
    await asyncio.gather(reader(), reader(), writer())

asyncio.run(test())


RuntimeError: await wasn't used with future

What?
That's really confusing!
The only difference is that there are now 2 readers running in parallel.

The actual exception comes from asyncio.Future.__await__ after a yield.
I'm not sure how to fix this...

----------
components: asyncio
messages: 344798
nosy: Dima.Tisnek, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Odd error awating a Future
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:39:08 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 10:39:08 +0000
Subject: [issue35082] Mock.__dir__ lists deleted attributes
In-Reply-To: <1540637110.3.0.788709270274.issue35082@psf.upfronthosting.co.za>
Message-ID: <1559817548.83.0.354698380556.issue35082@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13735
pull_request: https://github.com/python/cpython/pull/13859

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35082>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:40:24 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 06 Jun 2019 10:40:24 +0000
Subject: [issue35082] Mock.__dir__ lists deleted attributes
In-Reply-To: <1540637110.3.0.788709270274.issue35082@psf.upfronthosting.co.za>
Message-ID: <1559817624.93.0.64308049267.issue35082@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35082>
_______________________________________

From report at bugs.python.org  Thu Jun  6 06:40:30 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 06 Jun 2019 10:40:30 +0000
Subject: [issue35082] Mock.__dir__ lists deleted attributes
In-Reply-To: <1540637110.3.0.788709270274.issue35082@psf.upfronthosting.co.za>
Message-ID: <1559817630.59.0.684348222423.issue35082@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35082>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:08:14 2019
From: report at bugs.python.org (flying sheep)
Date: Thu, 06 Jun 2019 11:08:14 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
Message-ID: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>


New submission from flying sheep <flying-sheep at web.de>:

Currently, inspect.getfile(str) will report nonsense:

>>> inspect.getfile(str)
TypeError: <module 'builtins' (built-in)> is a built-in class

----------
components: Library (Lib)
messages: 344799
nosy: flying sheep
priority: normal
severity: normal
status: open
title: inspect.getfile error names module instead of passed class
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:08:35 2019
From: report at bugs.python.org (flying sheep)
Date: Thu, 06 Jun 2019 11:08:35 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559819315.31.0.582383358822.issue37173@roundup.psfhosted.org>


Change by flying sheep <flying-sheep at web.de>:


----------
keywords: +patch
pull_requests: +13736
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13861

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:10:52 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 06 Jun 2019 11:10:52 +0000
Subject: [issue37172] Odd error awating a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1559819452.43.0.437529408683.issue37172@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Global future objects (and global asyncio objects in general) don't work with asyncio.run(). The lifecycle of these objects should be closer than loop but asyncio.run() creates a loop during execution.

I think this is a good design, we have a plan to deprecate and eventually drop all old-times mess that allows confusions.

All three of your problems are because you use a global future which is implicitly attached to the different loop.

Also I'd like to note that futures are low-level API, which is very delicate and error-prone. Futures are crucial for libraries building (e.g. aiohttp uses them a lot) but working with futures in application code is an explicit sign of bad design.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:34:15 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 06 Jun 2019 11:34:15 +0000
Subject: [issue37102] Automatically dedent docstring constants by default
In-Reply-To: <1559239200.57.0.0816589870282.issue37102@roundup.psfhosted.org>
Message-ID: <1559820855.23.0.00632712682367.issue37102@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

How about do `inspect.cleandoc()` instead of just a dedent?
Some method has docstring like this:

    """First line

    blah blah blah blah

        example code here
    ...
    """

In such docstring, dedent can not strip indent well.

There is existing attempt (in Japanese):

https://qiita.com/hhatto/items/3da6c6820817395f2c39#%E6%84%9A%E7%9B%B4%E3%81%AB%E5%AE%9F%E8%A3%85%E3%81%97%E3%81%9F%E3%82%B3%E3%83%BC%E3%83%89

----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37102>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:43:08 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 06 Jun 2019 11:43:08 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559821388.4.0.246804305076.issue37170@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

As ztane says, the issue isn't the -1, it's the type of the cast. This looks like a legitimate issue to me.

----------
nosy: +eric.smith
resolution: not a bug -> 
stage: resolved -> patch review
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 07:57:57 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 06 Jun 2019 11:57:57 +0000
Subject: [issue37171] Documentation mismatch contextvars module vs PEP-567
In-Reply-To: <1559814726.03.0.917763473922.issue37171@roundup.psfhosted.org>
Message-ID: <1559822277.74.0.832515663221.issue37171@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

It seems I have been blind. I'll close this.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37171>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:06:26 2019
From: report at bugs.python.org (Maximilian Ernestus)
Date: Thu, 06 Jun 2019 12:06:26 +0000
Subject: [issue37174] sched.py: run() is caught in delayfunc even if all
 events are cancelled.
Message-ID: <1559822786.43.0.93146538102.issue37174@roundup.psfhosted.org>


New submission from Maximilian Ernestus <maximilian at ernestus.de>:

When I remove all events from a scheduler while its run() is being executed (with blocking=True in another thread), run() continues to block for some time because it is caught in its delayfunc which is time.sleep by default.

This issue can easily be solved by using the wait() function of a threading.Event as the delayfunc and setting the event whenever the queue becomes empty. The referenced pull request adds this functionality by default.

I also added a cancel_all() method which should be far more efficient than iterating all events and deleting them individually.

----------
components: Library (Lib)
messages: 344804
nosy: ernestum
priority: normal
pull_requests: 13738
severity: normal
status: open
title: sched.py: run() is caught in delayfunc even if all events are cancelled.
type: enhancement
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37174>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:14:20 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 12:14:20 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559823260.21.0.135262462578.issue36624@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Steve's suggestion sounds reasonable.

Should we just add this to the devguide, then?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:22:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 12:22:33 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559823753.97.0.972245837914.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Victor, as a friendly reminder, (unsigned long)-1 is not necessarily the same number as (unsigned long long)-1. The documentation means the latter.

Aaaah, I didn't notice that the function returns unsigned *long long*, sorry :-)

Which platform is impacted? Windows 64-bit? Does it mean that we have zero unit test on this function? Or does it mean that (unsigned long)-1 is compiled correctly as (unsigned long long)-1 on Windows 64-bit? Is "long long" 8 bytes long and "long" 4 bytes long on Windows 64-bit?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:24:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 12:24:36 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559823876.52.0.750349484744.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> When building openSUSE package for Python-3.8.0b1 (on x86_64 build system with the latest openSUSE/Tumbleweed)

How do you build Python?

* configure command
* C compiler
* etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:25:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 12:25:35 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1559823935.1.0.276867006043.issue36763@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 013a18a65167725f140c0395211050ae03501b12 by Victor Stinner in branch 'master':
bpo-36763, _testembed: enable assert() in release mode (GH-13857)
https://github.com/python/cpython/commit/013a18a65167725f140c0395211050ae03501b12


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:26:12 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 12:26:12 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1559823972.2.0.539182643254.issue36763@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13739
pull_request: https://github.com/python/cpython/pull/13863

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:29:41 2019
From: report at bugs.python.org (Antti Haapala)
Date: Thu, 06 Jun 2019 12:29:41 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559824181.87.0.286156736636.issue37170@roundup.psfhosted.org>


Antti Haapala <antti at haapala.name> added the comment:

Unsigned long long needs to be at least 64 bits wide, so it is probably all 32-bit platforms and 64-bit window at least. These functions are not used only in a few places within the CPython code and when they are they're guarded with `PyLong_Check`s or similar, as they probably should, but the other is part of public API

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 08:43:02 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 12:43:02 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1559824982.27.0.377838279349.issue36763@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 406284173a43f5c34643133e2f132ae15a071a23 by Miss Islington (bot) in branch '3.8':
bpo-36763, _testembed: enable assert() in release mode (GH-13857)
https://github.com/python/cpython/commit/406284173a43f5c34643133e2f132ae15a071a23


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:00:35 2019
From: report at bugs.python.org (daniel hahler)
Date: Thu, 06 Jun 2019 13:00:35 +0000
Subject: [issue36786] "make install" should run compileall in parallel
In-Reply-To: <1556908628.98.0.810004261153.issue36786@roundup.psfhosted.org>
Message-ID: <1559826035.84.0.18761960461.issue36786@roundup.psfhosted.org>


daniel hahler <python-bugs at thequod.de> added the comment:

This can be closed as per https://github.com/python/cpython/commit/1a2dd82f56bd813aacc570e172cefe55a8a41504.

----------
nosy: +blueyed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36786>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:03:12 2019
From: report at bugs.python.org (daniel hahler)
Date: Thu, 06 Jun 2019 13:03:12 +0000
Subject: [issue37175] make install: make compileall optional
Message-ID: <1559826192.88.0.243223248459.issue37175@roundup.psfhosted.org>


New submission from daniel hahler <python-bugs at thequod.de>:

I'd like to make running compileall optionally during installation, since it takes quite a while by itself (with lots of output), and gets a bit into the way when installing often (e.g. with git-bisect).

AFAIK it should not be required, because the files would be compiled on demand as usual.

I could imagine having an explicit target for this, or a make variable to control this, i.e. "make install COMPILEALL=0".

----------
components: Installation
messages: 344812
nosy: blueyed
priority: normal
severity: normal
status: open
title: make install: make compileall optional
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37175>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:09:09 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 06 Jun 2019 13:09:09 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559826549.19.0.996382342181.issue37170@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:09:35 2019
From: report at bugs.python.org (Andrei Zene)
Date: Thu, 06 Jun 2019 13:09:35 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559826575.02.0.817418125101.issue28708@roundup.psfhosted.org>


Andrei Zene <andrei.zene at outlook.com> added the comment:

Awesome work Victor! Thanks! I'll give it a try. One thing I see mising though (if I understand well) is the allocation of three fd_sets (I posted a comment on github regarding that).

Those fd_sets are currently allocated on stack and the array they contain is determined currently by FD_SETSIZE.

We'll basically need a similar structure that we can allocate dynamically, and cast it to fd_set when passing it to the select call.

I can go ahead and try implement the feedback and test it together with the changes in Victor's PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:15:52 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Thu, 06 Jun 2019 13:15:52 +0000
Subject: [issue36786] "make install" should run compileall in parallel
In-Reply-To: <1556908628.98.0.810004261153.issue36786@roundup.psfhosted.org>
Message-ID: <1559826952.72.0.274303894804.issue36786@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Ah, I had forgotten to close this issue. Thanks.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36786>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:18:22 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 13:18:22 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1559827102.88.0.0725907160287.issue37151@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13740
pull_request: https://github.com/python/cpython/pull/13864

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:54:33 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 13:54:33 +0000
Subject: [issue36922] Implement Py_TPFLAGS_METHOD_DESCRIPTOR
In-Reply-To: <1557909585.08.0.913937443168.issue36922@roundup.psfhosted.org>
Message-ID: <1559829273.19.0.297976144245.issue36922@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13741
pull_request: https://github.com/python/cpython/pull/13865

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36922>
_______________________________________

From report at bugs.python.org  Thu Jun  6 09:59:34 2019
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 06 Jun 2019 13:59:34 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1559829574.3.0.110498561394.issue28708@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> Those fd_sets are currently allocated on stack and the array they 
> contain is determined currently by FD_SETSIZE. We'll basically need 
> a similar structure that we can allocate dynamically, and cast it to
> fd_set when passing it to the select call.

This is possible in Windows. Other platforms are limited to a fixed FD_SETSIZE, in which case the old error should be retained:

        if (index >= (unsigned int)FD_SETSIZE) {
            PyErr_SetString(PyExc_ValueError,
                          "too many file descriptors in select()");
            goto finally;
        }

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Thu Jun  6 10:07:13 2019
From: report at bugs.python.org (daniel hahler)
Date: Thu, 06 Jun 2019 14:07:13 +0000
Subject: [issue37032] Add CodeType.replace() method
In-Reply-To: <1558689955.85.0.932624363868.issue37032@roundup.psfhosted.org>
Message-ID: <1559830033.12.0.347689288505.issue37032@roundup.psfhosted.org>


daniel hahler <python-bugs at thequod.de> added the comment:

Thanks for this great improvement!

Was about to suggest having something more futureproof when noticing this with pdbpp, found this, and submitted PRs to use it for ipython and hypothesis also.

----------
nosy: +blueyed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37032>
_______________________________________

From report at bugs.python.org  Thu Jun  6 10:15:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 14:15:03 +0000
Subject: [issue37032] Add CodeType.replace() method
In-Reply-To: <1558689955.85.0.932624363868.issue37032@roundup.psfhosted.org>
Message-ID: <1559830503.27.0.620915617397.issue37032@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> submitted PRs to use it for ipython and hypothesis also

Cool! Thank you for doing that ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37032>
_______________________________________

From report at bugs.python.org  Thu Jun  6 10:26:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 14:26:02 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559831162.75.0.116221343456.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 2.7 - 3.9 are affected. Python 3.6 no longer accept bugfixes.

----------
versions:  -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 10:36:45 2019
From: report at bugs.python.org (=?utf-8?q?R=C3=A9mi_Lapeyre?=)
Date: Thu, 06 Jun 2019 14:36:45 +0000
Subject: [issue37102] Automatically dedent docstring constants by default
In-Reply-To: <1559239200.57.0.0816589870282.issue37102@roundup.psfhosted.org>
Message-ID: <1559831805.18.0.314192991425.issue37102@roundup.psfhosted.org>


R?mi Lapeyre <remi.lapeyre at henki.fr> added the comment:

This is the function I inlined and as far as I can tell, my approach as been similar to the one you linked.

I'm still need to fix some issues as doctest was expecting to find the string before dedenting though.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37102>
_______________________________________

From report at bugs.python.org  Thu Jun  6 10:56:47 2019
From: report at bugs.python.org (Matej Cepl)
Date: Thu, 06 Jun 2019 14:56:47 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559833007.16.0.705260332567.issue37169@roundup.psfhosted.org>


Matej Cepl <mcepl at cepl.eu> added the comment:

Complete build log which shows all dependent libraries, compilation options, etc. If you want any other artifacts (config.log, Python.h) just let me know.

----------
Added file: https://bugs.python.org/file48397/log.txt.gz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:17:23 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 06 Jun 2019 15:17:23 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1559834243.13.0.374105183854.issue37156@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +13742
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13866

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:30:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 15:30:44 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559835044.69.0.201177447538.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Matej provides me a link to the build logs on IRC:

It's GCC 9.1.1 (gcc9-9.1.1+r271393-1.2)

The compilation uses PGO and LTO.

./configure --host=x86_64-suse-linux-gnu --build=x86_64-suse-linux-gnu --program-prefix= --disable-dependency-tracking --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/lib --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info --disable-dependency-tracking --docdir=/usr/share/doc/packages/python --enable-ipv6 --enable-shared --with-ensurepip=no --with-system-ffi --with-system-expat --with-lto --enable-optimizations --enable-loadable-sqlite-extensions

[   44s] configure: WARNING: unrecognized options: --disable-dependency-tracking, --disable-dependency-tracking

--

I'm unable to reproduce the issue on Fedora 30 using GCC 9.1.1:

$ ./configure --host=x86_64-suse-linux-gnu --build=x86_64-suse-linux-gnu --program-prefix= --disable-dependency-tracking --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/lib --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info --disable-dependency-tracking --docdir=/usr/share/doc/packages/python --enable-ipv6 --enable-shared --with-ensurepip=no --with-system-ffi --with-system-expat --with-lto --enable-optimizations --enable-loadable-sqlite-extensions
...
$ vim Makefile
# replace "PROFILE_TASK=..." with "PROFILE_TASK=-c pass", just to make compilation faster ;-)
$ make
...
$ LD_LIBRARY_PATH=$PWD ./python -m test -v test_capi
...
Tests result: SUCCESS

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:37:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 15:37:05 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559835425.33.0.0739593583207.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

test_pyobject_is_freed_free() test can be simplified as attached is_freed.py using:

$ LD_LIBRARY_PATH=$PWD PYTHONMALLOC=debug ./python is_freed.py; echo $?
0

0 means success: the test pass.

1 means failure: the test fails.

(Again, I cannot reproduce this failure.)

----------
Added file: https://bugs.python.org/file48398/is_freed.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:39:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 15:39:21 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559835561.41.0.749918285161.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh wait, only PyMemMallocDebugTests fails:

class PyMemMallocDebugTests(PyMemDebugTests):
    PYTHONMALLOC = 'malloc_debug'

Logs:

[ 2863s] test_pyobject_is_freed_free (test.test_capi.PyMemDebugTests) ... ok
[ 2863s] test_pyobject_is_freed_free (test.test_capi.PyMemDefaultTests) ... skipped 'need Py_DEBUG'
[ 2863s] test_pyobject_is_freed_free (test.test_capi.PyMemMallocDebugTests) ... FAIL
[ 2863s] test_pyobject_is_freed_free (test.test_capi.PyMemPymallocDebugTests) ... ok

So the correct line to reproduce the bug should be:

$ LD_LIBRARY_PATH=$PWD PYTHONMALLOC=malloc_debug ./python is_freed.py; echo $?
0

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:43:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 15:43:05 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559835785.94.0.380734261106.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I designed unit tests to be optimistic: expect that freed memory will be untouched during a few Python instructions:

# create an object, free its memory
obj = _testcapi.pyobject_freed()
# check that the object memory is freed
error = (_testcapi.pyobject_is_freed(obj) == False)

Maybe calling _testcapi.pyobject_is_freed() reuse the memory which has just been freed.

The test should be fully ritten in C to avoid this issue.

I wrote the test using 2 Python functions just to make the test simpler to write, but it seems like *sometimes*, it can fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Thu Jun  6 11:52:04 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 15:52:04 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559836324.42.0.645145188259.issue37138@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

That's entirely my fault. I was not aware of the fact that calling memcpy() with src=NULL and length 0 was undefined behaviour. I disagree that it should be undefined, but there is not much point in arguing against the C standard.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:00:50 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 16:00:50 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559836850.43.0.66701757176.issue37138@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13743
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13867

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:02:23 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 06 Jun 2019 16:02:23 +0000
Subject: [issue37165] Convert _collections._count_elements() to the Argument
 Clinic
In-Reply-To: <1559760307.2.0.195086878247.issue37165@roundup.psfhosted.org>
Message-ID: <1559836943.79.0.699606305612.issue37165@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37165>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:06:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 16:06:09 +0000
Subject: [issue30458] [security][CVE-2019-9740][CVE-2019-9947] HTTP Header
 Injection (follow-up of CVE-2016-5699)
In-Reply-To: <1495638091.75.0.96439752743.issue30458@psf.upfronthosting.co.za>
Message-ID: <1559837169.22.0.0128602842953.issue30458@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Note for myself: Python 2 urllib.urlopen(url) always quotes the URL and so is not vulnerable to HTTP Header Injection (at least, not to this issue ;-)).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30458>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:06:58 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 16:06:58 +0000
Subject: [issue37176] super() docs don't say what super() does
Message-ID: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

The documentation for super() at https://docs.python.org/3.8/library/functions.html#super does not actually say what super() does. It only says "Return a proxy object that delegates method calls to a parent or sibling class of type" and then gives a bunch of use cases and examples.

If there is one place where we should define exactly what super() does (as opposed to give guidance on how to use it), the stdlib reference should be it.

----------
assignee: docs at python
components: Documentation
messages: 344827
nosy: docs at python, jdemeyer
priority: normal
severity: normal
status: open
title: super() docs don't say what super() does
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:07:00 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 06 Jun 2019 16:07:00 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1559837220.21.0.290902767175.issue37156@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset e0c0c7e8c9f8153a54b92e43aa3d09e69a9fd0c0 by Steve Dower in branch 'master':
bpo-37156: Fix libssl DLL tag in MSI sources (GH-13866)
https://github.com/python/cpython/commit/e0c0c7e8c9f8153a54b92e43aa3d09e69a9fd0c0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:07:26 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 16:07:26 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1559837246.29.0.141209646812.issue37156@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13744
pull_request: https://github.com/python/cpython/pull/13868

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:08:19 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 06 Jun 2019 16:08:19 +0000
Subject: [issue18355] Merge super() guide into documentation
In-Reply-To: <1372901200.41.0.725969821731.issue18355@psf.upfronthosting.co.za>
Message-ID: <1559837299.39.0.620347337533.issue18355@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

I opened another doc issue about super(): #37176

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18355>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:11:56 2019
From: report at bugs.python.org (Michael Felt)
Date: Thu, 06 Jun 2019 16:11:56 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1559823260.21.0.135262462578.issue36624@roundup.psfhosted.org>
Message-ID: <43acebb0-04c2-7254-14f2-1a139c3ad0cb@felt.demon.nl>


Michael Felt <aixtools at felt.demon.nl> added the comment:

On 06/06/2019 14:14, Tal Einat wrote:
> Tal Einat <taleinat at gmail.com> added the comment:
>
> Steve's suggestion sounds reasonable.
>
> Should we just add this to the devguide, then?

Well, as I said before - it was never about THIS being the solution.
While that would have been nice (for my ego). Would it be worthwhile,
assuming this moves to "devguide" status - for me to work through the
tests - looking for the tests that do not follow these guidelines and
"patch" those?

Probably minor, but it is something I could do. Think of it as
"self-documentation" rather than .rst files.

>
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue36624>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:18:48 2019
From: report at bugs.python.org (Cooper Lees)
Date: Thu, 06 Jun 2019 16:18:48 +0000
Subject: [issue34971] add support for tls/ssl sessions in asyncio
In-Reply-To: <1539420460.92.0.788709270274.issue34971@psf.upfronthosting.co.za>
Message-ID: <1559837928.95.0.78459735298.issue34971@roundup.psfhosted.org>


Change by Cooper Lees <me at cooperlees.com>:


----------
nosy: +cooperlees

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34971>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:21:59 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 16:21:59 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
Message-ID: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>


New submission from Tal Einat <taleinat at gmail.com>:

This issue was brought up by Irv Kalb on the idle-dev mailing list.

I haven't been able to reproduce it exactly as he described, but I have managed to do so otherwise, and remember it happening on occasion on other computers.

This appears to happen because the dialog windows are not being made transient relative to the main window. I'll have a PR up with a fix in a bit.


Following is what Irv Kalb sent to the mailing list:

I teach Python classes using IDLE.  The search dialog is a real a problem for new students and me as the teacher.  My students and I often get into a scenario where the search dialog gets hidden behind a editing window.  When that happens, then you try to make edits in code and nothing happens.  This happens to very often.  I have learned to look for the hidden search dialog window, but my students get very flustered.


Simple steps to reproduce (I'm using Python 3.6.1 with IDLE):

	Open a new document.

	Enter any code (e.g., a = 1)

	Bring up the Search Dialog.

	If the Search Dialog is not over the rectangle of the editing window, move it anywhere over the editing window.
        (This step is specifically to reproduce the problem, but this happens very often as students move windows around.)

	Search for: a        

	Click: Find Next

	Click in the editing window (with the intention to make some change)

Results:

	Search Dialog is now hidden behind the editing window.  
        Keystrokes are now ignored in the editing window, even though the editing window appears to have focus.
	User has no idea about how to get out of this situation - unless they have seen it before and know that the Search Dialog is still active behind the current window.

----------
assignee: terry.reedy
components: IDLE
messages: 344831
nosy: taleinat, terry.reedy
priority: normal
severity: normal
status: open
title: IDLE: Search dialogs can be hidden behind the main window

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:22:35 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 16:22:35 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559838155.03.0.399755403592.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
stage:  -> needs patch
type:  -> behavior
versions: +Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:26:01 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 16:26:01 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559838361.06.0.191935593088.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
keywords: +patch
pull_requests: +13745
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13869

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:26:36 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 16:26:36 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559838396.5.0.742503797028.issue37177@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

See proposed fix in GH-13869.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:30:28 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Thu, 06 Jun 2019 16:30:28 +0000
Subject: [issue37178] One argument form of math.perm()
Message-ID: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

The perm() function should have a one argument form and change its signature to ``perm(n, k=None)``.  This matches what itertools:

itertools.permutations(iterable, r=None)
   Return successive r length permutations of elements
   in the iterable.

   If r is not specified or is None, then r defaults to
   the length of the iterable and all possible full-length
   permutations are generated.

----------
components: Library (Lib)
messages: 344833
nosy: mark.dickinson, rhettinger, serhiy.storchaka, tim.peters
priority: normal
severity: normal
status: open
title: One argument form of math.perm()
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:31:34 2019
From: report at bugs.python.org (Phil Frost)
Date: Thu, 06 Jun 2019 16:31:34 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559838694.4.0.262879807647.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

skrah: Yes, that's correct. Since I can only produce this bug in production it will take me some days to build and validate a source build. But absent any better ideas, I will try.

tim.peters: I've observed this bug across hundreds of EC2 hosts, in dozens of code paths, with all kinds of inputs. Moreover, the hosts aren't displaying any other symptoms of hardware failure such as random segfaults or mysteriously corrupted data.

I've also deeply investigated two cores now which show specifically that `exp` seems to get 2 added when it should have been 1. I have a hard time explaining how a hardware failure can cause precisely the same failure so reliably.

So I doubt hardware is to blame.

Although, it does seem the issue occurs in "clumps" on individual hosts. So we might go 10 hours without seeing the issue, then it may happen 5 times within 30 minutes on one host. We might observe 1 or 2 more such clumps on the same host until the next deploy of the application, at which point all the containers are replaced with fresh ones. So this suggests there is some ephemeral state within a host that creates a propensity for the issue.

I've also been unable to reproduce the problem in a development environment, even when that development environment is using the same kernel, instance class, and docker container as production. So I suspect the bug is precipitated by some particular concurrency or interaction that I haven't been able to replicate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:36:49 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 06 Jun 2019 16:36:49 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1559839009.35.0.867022422351.issue37178@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

perm(n, n) = factorial(n)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:38:01 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 16:38:01 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1559839081.97.0.643036160916.issue37156@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 1c4084f4c13d7ec516abc0439288cbeb2c96489a by Miss Islington (bot) in branch '3.8':
bpo-37156: Fix libssl DLL tag in MSI sources (GH-13866)
https://github.com/python/cpython/commit/1c4084f4c13d7ec516abc0439288cbeb2c96489a


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:41:31 2019
From: report at bugs.python.org (Tim Peters)
Date: Thu, 06 Jun 2019 16:41:31 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1559839291.4.0.423584820917.issue37178@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I agree: perm(n) should return factorial(n).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:49:27 2019
From: report at bugs.python.org (Nathaniel Gaertner)
Date: Thu, 06 Jun 2019 16:49:27 +0000
Subject: [issue36865] FileInput does not allow 'rt' mode,
 but all its existing delegates do
In-Reply-To: <1557408143.65.0.0603138385641.issue36865@roundup.psfhosted.org>
Message-ID: <1559839767.25.0.884285079773.issue36865@roundup.psfhosted.org>


Nathaniel Gaertner <natgaertner at gmail.com> added the comment:

Hey sorry for the delay in responding.

My thought with forcing 'rt' mode is that it would actually reduce the flexibility of the FileInput class. For 5758, I suspect the issue arose out of a confusion about what strings meant in python 2 vs 3. If I understand correctly, a "string" in 2 is actually an array of binary data, displayed as if it were ASCII encoded text. So when it prints the binary data from the gzip file in the example given on that issue, it's happy to say "aha this is ASCII encoded text, let's print it like a string." This leads to the case where 2 "works" (does not mark the printed data from gzip explicitly as binary).

But in 3 strings and binary arrays are totally different kinds of objects! I am unfamiliar with the history of introducing 'rt', but I'm guessing it has to do with disambiguating 'r', since text is now stored in its own unique object type and goes through an explicit encoding process to get there. With the explicit 'rt' and 'rb' modes, 'r' becomes explicitly ambiguous (an oxymoron I know), so if a user provides 'r' they are expressing no preference between text and binary. If they have a preference 'rt' and 'rb' give them the ability to express it.

I may be totally on the wrong track here, or missing some important backward compatibility issues, but that's my thoughts. Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36865>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:49:32 2019
From: report at bugs.python.org (Stefan Krah)
Date: Thu, 06 Jun 2019 16:49:32 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559839772.27.0.686822647206.issue37168@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

There are lots of ideas still. :)

As I said, on a Linux other than RedHat or Debian or such I'd first try
to blame the shipped Python, then the libc (I had a glibc memmove issue
once with similar inexplicable results).

Alpine Linux apparently uses musl.  Is that well supported and tested?



Since you mention concurrency: Before the arrival of contextvars in 3.7
the decimal context is thread-safe, but not coroutine-safe.


If the issue is really in that particular loop I can't see how
that could be the cause, but perhaps the core dump is not accurate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 12:59:13 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 06 Jun 2019 16:59:13 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1559840353.82.0.223558223602.issue37156@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:02:07 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 06 Jun 2019 17:02:07 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1559840527.32.0.461123652949.issue37178@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I never seen a one argument form of P(n, k) in mathematics. itertools.permutations() corresponds two functions: math.perm() and math .factorial(). Unless you a going to add a new function in the itertools module equal to a one argument form of itertools.permutations() there will be no full symmetry.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:05:58 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 06 Jun 2019 17:05:58 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559840758.58.0.424865897541.issue37170@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz
versions:  -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:08:46 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 06 Jun 2019 17:08:46 +0000
Subject: [issue21315] email._header_value_parser does not recognise in-line
 encoding changes
In-Reply-To: <1398009498.59.0.139606640186.issue21315@psf.upfronthosting.co.za>
Message-ID: <1559840926.32.0.830437953824.issue21315@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset dc20fc4311dece19488299a7cd11317ffbe4d3c3 by Barry Warsaw (Miss Islington (bot)) in branch '3.7':
bpo-21315: Fix parsing of encoded words with missing leading ws. (GH-13425) (#13846)
https://github.com/python/cpython/commit/dc20fc4311dece19488299a7cd11317ffbe4d3c3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21315>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:08:50 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 06 Jun 2019 17:08:50 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559840930.23.0.177258328716.issue36624@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Changing our policy here (from "no policy" to "here's a recommendation") probably deserves a python-dev discussion first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:15:42 2019
From: report at bugs.python.org (Rene Dudfield)
Date: Thu, 06 Jun 2019 17:15:42 +0000
Subject: [issue14367] try/except block in ismethoddescriptor() in inspect.py, 
 so that pydoc works with pygame in Python 3.2
In-Reply-To: <1332132143.66.0.7093323157.issue14367@psf.upfronthosting.co.za>
Message-ID: <1559841342.89.0.749875624394.issue14367@roundup.psfhosted.org>


Rene Dudfield <illume at users.sourceforge.net> added the comment:

This can be closed.

$ python3 -m pydoc -p 7464

Then view in browser: http://localhost:7464/pygame.html


No error.

----------
nosy: +illume

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14367>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:21:53 2019
From: report at bugs.python.org (Phil Frost)
Date: Thu, 06 Jun 2019 17:21:53 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559841713.74.0.540368296536.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

> Alpine Linux apparently uses musl.  Is that well supported and tested?

Heh. Not really.

Switching to a Debian container is probably just about as much work as building Python from source. Would that be preferable?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:29:12 2019
From: report at bugs.python.org (Stefan Krah)
Date: Thu, 06 Jun 2019 17:29:12 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559842152.17.0.586488612258.issue37168@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

Yes, I'd try Debian first, then potential libc issues can also be eliminated in a single experiment.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:40:08 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 17:40:08 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559842808.21.0.761085582349.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
nosy: +IrvKalb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Thu Jun  6 13:55:13 2019
From: report at bugs.python.org (Cooper Lees)
Date: Thu, 06 Jun 2019 17:55:13 +0000
Subject: [issue37179] asyncio loop.start_tls() provide support for TLS in TLS
Message-ID: <1559843713.76.0.0171515478407.issue37179@roundup.psfhosted.org>


New submission from Cooper Lees <me at cooperlees.com>:

aiohttp would love to be able to support HTTPS Proxy servers. To do this, asyncio itself needs to be able to provide TLS within TLS connections.

Can we add this support to asyncio please.

(I tried search but could not find a related issue - Please merge if there is)

----------
components: asyncio
messages: 344846
nosy: asvetlov, cooperlees, yselivanov
priority: normal
severity: normal
status: open
title: asyncio loop.start_tls() provide support for TLS in TLS
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37179>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:02:20 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 06 Jun 2019 18:02:20 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559844140.95.0.403992765203.issue37168@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:04:50 2019
From: report at bugs.python.org (Phil Frost)
Date: Thu, 06 Jun 2019 18:04:50 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559844290.17.0.33220672411.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

So this is um....interesting....

(gdb) p small_ints[0]
$2 = (PyIntObject *) 0x558ce65df528
(gdb) p *small_ints[0]
$3 = {ob_refcnt = 18, ob_type = 0x7fe019b694c0 <PyInt_Type>, ob_ival = -5}
(gdb) p *small_ints[1]
$4 = {ob_refcnt = 65, ob_type = 0x7fe019b694c0 <PyInt_Type>, ob_ival = -3}
(gdb) p *small_ints[2]
$5 = {ob_refcnt = 204, ob_type = 0x7fe019b694c0 <PyInt_Type>, ob_ival = -3}
(gdb) p *small_ints[3]
$6 = {ob_refcnt = 1872, ob_type = 0x7fe019b694c0 <PyInt_Type>, ob_ival = -2}

When is 1/1=10? When -5 + 1 = -3.

So now I suppose the question is how this comes to be.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:26:29 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 18:26:29 +0000
Subject: [issue30809] IDLE parenmatch - highlighting options
In-Reply-To: <1498768567.92.0.13204753323.issue30809@psf.upfronthosting.co.za>
Message-ID: <1559845589.38.0.748178093359.issue30809@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

FWIW I'm -1 on this change, due to the decision to keep IDLE simple for new users learning Python rather than power users.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30809>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:29:15 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Thu, 06 Jun 2019 18:29:15 +0000
Subject: [issue37179] asyncio loop.start_tls() provide support for TLS in TLS
In-Reply-To: <1559843713.76.0.0171515478407.issue37179@roundup.psfhosted.org>
Message-ID: <1559845755.99.0.398339723307.issue37179@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

Yeah, we have the SSL reimplementation ready to be backported from uvloop to cpython.  Fantix, the original author, should be able to do that soon.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37179>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:29:30 2019
From: report at bugs.python.org (Fantix King)
Date: Thu, 06 Jun 2019 18:29:30 +0000
Subject: [issue37179] asyncio loop.start_tls() provide support for TLS in TLS
In-Reply-To: <1559843713.76.0.0171515478407.issue37179@roundup.psfhosted.org>
Message-ID: <1559845770.98.0.791216495836.issue37179@roundup.psfhosted.org>


Change by Fantix King <fantix.king at gmail.com>:


----------
nosy: +fantix

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37179>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:35:53 2019
From: report at bugs.python.org (Ramin Najjarbashi)
Date: Thu, 06 Jun 2019 18:35:53 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
Message-ID: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>


New submission from Ramin Najjarbashi <ramin.najarbashi at gmail.com>:

Regarding the file named: "Lib/encodings/mac_farsi.py", the numbers are inserted in the wrong way, they are inserted Arabic numbers instead of Persian, they are edited in the comment.
The KAF character (?) which was the Arabic version, has been changed and edited to the Persian version(?).

It's not a big deal, but it's my first step to improve my favorite language ;)

----------
messages: 344850
nosy: RaminNietzsche
priority: normal
severity: normal
status: open
title: Fix Persian KAF in mac_farsi.py
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:36:03 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 06 Jun 2019 18:36:03 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1559846163.33.0.771249906797.issue35431@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
pull_requests: +13746
pull_request: https://github.com/python/cpython/pull/13870

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:37:02 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 06 Jun 2019 18:37:02 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1559846222.66.0.968921283021.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Since having tempfile.TemporaryDirectory() automatically unmount mount points is difficult to implement in a portable way (Windows, BSD/macOS, and Linux are all different), a shorter-term solution could be to add an 'onerror' callback function as a class initialization parameter. This would allow the caller to inspect and try to handle any directory entries that the cleanup() function can't handle (like unmounting a mount point).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:42:42 2019
From: report at bugs.python.org (Ramin Najjarbashi)
Date: Thu, 06 Jun 2019 18:42:42 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
In-Reply-To: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>
Message-ID: <1559846562.34.0.289996144297.issue37180@roundup.psfhosted.org>


Change by Ramin Najjarbashi <ramin.najarbashi at gmail.com>:


----------
keywords: +patch
pull_requests: +13747
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13871

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Thu Jun  6 14:43:06 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 06 Jun 2019 18:43:06 +0000
Subject: [issue24039] Idle: some modal dialogs maximize, don't minimize
In-Reply-To: <1429811337.7.0.183903934829.issue24039@psf.upfronthosting.co.za>
Message-ID: <1559846586.62.0.771946848478.issue24039@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Dialogs attached to a particular window should be 'transient' to that window.  https://www.tcl.tk/man/tcl8.6/TkCmd/wm.htm#M64
It is an oversight that the window search and replace windows are not.
Modal windows, including the current Find in Files might just as well be.  

PR 13869 for #37177 (aimed at a different symption) makes search windows transient, fixing this issue also.

If Find in Files were not modal, then it need not be transient to a particular window, and minimizing could be sensible.  But this is a separate issue.

----------
stage: needs patch -> 
versions: +Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24039>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:01:24 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 06 Jun 2019 19:01:24 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
Message-ID: <1559847684.99.0.249295662285.issue37181@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
components: Tests, Windows
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: fix test_regrtest failures on Windows arm64
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:07:39 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 06 Jun 2019 19:07:39 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
Message-ID: <1559848059.79.0.691678190948.issue37181@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13748
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13872

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:10:42 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 06 Jun 2019 19:10:42 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559848242.4.0.1088414496.issue37168@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

Interesting indeed.

What 3rd party extension are installed in your Python environment? Is it possible that one of them is messing with the CPython internals (perhaps in an overeager attempt to optimize)? Any uses of ctypes?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:14:45 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 06 Jun 2019 19:14:45 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559848485.88.0.22782344383.issue37168@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

This smells a bit as though someone's doing something like:

    myobject = PyInt_FromLong(some_long);

and then assuming that they hold the only reference to `myobject`, so that it's safe to mutate in place.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:15:24 2019
From: report at bugs.python.org (SilentGhost)
Date: Thu, 06 Jun 2019 19:15:24 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
In-Reply-To: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>
Message-ID: <1559848524.3.0.512449265974.issue37180@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

The names of the characters given in comments agree with the unicode database name (they're indeed ARABIC-INDIC DIGITs and ARABIC LETTER).

The replacement character that you're proposing is called (according to the same database) 'ARABIC LETTER KEHEH', whereas the old one was 'ARABIC LETTER KAF'. This encoding was originally generated based on data from unicode.org, I'd think a reference would be needed making clear that this is indeed a valid replacement.

----------
components: +Unicode, macOS
nosy: +SilentGhost, ezio.melotti, ned.deily, ronaldoussoren, vstinner
type: enhancement -> behavior
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:17:57 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 06 Jun 2019 19:17:57 +0000
Subject: [issue24139] Use sqlite3 extended error codes
In-Reply-To: <1430990375.51.0.367829317248.issue24139@psf.upfronthosting.co.za>
Message-ID: <1559848677.08.0.469993054946.issue24139@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
pull_requests: +13749
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13869

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24139>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:22:21 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 06 Jun 2019 19:22:21 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
In-Reply-To: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>
Message-ID: <1559848941.71.0.350992909191.issue37180@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +lemburg

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:22:30 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 06 Jun 2019 19:22:30 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559848950.05.0.12600048584.issue37134@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

@Brian: Probably not. The worry that came up during the steering council meeting was bifurcating the docs could cause confusion as to why it was different, which one was more "right", etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:22:52 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 06 Jun 2019 19:22:52 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559848972.03.0.159490724141.issue37134@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

@Brian: And thanks for the experiment! It was an interesting idea to consider.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:23:23 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 06 Jun 2019 19:23:23 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559849003.86.0.633163522133.issue37162@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:33:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 06 Jun 2019 19:33:38 +0000
Subject: [issue30809] IDLE parenmatch - highlighting options
In-Reply-To: <1498768567.92.0.13204753323.issue30809@psf.upfronthosting.co.za>
Message-ID: <1559849618.42.0.662352380842.issue30809@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I agree.  The parenmatch highlighting is so transient that it hardly matters what it is, except that it should not match a syntax color.

----------
dependencies:  -Idle extension configuration: add option-help option
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30809>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:35:05 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 19:35:05 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559849705.8.0.745376113742.issue37134@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

@brian, Just to echo Brett's words, the Steering Council appreciated the tabbed prototype and your effort to create it. While we may not use it in this particular case, it's great to keep in mind for other places. Thanks for contributing :D

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:41:45 2019
From: report at bugs.python.org (Ilya Kamenshchikov)
Date: Thu, 06 Jun 2019 19:41:45 +0000
Subject: [issue37182] ast - handling new line inside a string
Message-ID: <1559850105.87.0.562031777923.issue37182@roundup.psfhosted.org>


New submission from Ilya Kamenshchikov <ikamenshchikov at gmail.com>:

parsing two different strings produces identical ast.Str nodes:

import ast

txt1 = '"""\\n"""'
txt2 = '"""\n"""'

tree1 = ast.parse(txt1)
tree2 = ast.parse(txt2)

print(tree1.body[0].value.s == tree2.body[0].value.s)
print(bytes(tree1.body[0].value.s, encoding='utf-8'))
print(bytes(tree2.body[0].value.s, encoding='utf-8'))

>>> True
>>> b'\n'
>>> b'\n'

Expected result: I should be able to distinguish between the nodes created from two different strings.

----------
components: Library (Lib)
messages: 344861
nosy: Ilya Kamenshchikov
priority: normal
severity: normal
status: open
title: ast - handling new line inside a string
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37182>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:44:26 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 19:44:26 +0000
Subject: [issue21106] Updated Mac folder icon
In-Reply-To: <1396214057.84.0.0230664527626.issue21106@psf.upfronthosting.co.za>
Message-ID: <1559850266.32.0.322176098973.issue21106@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

This was resolved in https://github.com/python/cpython/pull/1780. Thanks @ned.deily.

----------
keywords: +patch
message_count: 15.0 -> 16.0
pull_requests: +13750
resolution:  -> fixed
stage: resolved -> patch review
status: open -> closed
pull_request: https://github.com/python/cpython/pull/1780

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21106>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:53:49 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Thu, 06 Jun 2019 19:53:49 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1559850829.97.0.691911248126.issue36520@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset f6713e84afc5addcfa8477dbdf2c027787f711c0 by Barry Warsaw (websurfer5) in branch 'master':
bpo-36520: Email header folded incorrectly (#13608)
https://github.com/python/cpython/commit/f6713e84afc5addcfa8477dbdf2c027787f711c0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:55:36 2019
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 06 Jun 2019 19:55:36 +0000
Subject: [issue37183] Linker failure when creating main binary with
 python-config --libs
Message-ID: <1559850936.49.0.687139467253.issue37183@roundup.psfhosted.org>


New submission from Christian Heimes <lists at cheimes.de>:

With 3.8 it is no longer possible to compile a custom Python interpreter with linker flags from python-config. The config helper omits the main Python library:

$ python3.8-config --ldflags
 -L/usr/lib64  -lcrypt -lpthread -ldl  -lutil -lm -lm

$ gcc  -L/usr/lib64  -lcrypt -lpthread -ldl  -lutil -lm -lm -o custompython custompython.o
/usr/bin/ld: custompython.o: in function `main':
custompython.c:10: undefined reference to `Py_BytesMain'
collect2: error: ld returned 1 exit status

----------
components: Interpreter Core
messages: 344864
nosy: christian.heimes, vstinner
priority: high
severity: normal
stage: needs patch
status: open
title: Linker failure when creating main binary with python-config --libs
type: compile error
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37183>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:56:18 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 19:56:18 +0000
Subject: [issue23324] Nonblocking serial io using Arduino and Ubuntu 14.10
 (Python 3.4.2) performance slowdown
In-Reply-To: <1422304616.63.0.532936343926.issue23324@psf.upfronthosting.co.za>
Message-ID: <1559850978.34.0.898896732247.issue23324@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

@MrYsLab, Sorry that this issue wasn't resolved in the past. 

I would like to close this since we are currently working on a 3.8 release. I'm going to do that now. You may wish to take a look at MicroPython and CircuitPython if you haven't already seen them. They are pretty interesting.

Thanks for using Python.

----------
resolution:  -> out of date
stage:  -> resolved

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23324>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:56:24 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 19:56:24 +0000
Subject: [issue23324] Nonblocking serial io using Arduino and Ubuntu 14.10
 (Python 3.4.2) performance slowdown
In-Reply-To: <1422304616.63.0.532936343926.issue23324@psf.upfronthosting.co.za>
Message-ID: <1559850984.6.0.812412550618.issue23324@roundup.psfhosted.org>


Change by Carol Willing <willingc at gmail.com>:


----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23324>
_______________________________________

From report at bugs.python.org  Thu Jun  6 15:59:47 2019
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 06 Jun 2019 19:59:47 +0000
Subject: [issue37183] Linker failure when creating main binary with
 python-config --libs
In-Reply-To: <1559850936.49.0.687139467253.issue37183@roundup.psfhosted.org>
Message-ID: <1559851187.93.0.152215066262.issue37183@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

python-3.8.pc also omits -lpython3.8:

$ pkg-config python-3.8 --libs

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37183>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:02:01 2019
From: report at bugs.python.org (Ilya Kamenshchikov)
Date: Thu, 06 Jun 2019 20:02:01 +0000
Subject: [issue37182] ast - handling new line inside a string
In-Reply-To: <1559850105.87.0.562031777923.issue37182@roundup.psfhosted.org>
Message-ID: <1559851321.86.0.933526375989.issue37182@roundup.psfhosted.org>


Ilya Kamenshchikov <ikamenshchikov at gmail.com> added the comment:

Same problem holds for tabs (\\t vs \t).

For \\r vs \r, it is even more fun: 
txt1 = '"""\\r"""'
txt2 = '"""\r"""'

>>> b'\r'
>>> b'\n'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37182>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:05:35 2019
From: report at bugs.python.org (Alan Yorinks)
Date: Thu, 06 Jun 2019 20:05:35 +0000
Subject: [issue23324] Nonblocking serial io using Arduino and Ubuntu 14.10
 (Python 3.4.2) performance slowdown
In-Reply-To: <1559850984.62.0.390359637097.issue23324@roundup.psfhosted.org>
Message-ID: <702a882f-b52b-7c01-a52d-08e74566d2cc@gmail.com>


Alan Yorinks <MisterYsLab at gmail.com> added the comment:

Hi Carol,
 ??? Thanks for the update. I retested on Python 3.7 and the problem 
seems to have been resolved some where along the way.
BTW, I am using MicroPython on an ESP8266 remotely controlled from a 
Python program on a PC. You can read about it here:
https://mryslab.github.io/python_banyan/#gpio_intro/.

Looking forward to 3.8!

Thanks again,
Alan

On 6/6/19 3:56 PM, Carol Willing wrote:
> Change by Carol Willing <willingc at gmail.com>:
>
>
> ----------
> status: open -> closed
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue23324>
> _______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23324>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:21:00 2019
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 06 Jun 2019 20:21:00 +0000
Subject: [issue37183] Linker failure when creating main binary with
 python-config --libs
In-Reply-To: <1559850936.49.0.687139467253.issue37183@roundup.psfhosted.org>
Message-ID: <1559852460.6.0.677156599025.issue37183@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

memo to me: read the **whole** what's new document.

https://docs.python.org/3.8/whatsnew/3.8.html#debug-build-uses-the-same-abi-as-release-build

----------
resolution:  -> not a bug
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37183>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:26:58 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 20:26:58 +0000
Subject: [issue23324] Nonblocking serial io using Arduino and Ubuntu 14.10
 (Python 3.4.2) performance slowdown
In-Reply-To: <1422304616.63.0.532936343926.issue23324@psf.upfronthosting.co.za>
Message-ID: <1559852818.48.0.155697242798.issue23324@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

@MrYsLab Well, I'm glad it resolved itself along the way. 

Your project looks cool and the docs are very nice too. Thanks for the link.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23324>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:28:51 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 20:28:51 +0000
Subject: [issue5225] OS X "Update Shell Profile" may not update $PATH if run
 more than once
In-Reply-To: <1234440346.58.0.444916712806.issue5225@psf.upfronthosting.co.za>
Message-ID: <1559852931.17.0.538219387146.issue5225@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

@ned.deily I'm doing some triaging today. As the original submitter of this issue, would you be willing to close it? Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5225>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:32:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 20:32:08 +0000
Subject: [issue37183] Linker failure when creating main binary with
 python-config --libs
In-Reply-To: <1559852460.6.0.677156599025.issue37183@roundup.psfhosted.org>
Message-ID: <CA+3bQGEJetXZ_AxyU0hGxR3YSbSeds+KGZ-9jtNVW+ybw3r0gg@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

It is a deliberate change but matbe it is not well documented? Should we
update the C API doc?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37183>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:35:32 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 20:35:32 +0000
Subject: [issue33048] macOS job broken on Travis CI
In-Reply-To: <1520791962.83.0.467229070634.issue33048@psf.upfronthosting.co.za>
Message-ID: <1559853332.54.0.46786555551.issue33048@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Folks, I'm going to close this as resolved since we are now using Azure Pipelines for MacOS as well. Brew has also since come up with a naming policy for 2 or 3 so hopefully (?) there will be no further renaming.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33048>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:39:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 20:39:40 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559853580.37.0.892890069545.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset dc2476500d91082f0c907772c83a044bf49af279 by Victor Stinner (Zackery Spytz) in branch 'master':
bpo-37170: Fix the cast on error in PyLong_AsUnsignedLongLongMask() (GH-13860)
https://github.com/python/cpython/commit/dc2476500d91082f0c907772c83a044bf49af279


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:42:20 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 06 Jun 2019 20:42:20 +0000
Subject: [issue37182] ast - handling new line inside a string
In-Reply-To: <1559850105.87.0.562031777923.issue37182@roundup.psfhosted.org>
Message-ID: <1559853740.64.0.688688930272.issue37182@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

There was a recent discussion about this on the bug tracker, but of course now I can't find it. But for an earlier discussion, see issue 25885.

The decision was that your expectation that the nodes be distinguishable isn't a design goal of the ast. There's no expectation that code can round-trip through the ast and produce the original text, even for a string.

----------
nosy: +eric.smith
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37182>
_______________________________________

From report at bugs.python.org  Thu Jun  6 16:50:32 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Thu, 06 Jun 2019 20:50:32 +0000
Subject: [issue15913] PyBuffer_SizeFromFormat is missing
In-Reply-To: <1347312444.09.0.484126652005.issue15913@psf.upfronthosting.co.za>
Message-ID: <1559854232.88.0.0746043234189.issue15913@roundup.psfhosted.org>


Change by Joannah Nanjekye <nanjekyejoannah at gmail.com>:


----------
keywords: +patch
pull_requests: +13751
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13873

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15913>
_______________________________________

From report at bugs.python.org  Thu Jun  6 17:03:00 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 06 Jun 2019 21:03:00 +0000
Subject: [issue5225] OS X "Update Shell Profile" may not update $PATH if run
 more than once
In-Reply-To: <1234440346.58.0.444916712806.issue5225@psf.upfronthosting.co.za>
Message-ID: <1559854980.87.0.853421209273.issue5225@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Please don?t close this.  It?s still an issue that needs to be addressed and I intend to do so. Thanks.

----------
assignee:  -> ned.deily
versions: +Python 3.9 -Python 2.7, Python 3.2, Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5225>
_______________________________________

From report at bugs.python.org  Thu Jun  6 17:06:00 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 06 Jun 2019 21:06:00 +0000
Subject: [issue5225] OS X "Update Shell Profile" may not update $PATH if run
 more than once
In-Reply-To: <1234440346.58.0.444916712806.issue5225@psf.upfronthosting.co.za>
Message-ID: <1559855160.19.0.0456503009119.issue5225@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

No problem :D Ping me when you need a review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5225>
_______________________________________

From report at bugs.python.org  Thu Jun  6 17:40:17 2019
From: report at bugs.python.org (Phil Frost)
Date: Thu, 06 Jun 2019 21:40:17 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559857217.57.0.870221252276.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

Probably too many C extensions to feasibly audit them all. Also we can't rule out something busted in Alpine. So I'm going to set a watchpoint on small_ints[1]->ob_ival with a little gdb script to dump core right when it changes; hopefully inspecting that backtrace will lead directly to the culprit.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:07:05 2019
From: report at bugs.python.org (Brian Skinn)
Date: Thu, 06 Jun 2019 22:07:05 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559858825.69.0.275734989164.issue37134@roundup.psfhosted.org>


Brian Skinn <bskinn at alum.mit.edu> added the comment:

:thumbsup:

Glad I happened to be in the right place at the right time to put it together. I'll leave the tabslash repo up for future reference.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:16:29 2019
From: report at bugs.python.org (Noah)
Date: Thu, 06 Jun 2019 22:16:29 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
Message-ID: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>


New submission from Noah <nlevitt at archive.org>:

Suggesting option to raise exception if process exits nonzero in `with subprocess.Popen(...):`

with subprocess.Popen('/bin/false'):
    pass

I made the mistake of assuming this construct would raise an exception (CalledProcessError). It would be nice if there were a way to do that.

----------
components: Library (Lib)
messages: 344880
nosy: nlevitt
priority: normal
severity: normal
status: open
title: suggesting option to raise exception if process exits nonzero in `with subprocess.Popen(...):`
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:20:10 2019
From: report at bugs.python.org (Pierre Glaser)
Date: Thu, 06 Jun 2019 22:20:10 +0000
Subject: [issue37185] use  os.memfd_create in multiprocessing.shared_memory?
Message-ID: <1559859610.5.0.492744373458.issue37185@roundup.psfhosted.org>


New submission from Pierre Glaser <pierreglaser at msn.com>:

Hi,
Following https://bugs.python.org/issue26836, I started thinking about using memfd_create instead of shm_open for creating shared-memory segments in multiprocessing.shared_memory.

The main advantage of memfd_create over shm_open is that the generated resources management is easier: a segment created using using memfd_create is released once all references to the segment are dropped. This is not the case for segments created using shm_open, for which additional resource tracking is needed (using the new multiprocessing.resource_tracker)

The main difference between those two calls is that segments created using memfd_create are anonymous and can only be accessed using file descriptors. The name argument in the signature serves only for debugging purposes. On the contrary, shm_open generates segments that map to a file in /dev/shm: therefore, segments each have unique names.

Would we decide to switch from shm_open to memfd_create, the name behavior will also change. How big of a deal would that be?

----------
messages: 344881
nosy: davin, pierreglaser, pitrou
priority: normal
severity: normal
status: open
title: use  os.memfd_create in multiprocessing.shared_memory?
type: resource usage
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37185>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:25:51 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 06 Jun 2019 22:25:51 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
In-Reply-To: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>
Message-ID: <1559859951.31.0.0105124367143.issue37184@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I think Popen() is just about as complex as anyone wants it to be. Is there something about .run() or .check_call() that keeps you from using them?

----------
nosy: +eric.smith
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:32:17 2019
From: report at bugs.python.org (Noah)
Date: Thu, 06 Jun 2019 22:32:17 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
In-Reply-To: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>
Message-ID: <1559860337.47.0.822174382351.issue37184@roundup.psfhosted.org>


Noah <nlevitt at archive.org> added the comment:

Yes, I'm piping a large amount of data to/from a fairly long-running subprocess.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Thu Jun  6 18:56:17 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Thu, 06 Jun 2019 22:56:17 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559858825.69.0.275734989164.issue37134@roundup.psfhosted.org>
Message-ID: <CAP7+vJKJdyHzTsVo2yihP_Sy9834ELPiegcr2cvGOB0Q8zNBmg@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Thanks Brian!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:03:34 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 06 Jun 2019 23:03:34 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559862214.89.0.282773708183.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks Brian for the prototype!

I will close this now. We can reopen if something is missing in the future.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:17:14 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 06 Jun 2019 23:17:14 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
In-Reply-To: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>
Message-ID: <1559863034.51.0.372644527892.issue37184@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I figured as much (but didn't want to lead the witness!).

I'm not completely opposed to this. I think the best thing to do is to bring up the proposal on python-ideas, and point here.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:24:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 23:24:18 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559863458.73.0.122150098897.issue37134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It seems like the translate() method of bytes and bytearray also needs a "/" in their doc.

I wrote a quick & dirty script to parse C files:
---
import glob

def parse(filename):
    clinic_input = False
    args = False
    positional = False
    func = None
    for line_number, line in enumerate(open(filename)):
        line = line.rstrip()
        if line.startswith("/*[clinic input]"):
            clinic_input = True
            args = False
            positional = False
            func = None
        elif clinic_input and func is None:
            func = line
        elif clinic_input and not args and not line:
            args = True
        elif args and line == "    /":
            positional = True
        elif positional and (line == "    *" or line.startswith("[clinic start generated code]")):
            clinic_input = False
            args = False
            positional = False
            func = None
        elif positional and line:
            print("!!!", filename, line_number, func, repr(line))
        elif not line:
            clinic_input = False
            args = False
            positional = False
            func = None

for filename in glob.glob("*/**.c"):
    parse(filename)
---

Output on the master branch:
---
!!! Modules/_struct.c 2224 unpack_from '    buffer: Py_buffer'
!!! Modules/_struct.c 2225 unpack_from '    offset: Py_ssize_t = 0'
!!! Modules/zlibmodule.c 195 zlib.compress '    level: int(c_default="Z_DEFAULT_COMPRESSION") = Z_DEFAULT_COMPRESSION'
!!! Modules/zlibmodule.c 196 zlib.compress '        Compression level, in 0-9 or -1.'
!!! Modules/zlibmodule.c 314 zlib.decompress '    wbits: int(c_default="MAX_WBITS") = MAX_WBITS'
!!! Modules/zlibmodule.c 315 zlib.decompress '        The window buffer size and container format.'
!!! Modules/zlibmodule.c 316 zlib.decompress '    bufsize: ssize_t(c_default="DEF_BUF_SIZE") = DEF_BUF_SIZE'
!!! Modules/zlibmodule.c 317 zlib.decompress '        The initial output buffer size.'
!!! Modules/zlibmodule.c 744 zlib.Decompress.decompress '    max_length: ssize_t = 0'
!!! Modules/zlibmodule.c 745 zlib.Decompress.decompress '        The maximum allowable length of the decompressed data.'
!!! Modules/zlibmodule.c 746 zlib.Decompress.decompress '        Unconsumed input data will be stored in'
!!! Modules/zlibmodule.c 747 zlib.Decompress.decompress '        the unconsumed_tail attribute.'
!!! Objects/bytearrayobject.c 1197 bytearray.translate '    delete as deletechars: object(c_default="NULL") = b\'\''
!!! Objects/bytesobject.c 2080 bytes.translate '    delete as deletechars: object(c_default="NULL") = b\'\''
!!! Python/bltinmodule.c 2282 sum as builtin_sum '    start: object(c_default="NULL") = 0'
---

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:28:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 06 Jun 2019 23:28:48 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559863728.79.0.27556431252.issue37168@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

On Python 3, you can use tracemalloc.get_object_traceback() to find where an object was allocated ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:29:43 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 06 Jun 2019 23:29:43 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559863783.87.0.24775346284.issue37134@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13752
pull_request: https://github.com/python/cpython/pull/13874

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:38:47 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 06 Jun 2019 23:38:47 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559864327.47.0.559053037618.issue37134@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset de76c07a8cd0216c3dce215e4d542e2f45aa022f by Pablo Galindo in branch 'master':
bpo-37134: Add PEP570 notation to the signature of byte{array}.translate (GH-13874)
https://github.com/python/cpython/commit/de76c07a8cd0216c3dce215e4d542e2f45aa022f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:39:17 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 23:39:17 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559864357.55.0.521530050678.issue37134@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13753
pull_request: https://github.com/python/cpython/pull/13875

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 19:44:53 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 06 Jun 2019 23:44:53 +0000
Subject: [issue37134] Use PEP570 syntax in the documentation
In-Reply-To: <1559492286.96.0.468855325599.issue37134@roundup.psfhosted.org>
Message-ID: <1559864693.22.0.970388984652.issue37134@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dba4448c63b687204813a5b04c89dd458d5ac45b by Miss Islington (bot) in branch '3.8':
bpo-37134: Add PEP570 notation to the signature of byte{array}.translate (GH-13874)
https://github.com/python/cpython/commit/dba4448c63b687204813a5b04c89dd458d5ac45b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37134>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:00:51 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 00:00:51 +0000
Subject: [issue24139] Use sqlite3 extended error codes
In-Reply-To: <1430990375.51.0.367829317248.issue24139@psf.upfronthosting.co.za>
Message-ID: <1559865651.84.0.281981138013.issue24139@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests:  -13749

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24139>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:01:12 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 00:01:12 +0000
Subject: [issue24039] Idle: some modal dialogs maximize, don't minimize
In-Reply-To: <1429811337.7.0.183903934829.issue24039@psf.upfronthosting.co.za>
Message-ID: <1559865672.57.0.035266625908.issue24039@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
keywords: +patch
pull_requests: +13754
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13869

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24039>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:03:04 2019
From: report at bugs.python.org (Roffild)
Date: Fri, 07 Jun 2019 00:03:04 +0000
Subject: [issue37186] Everyone uses GIL wrong! = DEADLOCK
Message-ID: <1559865784.82.0.0210813088917.issue37186@roundup.psfhosted.org>


New submission from Roffild <roffild at gmail.com>:

Everyone uses GIL wrong! = DEADLOCK

I used sub-interpreters in embedded Python:
https://github.com/Roffild/RoffildLibrary/blob/35ef39fafc164d260396b39b28ff897d44cf0adb/Libraries/Roffild/PythonDLL/private.h#L44
https://github.com/Roffild/RoffildLibrary/blob/35ef39fafc164d260396b39b28ff897d44cf0adb/Libraries/Roffild/PythonDLL/mql_class.c#L142

PyEval_AcquireThread(__interp->interp);
...
PyGILState_Ensure() = DEADLOCK
...
PyEval_ReleaseThread(__interp->interp);

A deadlock happens in the line:
https://github.com/python/cpython/blob/7114c6504a60365b8b0cd718da0ec8a737599fb9/Python/pystate.c#L1313

Of course in the help there is the note:
Note that the PyGILState_() functions assume there is only one global interpreter (created automatically by Py_Initialize()). Python supports the creation of additional interpreters (using Py_NewInterpreter()), but mixing multiple interpreters and the PyGILState_() API is unsupported.

But functions PyGILState_() are used in third-party libraries. Most often, these functions are used without checking that GIL is already locked. Often, these functions are added to the code for reinsurance only and this can affect performance.

Numpy:
https://github.com/numpy/numpy/blob/2d4975e75c210202293b894bf98faf12f4697a31/numpy/core/include/numpy/ndarraytypes.h#L987
https://github.com/numpy/numpy/search?q=NPY_ALLOW_C_API&unscoped_q=NPY_ALLOW_C_API

Pytorch:
https://github.com/pytorch/pytorch/blob/0a3fb45d3d2cfacbd0469bbdba0e6cb1a2cd1bbe/torch/csrc/utils/auto_gil.h#L9
https://github.com/pytorch/pytorch/search?q=AutoGIL&unscoped_q=AutoGIL

Pybind11 developers have already fixed this problem:
https://github.com/pybind/pybind11/blob/97784dad3e518ccb415d5db57ff9b933495d9024/include/pybind11/pybind11.h#L1846

It is necessary to change the code of PyGILState_() functions to support sub-interpreters.

Or add to https://docs.python.org/3/c-api/init.html#thread-state-and-the-global-interpreter-lock warning:
Some Python libraries cannot be used in a sub-interpreter due to the likelihood of deadlock.

For me, this is a critical vulnerability!

There is another problem:
Calling PyEval_AcquireThread() again results in a deadlock. This can be controlled in your code, but not in a third-party library.

----------
components: Interpreter Core
messages: 344891
nosy: Roffild
priority: normal
severity: normal
status: open
title: Everyone uses GIL wrong! = DEADLOCK
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37186>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:35:08 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 00:35:08 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559867708.44.0.432352649933.issue37176@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

The docs do say what super does: it returns "a proxy object that delegates method calls to a parent or sibling class of type", just as you quoted. That concise description is (almost) completely accurate and precise.

(I say *almost* because it's not just method calls that it works with, but any attribute lookup.)

What more do you want? That's not a rhetorical question.

I'm not saying that the docs are perfect or cannot be improved, but they look pretty good to me: they tell you what super does, they tell you why you might use it, and show how to use it. What's missing?

(Again, not a rhetorical question.)

I understand that super is a very advanced corner of the language: there's a lot of necessary technical jargon in the docs:

- One already needs to have a good understanding of what super *does* in order to make sense of the sentence describing what it *is*, so there's an element of circular reasoning needed.

- The reader needs to understand that super isn't magical, it just returns an object like any other function, and understand what "proxy object" means, as well as delegation.

- And have an understanding of how inheritance and the MRO work in Python, and the difference between bound and unbound methods/proxies.

But to the experienced reader who knows these concepts, I'm having a hard time seeing what you believe is missing from the docs.

Perhaps there ought to be a "gentle guide to super" somewhere, and the docs could link to that?

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:36:30 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 00:36:30 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559867790.81.0.672231524223.issue37176@roundup.psfhosted.org>


Change by Steven D'Aprano <steve+python at pearwood.info>:


----------
Removed message: https://bugs.python.org/msg344892

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:37:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 00:37:16 +0000
Subject: [issue37186] Everyone uses GIL wrong! = DEADLOCK
In-Reply-To: <1559865784.82.0.0210813088917.issue37186@roundup.psfhosted.org>
Message-ID: <1559867836.59.0.668745304644.issue37186@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +eric.snow, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37186>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:39:55 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 00:39:55 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559867995.12.0.988893524232.issue37176@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

The docs do say what super does: it returns "a proxy object that delegates method calls to a parent or sibling class of type", just as you quoted. That concise description is (almost) completely accurate and precise.

(I say *almost* because it's not just method calls that it works with, but any attribute lookup.)

What more do you want? That's not a rhetorical question.

I'm not saying that the docs are perfect or cannot be improved, but they look pretty good to me: they tell you what super does, they tell you why you might use it, and show how to use it. What's missing? Again, not a rhetorical question.

I understand that super is a very advanced corner of the language: there's a lot of necessary technical jargon in the docs, e.g.:

- One already needs to have a good understanding of what super *does* in order to make sense of the sentence describing what it *is*, so there's an element of circular reasoning needed.

- The reader needs to understand that super isn't magical, it just returns an object like any other function, and understand what "proxy object" means, as well as delegation.

- And have an understanding of how inheritance and the MRO work in Python, and the difference between bound and unbound methods/proxies.

I think that to the experienced reader who knows these concepts, the docs should be pretty clear and complete.

I'm having a hard time seeing what you believe is missing from the docs. Can you explain further?

Perhaps there ought to be a "gentle guide to super" somewhere, and the docs could link to that?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Thu Jun  6 20:50:12 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 07 Jun 2019 00:50:12 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559868612.96.0.552445883662.issue37176@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> It only says "Return a proxy object that delegates method 
> calls to a parent or sibling class of type" and then gives
> a bunch of use cases and examples."  

That wording seems very reasonable to me.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Thu Jun  6 21:24:14 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 07 Jun 2019 01:24:14 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
In-Reply-To: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>
Message-ID: <1559870654.33.0.795312276627.issue37184@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Thu Jun  6 23:46:36 2019
From: report at bugs.python.org (Eric Wieser)
Date: Fri, 07 Jun 2019 03:46:36 +0000
Subject: [issue37187] CField.size from the ctypes module does not behave as
 documented on bitfields
Message-ID: <1559879196.85.0.0861364976154.issue37187@roundup.psfhosted.org>


New submission from Eric Wieser <wieser.eric at gmail.com>:

This behavior is pretty surprising:

```python
import ctypes

class Simple(ctypes.Structure):
    _fields_ = [
        ('a', ctypes.c_uint8),
        ('b', ctypes.c_uint8),
    ]

class Bitfields(ctypes.Structure):
    _fields_ = [
        ('a', ctypes.c_uint8, 8),
        ('b', ctypes.c_uint8, 8),
    ]

print(Simple.b.size)     # 1
print(Bitfields.b.size)  # 262148
```

The docstring for this field, from `help(type(Bitfields.b).size)`, is:

> Help on getset descriptor _ctypes.CField.size:
>
> size
>    size in bytes of this field

So either the behavior or the docstring needs to change.

----------
assignee: docs at python
components: Documentation
messages: 344895
nosy: Eric Wieser, docs at python
priority: normal
severity: normal
status: open
title: CField.size from the ctypes module does not behave as documented on bitfields

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37187>
_______________________________________

From report at bugs.python.org  Fri Jun  7 00:28:52 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 04:28:52 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1559881732.77.0.56333660371.issue37163@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

+1 to Serhiy's proposal

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Fri Jun  7 00:56:56 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 07 Jun 2019 04:56:56 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559883416.59.0.317764287446.issue37162@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

@staticmethod
    def _switch_path(path):
        from contextlib import suppress
        import zipfile
        from pathlib import Path
        with suppress(Exception):
            return zipfile.Path(path)
        return Path(path)

Oh, I did not know about zipfile.Path!

I do not think this is a correct solution. It does not work with general loaders. I think that it would be more correct to override some methods in zipimport.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Fri Jun  7 01:22:25 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 07 Jun 2019 05:22:25 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1559884945.82.0.869978003171.issue37163@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +13755
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13877

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Fri Jun  7 01:54:43 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 05:54:43 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559886883.01.0.0846789333963.issue37177@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:


New changeset 554450fb4e95066e825bdb4a2d544a490daeebdc by Tal Einat in branch 'master':
bpo-37177: make IDLE's search dialogs transient (GH-13869)
https://github.com/python/cpython/commit/554450fb4e95066e825bdb4a2d544a490daeebdc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 01:55:04 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 05:55:04 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559886904.11.0.615441538859.issue37177@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13756
pull_request: https://github.com/python/cpython/pull/13878

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 01:55:11 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 05:55:11 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559886911.26.0.558528859672.issue37177@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13757
pull_request: https://github.com/python/cpython/pull/13879

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:08:17 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 06:08:17 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559887697.02.0.868746387865.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
pull_requests: +13758
pull_request: https://github.com/python/cpython/pull/13880

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:09:51 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 06:09:51 +0000
Subject: [issue24039] Idle: some modal dialogs maximize, don't minimize
In-Reply-To: <1429811337.7.0.183903934829.issue24039@psf.upfronthosting.co.za>
Message-ID: <1559887791.88.0.0840083012431.issue24039@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
versions: +Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24039>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:17:16 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 06:17:16 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559888236.08.0.804979424192.issue37177@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 295fe32e393280464feef7c6fb616ea2d1e73e37 by Miss Islington (bot) in branch '3.8':
bpo-37177: make IDLE's search dialogs transient (GH-13869)
https://github.com/python/cpython/commit/295fe32e393280464feef7c6fb616ea2d1e73e37


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:18:44 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 07 Jun 2019 06:18:44 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559888324.55.0.297211508807.issue33826@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:37:35 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 06:37:35 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559889455.85.0.902473573119.issue37177@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 685b806549cc956aeeb3a57fe15ee5a4d1704aed by Miss Islington (bot) in branch '3.7':
bpo-37177: make IDLE's search dialogs transient (GH-13869)
https://github.com/python/cpython/commit/685b806549cc956aeeb3a57fe15ee5a4d1704aed


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:41:34 2019
From: report at bugs.python.org (Eric Wieser)
Date: Fri, 07 Jun 2019 06:41:34 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
Message-ID: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>


New submission from Eric Wieser <wieser.eric at gmail.com>:

Introduced in the fix to bpo-36504, GH-12660.

```python
>>> (ctypes.c_uint8 * 0 * 2)()
Fatal Python error: Floating point exception

>>> struct Empty(ctypes.Structure): _fields_ = []
>>> (Empty * 2)()
Fatal Python error: Floating point exception
```

This used to work just fine

----------
messages: 344901
nosy: Eric Wieser, ZackerySpytz
priority: normal
severity: normal
status: open
title: Creating a ctypes array of an element with size zero causes "Fatal Python error: Floating point exception"
type: crash
versions: Python 2.7, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:48:35 2019
From: report at bugs.python.org (Eric Wieser)
Date: Fri, 07 Jun 2019 06:48:35 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559890115.62.0.0111691726785.issue37188@roundup.psfhosted.org>


Change by Eric Wieser <wieser.eric+pybug at gmail.com>:


----------
keywords: +patch
pull_requests: +13759
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13881

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:51:01 2019
From: report at bugs.python.org (Eric Wieser)
Date: Fri, 07 Jun 2019 06:51:01 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559890261.64.0.337191732422.issue37188@roundup.psfhosted.org>


Change by Eric Wieser <wieser.eric at gmail.com>:


----------
components: +ctypes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:51:30 2019
From: report at bugs.python.org (Eric Wieser)
Date: Fri, 07 Jun 2019 06:51:30 +0000
Subject: [issue37187] CField.size from the ctypes module does not behave as
 documented on bitfields
In-Reply-To: <1559879196.85.0.0861364976154.issue37187@roundup.psfhosted.org>
Message-ID: <1559890290.44.0.896939573026.issue37187@roundup.psfhosted.org>


Change by Eric Wieser <wieser.eric at gmail.com>:


----------
components: +ctypes
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37187>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:53:08 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 06:53:08 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559890388.1.0.521610525683.issue37177@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:


New changeset 1b57ab5c6478b93cf4150bd8c475022252776598 by Tal Einat in branch '2.7':
[2.7] bpo-37177: make IDLE's search dialogs transient (GH-13869)
https://github.com/python/cpython/commit/1b57ab5c6478b93cf4150bd8c475022252776598


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:53:57 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 06:53:57 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559890437.45.0.161619738133.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 02:56:48 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 06:56:48 +0000
Subject: [issue24039] Idle: some modal dialogs maximize, don't minimize
In-Reply-To: <1429811337.7.0.183903934829.issue24039@psf.upfronthosting.co.za>
Message-ID: <1559890608.61.0.546871959899.issue24039@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

The search dialog windows are now made transient relative to the editor window.  Among other things, they no longer have minimize/maximize buttons on Windows, resolving this issue.

----------
nosy: +taleinat
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24039>
_______________________________________

From report at bugs.python.org  Fri Jun  7 03:08:21 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 07:08:21 +0000
Subject: [issue35954] Incoherent type conversion in configparser
In-Reply-To: <1549801714.53.0.77041525212.issue35954@roundup.psfhosted.org>
Message-ID: <1559891301.91.0.29386670792.issue35954@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

This is indeed inconsistent, but it's a minor issue that has been this way for a long time and is easily worked around. IMO changing it would create more problems than leaving it as-is.

IMO we should at most clarify in the docs.

----------
nosy: +taleinat
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35954>
_______________________________________

From report at bugs.python.org  Fri Jun  7 03:55:23 2019
From: report at bugs.python.org (Christoph Gohlke)
Date: Fri, 07 Jun 2019 07:55:23 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
Message-ID: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>


New submission from Christoph Gohlke <cgohlke at uci.edu>:

While testing third party packages on Python 3.8.0b1 for Windows, I noticed that the `PyRun_String` function is no longer exported from `python38.dll`.

Is this intentional? I can't see this mentioned at <https://docs.python.org/3.8/whatsnew/3.8.html> or <https://docs.python.org/3.8/c-api/veryhigh.html#c.PyRun_String>

This change breaks existing code. But then `PyRun_String` is easy to replace with `PyRun_StringFlags`.

----------
components: Windows
messages: 344905
nosy: cgohlke, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: PyRun_String not exported in python38.dll
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:00:34 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 08:00:34 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559894434.84.0.594018142015.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> What more do you want?

Mainly: it says "a parent or sibling class of *type*" but it doesn't explain which class it actually uses.

And the sentence "The __mro__ attribute of the type lists the method resolution search order used by both getattr() and super()" is even wrong or at least confusing: what matters is not the MRO of the type (the first argument to super()) but the MRO of the object (the second argument to super()).

The zero-argument form super() is not explained at all.

> Perhaps there ought to be a "gentle guide to super" somewhere, and the docs could link to that?

There are plenty of guides like that and in fact that docs already link to https://rhettinger.wordpress.com/2011/05/26/super-considered-super/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:13:57 2019
From: report at bugs.python.org (Stefan Krah)
Date: Fri, 07 Jun 2019 08:13:57 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559895237.92.0.00449112850191.issue37188@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:


New changeset 0690c79c419b8d2bdfe7c5b6dca57b018f5a5a54 by Stefan Krah (Eric Wieser) in branch 'master':
bpo-37188: Fix a divide-by-zero in arrays of size-0 objects (#13881)
https://github.com/python/cpython/commit/0690c79c419b8d2bdfe7c5b6dca57b018f5a5a54


----------
nosy: +skrah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:15:10 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 08:15:10 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559895310.16.0.714718563647.issue37188@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13760
pull_request: https://github.com/python/cpython/pull/13882

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:34:19 2019
From: report at bugs.python.org (Stefan Krah)
Date: Fri, 07 Jun 2019 08:34:19 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559896459.47.0.875886075832.issue37188@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:


New changeset 8f0bbbdcae73f275faff90cc4559f6111116f001 by Stefan Krah (Miss Islington (bot)) in branch '3.7':
bpo-37188: Fix a divide-by-zero in arrays of size-0 objects (GH-13881) (#13882)
https://github.com/python/cpython/commit/8f0bbbdcae73f275faff90cc4559f6111116f001


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:42:16 2019
From: report at bugs.python.org (Michael Felt)
Date: Fri, 07 Jun 2019 08:42:16 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1559840930.23.0.177258328716.issue36624@roundup.psfhosted.org>
Message-ID: <d3f64c50-fad9-33a0-e840-2eca4259b866@felt.demon.nl>


Michael Felt <aixtools at felt.demon.nl> added the comment:

On 06/06/2019 19:08, Steve Dower wrote:
> Steve Dower <steve.dower at python.org> added the comment:
>
> Changing our policy here (from "no policy" to "here's a recommendation") probably deserves a python-dev discussion first.
I can rejoin the list - to follow the discussion, should one start.
> ----------
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue36624>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Fri Jun  7 04:57:50 2019
From: report at bugs.python.org (=?utf-8?q?Radu_Matei_L=C4=83craru?=)
Date: Fri, 07 Jun 2019 08:57:50 +0000
Subject: [issue37190] asyncio.iscoroutinefunction(<async_generator>.asend)
 returns False
Message-ID: <1559897870.46.0.572165023126.issue37190@roundup.psfhosted.org>


New submission from Radu Matei L?craru <radu.lacraru97 at gmail.com>:

asyncio.iscoroutinefunction(<async_generator>.__anext__)
asyncio.iscoroutinefunction(<async_generator>.asend)
asyncio.iscoroutinefunction(<async_generator>.athrow)
asyncio.iscoroutinefunction(<async_generator>.aclose)

All of these return False, is this the intended behavior? Aren't all of these in fact coroutine functions?

----------
components: asyncio
messages: 344910
nosy: Radu Matei L?craru, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: asyncio.iscoroutinefunction(<async_generator>.asend) returns False
type: behavior
versions: Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37190>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:04:19 2019
From: report at bugs.python.org (Michael Felt)
Date: Fri, 07 Jun 2019 09:04:19 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559898259.98.0.294721352867.issue36656@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
nosy: +Michael.Felt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:09:29 2019
From: report at bugs.python.org (Robert Collins)
Date: Fri, 07 Jun 2019 09:09:29 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559898569.92.0.252381878123.issue36656@roundup.psfhosted.org>


Robert Collins <robertc at robertcollins.net> added the comment:

Thank you @Eryk

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:13:57 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 07 Jun 2019 09:13:57 +0000
Subject: [issue37191] Python.h contains intermingled declarations
Message-ID: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>


New submission from Petr Viktorin <encukou at gmail.com>:

When compiled with GCC's -Werror=declaration-after-statement ("intermingled declarations" in PEP7), cpython/abstract.h (included from <Python.h>) errors on vectorcall helper functions added in 3.8.0 Beta 1.

It's well within our rights to ignore this: since 3.6 we require intermingled declarations.
But, when re-compiling Fedora we've seen several projects fail with this warning (so far: pygobject3, python-dbus, xen; more will likely come).

Dear Release Manager, should we patch 3.8 to avoid this? The patch is simple, and it would give projects that we(re) dutifully tested with the Alphas one more release to adapt.

I don't think it's worth changing for 3.9 (but if we do we should test it).

----------
messages: 344912
nosy: lukasz.langa, petr.viktorin
priority: normal
severity: normal
status: open
title: Python.h contains intermingled declarations
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:14:06 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 09:14:06 +0000
Subject: [issue24039] Idle: some modal dialogs maximize, don't minimize
In-Reply-To: <1429811337.7.0.183903934829.issue24039@psf.upfronthosting.co.za>
Message-ID: <1559898846.54.0.668692876967.issue24039@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions:  -Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24039>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:16:20 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 09:16:20 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559898980.73.0.966198739922.issue37177@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Irv's steps did not work for me either, on Windows, and I do not know how else to reproduce.  So I cannot test that this fixes any hiding issue.  However, the patch fixes #24039.  On Windows, it removes the inoperative minimize button and the unwanted maximize buttom, making the search dialog work like all the other IDLE dialogs I checked.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:20:28 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 07 Jun 2019 09:20:28 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559899228.78.0.874343183882.issue37191@roundup.psfhosted.org>


Change by Petr Viktorin <encukou at gmail.com>:


----------
keywords: +patch
pull_requests: +13761
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13887

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:22:57 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Fri, 07 Jun 2019 09:22:57 +0000
Subject: [issue36624] cleanup the stdlib and tests with regard to sys.platform
 usage
In-Reply-To: <1555158343.77.0.950141438455.issue36624@roundup.psfhosted.org>
Message-ID: <1559899377.52.0.414465566606.issue36624@roundup.psfhosted.org>


Change by Kubilay Kocak <koobs.freebsd at gmail.com>:


----------
nosy: +koobs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36624>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:27:03 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 07 Jun 2019 09:27:03 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559899623.49.0.581136689067.issue37191@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

> pygobject3, python-dbus, xen

Correction:
- The Fedora packages failed to build; this might or might not be due to the projects themseves
- pygobject3 actually only warns on this

Anyway, we can usually take care of open-source stuff. Only take it as a litmus test for codebases we don't know about.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:39:45 2019
From: report at bugs.python.org (Michael Felt)
Date: Fri, 07 Jun 2019 09:39:45 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1559900385.62.0.984895898584.issue36656@roundup.psfhosted.org>


Michael Felt <aixtools at felt.demon.nl> added the comment:

I started a reply on the python-mentoring maillist - and promised to come back here.

a) imho - the discussion about an "attacker" is only misleading for the general case. For active attacks - where an attacker has active acces to the system is not something that is the responsibility of "stdlib". On POSIX, one of the first things I would consider is adding the "STX" bit so that only root and the file owner can remove an existing "link" to an inode (a symbolic link is a "special" file whose contents is the PATH to yet another filesystem "name" regardless of it's type.) For reference, a hard-link "merely" increases the number of links to an inode - and so only works for non-directory objects within the same filesystem). Puf!

b) the "real", again imho, security issue is one of system integrity. Compare this "race" condition with a multi-user database (think of directories as the "index" to a data-record. A user that trusts the file-system index to refer to the correct file-system object (file, directory, other special file) - especially when there is no way for the user to verify the accuracy of the symbolic link. Any application, especially if it runs as "root" needs to be extremely cautious with "overwriting" existing "records". It is asif as database admin just changes where one database record references - as is, I cannot change the data it references - so I just change what it goes to - where I can change the data. -- As I think about it - an application that is dependent on symbolic links has an inherent weakness.

In short - I would be against this - if security is the primary argument for developing it. I would rather be notified that there is an existing symbolic link - where there should not be - and consider later action.

a) an application, running as root, can override any security measure I can come up with. The is the core "weakness" of UNIX/POSIX access control. When not running as root - there are mechanisms that can block the removal of any directory entry (the unlink() call).

b) so, if you want to consider adding a "user-friendly" force option, just as POSIX ln does (whether for hard or soft links) - then that is, imho - a different discussion. I would tend to be "against" making it too easy, because an application coded with "Force=true" would never get the feedback that something already exists. If the currect implementation returns the a "fatal" error - that needs to be fixed.

In short, I do not think it is the task of Python to rewrite the behavior of the system calls being used - and/because I fear lazy programmers (being there, done that!).

"ls -sf xxx yyy" and/or "ln -f xxx yyy" is a convenience. Using it as a default is "bad-practice" (imho) - and I fear programmers would use this new "feature" and move to "bad practice"

Michael

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:50:09 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 09:50:09 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559894434.84.0.594018142015.issue37176@roundup.psfhosted.org>
Message-ID: <20190607095000.GK4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Fri, Jun 07, 2019 at 08:00:34AM +0000, Jeroen Demeyer wrote:
> 
> Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:
> 
> > What more do you want?
> 
> Mainly: it says "a parent or sibling class of *type*" but it doesn't 
> explain which class it actually uses.

Only one of the two arguments is called "type". The other is called 
"object-or-type".

> And the sentence "The __mro__ attribute of the type lists the method 
> resolution search order used by both getattr() and super()" is even 
> wrong or at least confusing: what matters is not the MRO of the type 
> (the first argument to super()) but the MRO of the object (the second 
> argument to super()).

The sentence doesn't talk about the MRO of *type* (the first argument), 
it talks about the __mro__ attribute. It is correct. The __mro__ 
attribute is on the type, not the instance:

py> int.__mro__
(<class 'int'>, <class 'object'>)

py> int().__mro__
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: 'int' object has no attribute '__mro__'

super() look-ups never start at the instance, they delegate to the 
superclass (or superclasses), not back to the current class, or the 
instance itself.

> The zero-argument form super() is not explained at all.

Yes it is. Look at the example given:

    super().method(arg)    # This does the same thing as:
                           # super(C, self).method(arg)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:51:22 2019
From: report at bugs.python.org (Stefan Krah)
Date: Fri, 07 Jun 2019 09:51:22 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559901082.89.0.219361660114.issue37188@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:

Thanks for the fix!

3.7/3.8 are done, 2.7 still needs a manual backport.

----------
versions:  -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:51:40 2019
From: report at bugs.python.org (Stefan Krah)
Date: Fri, 07 Jun 2019 09:51:40 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559901100.21.0.0673526557432.issue37188@roundup.psfhosted.org>


Change by Stefan Krah <stefan at bytereef.org>:


----------
stage: patch review -> backport needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 05:57:11 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 09:57:11 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559901431.74.0.0354897681455.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Only one of the two arguments is called "type". The other is called 
"object-or-type".

I'm having problems with the first word of "a parent or sibling class of type". The most important part of super() is to *which* class that attribute lookups are delegated to and this is not explained.

> The __mro__ attribute is on the type, not the instance:

Sorry for that. I meant to say:

And the sentence "The __mro__ attribute of the type lists the method resolution search order used by both getattr() and super()" is even wrong or at least confusing: what matters is not the MRO of the type (the first argument to super()) but the MRO of ***the type of*** the object (the second argument to super()).

> Yes it is. Look at the example given:

An example is not an explanation. But it's true, this is the least of my problems with this doc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 06:00:45 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 10:00:45 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559901645.61.0.0290471616991.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> The sentence doesn't talk about the MRO of *type* (the first argument), 
it talks about the __mro__ attribute.

If you have to explain in a bpo issue how the doc should be read, that proves exactly my point that it's confusing. The fact that it's technically correct if you read it the right way is irrelevant.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 06:20:38 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 07 Jun 2019 10:20:38 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1559902838.57.0.15498616227.issue37151@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 3f345c39255dc3823dd989d4e3c93b12d18c44e0 by Petr Viktorin (Jeroen Demeyer) in branch 'master':
bpo-37151: simplify classmethoddescr_call (GH-13340)
https://github.com/python/cpython/commit/3f345c39255dc3823dd989d4e3c93b12d18c44e0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Fri Jun  7 06:24:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 10:24:44 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559903084.5.0.10482361752.issue37169@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13762
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13888

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun  7 06:53:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 10:53:05 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1559904785.75.0.0357605460482.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13763
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13889

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Fri Jun  7 06:56:55 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Fri, 07 Jun 2019 10:56:55 +0000
Subject: [issue37187] CField.size from the ctypes module does not behave as
 documented on bitfields
In-Reply-To: <1559879196.85.0.0861364976154.issue37187@roundup.psfhosted.org>
Message-ID: <1559905015.92.0.265272653212.issue37187@roundup.psfhosted.org>


Michele Angrisano <michele.angrisano at gmail.com> added the comment:

Hi Eric,

Thank you for the report.
Would you interested to propose a Pull Request for this issue?
You can read the devguide for more info: https://devguide.python.org/

----------
nosy: +amaury.forgeotdarc, belopolsky, mangrisano, meador.inge

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37187>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:00:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 11:00:19 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1559905219.95.0.653226520734.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote PR 13889: with this change, I can easily reproduce the crash on Linux:

$ ./python -m test test_threading -m test_threads_join_2 -F
Run tests sequentially
0:00:00 load avg: 0.51 [  1] test_threading
Fatal Python error: Py_EndInterpreter: not the last thread

Current thread 0x00007f84ad74d740 (most recent call first):
  File "/home/vstinner/prog/python/master/Lib/test/support/__init__.py", line 2794 in run_in_subinterp
  File "/home/vstinner/prog/python/master/Lib/test/test_threading.py", line 923 in test_threads_join_2
...

Py_EndInterpreter() calls wait_for_thread_shutdown() to wait until threading._shutdown() completes.

When the assertion fails, threading.enumerate() only contains the main thread: the spawned thread is already gone. But the assertion fails, which means that the Python thread state of the thread (which looks to be completed) is still around.

This unit test comes from bpo-18808:

commit 7b4769937fb612d576b6829c3b834f3dd31752f1
Author: Antoine Pitrou <solipsis at pitrou.net>
Date:   Sat Sep 7 23:38:37 2013 +0200

    Issue #18808: Thread.join() now waits for the underlying thread state to be destroyed before returning.
    This prevents unpredictable aborts in Py_EndInterpreter() when some non-daemon threads are still running.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:00:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 11:00:36 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1559905236.29.0.831235919016.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +eric.snow, pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:34:29 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 11:34:29 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559901431.74.0.0354897681455.issue37176@roundup.psfhosted.org>
Message-ID: <20190607113422.GL4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Fri, Jun 07, 2019 at 09:57:11AM +0000, Jeroen Demeyer wrote:

> I'm having problems with the first word of "a parent or sibling class of type". 

The first word is "a". Did you mean something else or did you mean it 
literally?

If the second case, we have to talk about *a* parent class rather than 
*the* parent class, since Python supports multiple inheritance and a 
class can have more than one parent class.

> The most important part of super() is to *which* class that attribute 
> lookups are delegated to and this is not explained.

Lookups are delegated to a parent or sibling class, exactly as the 
documentation says. Which class that is (whether a parent or sibling) 
can only be determined at runtime.

> And the sentence "The __mro__ attribute of the type lists the method 
> resolution search order used by both getattr() and super()" is even 
> wrong or at least confusing: what matters is not the MRO of the type 
> (the first argument to super()) but the MRO of ***the type of*** the 
> object (the second argument to super()).

I believe that is still wrong.

What matters is the __mro__ attribute of the first argument. It matters 
because that is how the MRO actually is searched.

The MRO of the second argument is not relevant, except to the degree 
that it overlaps with the __mro__ attribute of the first. And it will 
always overlaps, because the second argument must be an instance or 
subclass of the first. But not necessarily *directly* of the first:

object > Parent > A > B > C > D > E > F > instance = F()

If the method is defined in class C, then the super call in C should be 
written:

    class C(B):
        def method(self, arg):
            super().method(arg)  # like super(C, self).method(arg)

and the lookup will start at C.__mro__[1], namely B, precisely as 
expected. If it started back at the type of the instance (self), namely 
class F, the C.method would recursively call itself over and over and 
over again.

If you don't believe me, you can simulate super() working the way you 
suggest by doing this:

# -----%<-----

class A(object):
    def method(self):
        print("from class A")

class B(A):
    def method(self):
        print("bad method")
        # This is bad, don't do it!
        super(type(self), self).method()

class C(B): pass

C().method()

# -----%<-----

For multiple inheritance:

    class C(B, X, Y, Z): ...

we can't generally tell in advance which will be looked at next, since 
that depends on the precise details of the inheritance diagram. But 
whatever the class is, at this point, it is still the __mro__ of C that 
is used, not the MRO of the instance.

The bottom line: what matters is <first argument>.__mro__, exactly as 
documented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:39:17 2019
From: report at bugs.python.org (Alen Kolman)
Date: Fri, 07 Jun 2019 11:39:17 +0000
Subject: [issue37192] pip instal math3d - EROR
Message-ID: <1559907557.33.0.540342882272.issue37192@roundup.psfhosted.org>


New submission from Alen Kolman <alenkolman at gmail.com>:

I am geting constant eror while trying to isntal math3d or urx libary for Python using pip install. I am using Windows 10 and Python 3.7.3

I tried to: - unistall/instal python and also try older version 3.4.4.. nothing work - upgrade setuptools - upgrade pip (then I get even more errors)

Here is my error:
C:\Python34\Scripts>pip install math3d
Collecting math3d
  Using cached https://files.pythonhosted.org/packages/9a/33/72ac95bb4ac11a2b13e033d90f84430dc23fc815124d9303dffca8789a75/math3d-3.3.4.tar.gz
Installing collected packages: math3d
  Running setup.py install for math3d ... error
    Complete output from command c:\python34\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\ALEN~1.KOL\\AppData\\Local\\Temp\\pip-install-duiwypg9\\math3d\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\ALEN~1.KOL\AppData\Local\Temp\pip-record-cmd8m8g6\install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    creating build
    creating build\lib
    creating build\lib\math3d
    copying math3d\orientation.py -> build\lib\math3d
    copying math3d\orientation_computer.py -> build\lib\math3d
    copying math3d\quaternion.py -> build\lib\math3d
    copying math3d\transform.py -> build\lib\math3d
    copying math3d\utils.py -> build\lib\math3d
    copying math3d\vector.py -> build\lib\math3d
    copying math3d\__init__.py -> build\lib\math3d
    creating build\lib\math3d\interpolation
    copying math3d\interpolation\r3interpolation.py -> build\lib\math3d\interpolation
    copying math3d\interpolation\se3interpolation.py -> build\lib\math3d\interpolation
    copying math3d\interpolation\so3interpolation.py -> build\lib\math3d\interpolation
    copying math3d\interpolation\__init__.py -> build\lib\math3d\interpolation
    creating build\lib\math3d\reference_system
    copying math3d\reference_system\frame.py -> build\lib\math3d\reference_system
    copying math3d\reference_system\free_vector.py -> build\lib\math3d\reference_system
    copying math3d\reference_system\point.py -> build\lib\math3d\reference_system
    copying math3d\reference_system\reference_system.py -> build\lib\math3d\reference_system
    copying math3d\reference_system\__init__.py -> build\lib\math3d\reference_system
    creating build\lib\math3d\dynamics
    copying math3d\dynamics\twist.py -> build\lib\math3d\dynamics
    copying math3d\dynamics\wrench.py -> build\lib\math3d\dynamics
    copying math3d\dynamics\__init__.py -> build\lib\math3d\dynamics
    creating build\lib\math3d\geometry
    copying math3d\geometry\line.py -> build\lib\math3d\geometry
    copying math3d\geometry\plane.py -> build\lib\math3d\geometry
    copying math3d\geometry\__init__.py -> build\lib\math3d\geometry
    running install_lib
    running install_data
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "C:\Users\ALEN~1.KOL\AppData\Local\Temp\pip-install-duiwypg9\math3d\setup.py", line 23, in <module>
        data_files=[('share/doc/pymath3d/', ['README.md', 'COPYING'])]
      File "c:\python34\lib\distutils\core.py", line 148, in setup
        dist.run_commands()
      File "c:\python34\lib\distutils\dist.py", line 966, in run_commands
        self.run_command(cmd)
      File "c:\python34\lib\distutils\dist.py", line 985, in run_command
        cmd_obj.run()
      File "c:\python34\lib\site-packages\setuptools\command\install.py", line 61, in run
        return orig.install.run(self)
      File "c:\python34\lib\distutils\command\install.py", line 557, in run
        self.run_command(cmd_name)
      File "c:\python34\lib\distutils\cmd.py", line 313, in run_command
        self.distribution.run_command(command)
      File "c:\python34\lib\distutils\dist.py", line 985, in run_command
        cmd_obj.run()
      File "c:\python34\lib\distutils\command\install_data.py", line 56, in run
        dir = convert_path(f[0])
      File "c:\python34\lib\distutils\util.py", line 112, in convert_path
        raise ValueError("path '%s' cannot end with '/'" % pathname)
    ValueError: path 'share/doc/pymath3d/' cannot end with '/'

    ----------------------------------------
Command "c:\python34\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\ALEN~1.KOL\\AppData\\Local\\Temp\\pip-install-duiwypg9\\math3d\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\ALEN~1.KOL\AppData\Local\Temp\pip-record-cmd8m8g6\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\ALEN~1.KOL\AppData\Local\Temp\pip-install-duiwypg9\math3d\

----------
components: Installation
messages: 344924
nosy: Alen Kolman
priority: normal
severity: normal
status: open
title: pip instal math3d - EROR
type: compile error
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37192>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:50:07 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 07 Jun 2019 11:50:07 +0000
Subject: [issue37192] pip instal math3d - EROR
In-Reply-To: <1559907557.33.0.540342882272.issue37192@roundup.psfhosted.org>
Message-ID: <1559908207.78.0.116759917104.issue37192@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This tracker is only for issues related to CPython. math3d is not a part of CPython stdlib. I would suggest following up on the respective repo's issue tracker.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37192>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:51:37 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 07 Jun 2019 11:51:37 +0000
Subject: [issue37192] pip instal math3d - EROR
In-Reply-To: <1559907557.33.0.540342882272.issue37192@roundup.psfhosted.org>
Message-ID: <1559908297.68.0.713562621296.issue37192@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37192>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:53:39 2019
From: report at bugs.python.org (Norihiro Maruyama)
Date: Fri, 07 Jun 2019 11:53:39 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
Message-ID: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>


New submission from Norihiro Maruyama <norihiro.maruyama at gmail.com>:

UDP/TCPServer with socketserver.ThreadingMixin class (also ThreadingTCPServer and ThreadingUDPServer class) seems to be memory leak while running the server.

https://docs.python.org/3/library/socketserver.html#socketserver.ThreadingMixIn

My code which wrote to check this is the following.

```
class ThreadedTCPRequestHandler(socketserver.BaseRequestHandler):
    def handle(self):
        data = str(self.request.recv(1024), 'ascii')
        cur_thread = threading.current_thread()
        response = bytes("{}: {}".format(cur_thread.name, data), 'ascii')
        self.request.sendall(response)


if __name__ == "__main__":
    HOST, PORT = "localhost", 0

    server = socketserver.ThreadingTCPServer((HOST, PORT), ThreadedTCPRequestHandler)
    server.daemon_threads = False
    server.block_on_close = True

    with server:
        ip, port = server.server_address

        server_thread = threading.Thread(target=server.serve_forever)

        server_thread.daemon = True
        server_thread.start()

        for i in range(1000):
            with socket.socket(socket.AF_INET, socket.SOCK_STREAM) as sock:
                sock.connect(server.server_address)
                sock.sendall(bytes("hello", 'ascii'))
                response = str(sock.recv(1024), 'ascii')
                print("Received: {}".format(response))
            time.sleep(0.01)

        server.server_close()
        server.shutdown()
```
( I wrote this based on https://docs.python.org/3/library/socketserver.html#asynchronous-mixins)

Then I checked memory usage with profiling tool.
(I used memory-profiler module https://pypi.org/project/memory-profiler/)

$ mprof run python mycode.py
$ mprof plot

I attached result plot.

And also I checked this also more long time and I found memory usage was increased endlessly.

My environment is

Hardware: MacBook Pro (15-inch, 2018)
OS: MacOS 10.14
Python 3.7.1


I guess it caused by a thread object is not released in spite of the thread finished to process request and thread object will be made infinitely until server_close() is called.

----------
components: Library (Lib)
files: threadingmixin_memory_usage.png
messages: 344926
nosy: maru-n
priority: normal
severity: normal
status: open
title: Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn
type: resource usage
versions: Python 3.7
Added file: https://bugs.python.org/file48399/threadingmixin_memory_usage.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:54:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 11:54:00 +0000
Subject: [issue37194] Move new vector headers to the internal C API
Message-ID: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

bpo-37191: the new vector APIs declare "static inline" functions which are no C89 compatible and so cause compilation issues on pygobject3, python-dbus, xen (for example).

I propose to move the new *private* declarations to the internal C API.

I started to work on an application. The blocker issue is _PyObject_CallNoArg() which is now commonly used in CPython code base for best performances. It is used the _testcapi which must *not* be compiled with the internal C API.

So I suggest to first add a new public PyObject_CallNoArg() function. It would be different than _PyObject_CallNoArg() static inline function: PyObject_CallNoArg() would be a regular function and so fit better with ABI issues.

----------
components: Interpreter Core
messages: 344927
nosy: vstinner
priority: normal
severity: normal
status: open
title: Move new vector headers to the internal C API
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:55:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 11:55:22 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559908522.22.0.456307994492.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: Move new vector headers to the internal C API -> Move new vector private declarations to the internal C API

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 07:55:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 11:55:29 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559908529.57.0.783874329767.issue37191@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

PR 13887 is fine but I would prefer to still be able to use C99 style for variable declarations. More generally, I don't think that variable declaration is the only issue: static inline function is a new shiny thing which can cause other issues with some C compilers. So I propose a different approach, bpo-37194: "Move new vector private declarations to the internal C API".

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:04:23 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 12:04:23 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559909063.65.0.885423003861.issue37194@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> I propose to move the new *private* declarations to the internal C API.

Some of those functions (in particular _PyObject_Vectorcall) are expected to become public in 3.9. They are only private for now since the API is provisional.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:05:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 12:05:55 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559909155.67.0.392187342021.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13764
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13890

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:24:49 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 12:24:49 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559901645.61.0.0290471616991.issue37176@roundup.psfhosted.org>
Message-ID: <20190607122440.GM4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> If you have to explain in a bpo issue how the doc should be read, that 
> proves exactly my point that it's confusing. The fact that it's 
> technically correct if you read it the right way is irrelevant.

Do you expect the docs to be technically correct when read wrongly? How 
else should people read the docs, except the right way?

If you have *concrete* suggestions for improvements, of course we will 
consider them. I'll start with two concrete improvements:

1. Explicitly document that the zero-argument version is equivalent
to super(__class__, <first argument (usually self)>), and note that 
__class__ here is a special variable populated by the compiler.

The first part of this is already documented in super.__doc__ and the 
second part used to be documented:

https://docs.python.org/3.1/library/functions.html?#super

and I don't think there's any harm in adding it back in.

2. Link to the essay on how the MRO is calculated.

https://www.python.org/download/releases/2.3/mro/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:26:29 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 12:26:29 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559910389.74.0.727961640102.issue37191@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Should we revert these inline functions back to macros?

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:29:15 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 12:29:15 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559910555.79.0.238778691738.issue37191@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> It's well within our rights to ignore this: since 3.6 we require intermingled declarations.

It's not clear from PEP 7 if we require intermingled declarations only when compiling CPython itself, or also for external packages that include CPython headers. It would be prudent to stay C89-compatible for non-internal header files.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:37:05 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 07 Jun 2019 12:37:05 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559911025.14.0.938538076978.issue37170@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13765
pull_request: https://github.com/python/cpython/pull/13891

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 08:45:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 12:45:12 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559911512.01.0.170060334259.issue37191@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13766
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13892

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:02:57 2019
From: report at bugs.python.org (Norihiro Maruyama)
Date: Fri, 07 Jun 2019 13:02:57 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1559912577.89.0.0979572765637.issue37193@roundup.psfhosted.org>


Change by Norihiro Maruyama <norihiro.maruyama at gmail.com>:


----------
keywords: +patch
pull_requests: +13767
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13893

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:04:54 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 13:04:54 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
Message-ID: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

./python.exe -m test test_os -R : -v
======================================================================
FAIL: test_utime (test.test_os.UtimeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 591, in test_utime
    self._test_utime(set_time)
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 579, in _test_utime
    self.assertAlmostEqual(st.st_atime, atime_ns * 1e-9, delta=1e-6)
AssertionError: 1559912609.2612822 != 1.002003 within 1e-06 delta (1559912608.2592793 difference)

======================================================================
FAIL: test_utime_by_indexed (test.test_os.UtimeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 609, in test_utime_by_indexed
    self._test_utime(set_time)
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 579, in _test_utime
    self.assertAlmostEqual(st.st_atime, atime_ns * 1e-9, delta=1e-6)
AssertionError: 1559912609.2679918 != 1.002003 within 1e-06 delta (1559912608.2659888 difference)

======================================================================
FAIL: test_utime_dir_fd (test.test_os.UtimeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 651, in test_utime_dir_fd
    self._test_utime(set_time)
  File "/Users/pgalindo3/github/cpython/Lib/test/test_os.py", line 579, in _test_utime
    self.assertAlmostEqual(st.st_atime, atime_ns * 1e-9, delta=1e-6)
AssertionError: 1559912609.2721212 != 1.002003 within 1e-06 delta (1559912608.2701182 difference)

----------------------------------------------------------------------

----------
components: Tests
messages: 344933
nosy: pablogsal, vstinner
priority: normal
severity: normal
status: open
title: test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:17:12 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 13:17:12 +0000
Subject: [issue37192] pip instal math3d - EROR
In-Reply-To: <1559907557.33.0.540342882272.issue37192@roundup.psfhosted.org>
Message-ID: <1559913432.18.0.264338444996.issue37192@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

In addition to being a third-party library, according to the output you posted, you're actually running Python 3.4 not 3.7.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37192>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:33:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 13:33:51 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559914431.62.0.904456626256.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


Added file: https://bugs.python.org/file48400/stack_overflow-4.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:34:33 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Fri, 07 Jun 2019 13:34:33 +0000
Subject: [issue37030] Lib/cmd.py: Hide undocumented commands in help and
 completenames
In-Reply-To: <1558682753.85.0.407660629596.issue37030@roundup.psfhosted.org>
Message-ID: <1559914473.57.0.56542694645.issue37030@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Can there be a review of the PR to let me know if all changes are correct?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37030>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:35:14 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 13:35:14 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559914513.99.0.0501797350317.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I used testcapi_call_no_args.patch and stack_overflow-4.py to measure the stack consumption of PyObject_CallNoArgs() and PyObject_CallFunctionObjArgs() for PR 13890.

----------
Added file: https://bugs.python.org/file48401/testcapi_call_no_args.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:45:50 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 07 Jun 2019 13:45:50 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559915150.22.0.356776413531.issue37195@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 09:56:45 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 13:56:45 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559915805.1.0.622151012135.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> What matters is the __mro__ attribute of the first argument. It matters 
because that is how the MRO actually is searched.

I'm sorry to say that you're wrong here. super() looks at the MRO of the type of the object (the second argument) (*). It has to do that in order to support diamonds. Consider a diamond like

  D
 / \
B   C
 \ /
  A

(with A as common base class). Now super(B, D()).attr will look in the MRO of D (which is D, B, C, A) and therefore delegate to C.attr. In this case, C does not even appear in the MRO of B.

(*) To be pedantic: in the special case that the second argument is a type itself, it looks at the MRO of the second argument.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:01:35 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 07 Jun 2019 14:01:35 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559916095.13.0.518503751681.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

And this last comment is precisely the kind of information which should be explained in the super() docs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:05:15 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 07 Jun 2019 14:05:15 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
Message-ID: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>


New submission from G?ry <gery.ogam at gmail.com>:

Could we allow arbitrary expressions in the @expression syntax for applying decorators to functions/classes? The current grammar restriction to:

    decorator: '@' dotted_name [ '(' [arglist] ')' ] NEWLINE

is very surprising and I don't understand the real motivation.

I find it weird that you are not able to do that:

    def f():
        def g():
            def h(x):
                pass
            return h
        return g
    
    @f()()
    def i():
        pass

since you get:

        @f()()
            ^
    SyntaxError: invalid syntax

but the following is perfectly valid:

    def f():
        def g():
            def h(x):
                pass
            return h
        return g
    
    def g(x):
        def h(x):
            pass
        return g
    
    @g(f()())
    def h():
        pass

See this post for more details: https://stackoverflow.com/questions/56490579

----------
components: Interpreter Core
messages: 344939
nosy: bob.ippolito, exarkun, gvanrossum, j1m, maggyero, mwh, rhettinger
priority: normal
severity: normal
status: open
title: Allowing arbitrary expressions in the @expression syntax
type: enhancement
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:06:42 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 07 Jun 2019 14:06:42 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
In-Reply-To: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>
Message-ID: <1559916402.46.0.488606112446.issue37196@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

The syntax is deliberately limited. The reasons are explained at:

https://www.python.org/dev/peps/pep-0318/#current-syntax
https://mail.python.org/pipermail/python-dev/2004-August/046711.html

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:16:39 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 07 Jun 2019 14:16:39 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559916999.18.0.732922763412.issue37176@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Jeroen Demeyer

> I'm sorry to say that you're wrong here. super() looks at the MRO of the type of the object (the second argument) (*).

Exactly! It is funny because I was about to open the same issue this weekend. The documentation of super() is wrong here.

----------
nosy: +maggyero

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:22:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 14:22:26 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559917346.7.0.0354586506975.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 3bf0f3ad2046ac674d8e8a2c074a5a8b3327797d by Victor Stinner in branch 'master':
bpo-37169: Rewrite _PyObject_IsFreed() unit tests (GH-13888)
https://github.com/python/cpython/commit/3bf0f3ad2046ac674d8e8a2c074a5a8b3327797d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:23:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 14:23:01 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559917381.68.0.677252957239.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset dd492d9c352eb0fa2bc48ea9acc47e47a7fab8a0 by Victor Stinner (Zackery Spytz) in branch '3.8':
[3.8] bpo-37170: Fix the cast on error in PyLong_AsUnsignedLongLongMask() (GH-13860) (GH-13891)
https://github.com/python/cpython/commit/dd492d9c352eb0fa2bc48ea9acc47e47a7fab8a0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:26:10 2019
From: report at bugs.python.org (Thomas Viehmann)
Date: Fri, 07 Jun 2019 14:26:10 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559917570.66.0.630156659588.issue37177@roundup.psfhosted.org>


Change by Thomas Viehmann <tv.python.org at beamnet.de>:


----------
pull_requests: +13768
pull_request: https://github.com/python/cpython/pull/13894

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:26:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 14:26:22 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559917582.93.0.0836881990304.issue37169@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13769
pull_request: https://github.com/python/cpython/pull/13895

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:28:11 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 07 Jun 2019 14:28:11 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
In-Reply-To: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>
Message-ID: <1559917691.53.0.788654781056.issue37196@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Christian Heimes

> The reasons are explained at:

Yes I read that. But I am wondering if after 15 years Guido still has this "gut feeling". Because my gut feeling as a Python *user* who has discovered decorators and stumbled on this restriction was: "what?!".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:30:40 2019
From: report at bugs.python.org (Thomas Viehmann)
Date: Fri, 07 Jun 2019 14:30:40 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559917840.45.0.332632308334.issue33826@roundup.psfhosted.org>


Change by Thomas Viehmann <tv.python.org at beamnet.de>:


----------
pull_requests: +13770
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13894

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:32:24 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 14:32:24 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559917944.5.0.38238987156.issue37177@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
pull_requests:  -13768

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:43:58 2019
From: report at bugs.python.org (Tal Einat)
Date: Fri, 07 Jun 2019 14:43:58 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559918638.11.0.0351326420584.issue33826@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Given that classes already have a '__module__' attribute, using which it is rather easy to find the filename, I don't see a good reason to add such an attribute to classes.

IMO it would be more appropriate to directly create enhancement proposal for IPython/Jupyter to enhance the capabilities of their source code retrieval.

I suggest rejecting this enhancement.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:46:40 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 07 Jun 2019 14:46:40 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
In-Reply-To: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>
Message-ID: <1559918800.96.0.57040448504.issue37196@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

What you want to write is as unreadable as it ever was.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:46:42 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 07 Jun 2019 14:46:42 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559918802.73.0.28573349389.issue37170@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +13771
pull_request: https://github.com/python/cpython/pull/13896

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:50:59 2019
From: report at bugs.python.org (Thomas Viehmann)
Date: Fri, 07 Jun 2019 14:50:59 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559919059.64.0.33347361298.issue33826@roundup.psfhosted.org>


Thomas Viehmann <tv.python.org at beamnet.de> added the comment:

Note that the module is less granular than the filename in IPython - i.e. it's useless for within notebooks.

----------
nosy: +t-vi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:54:02 2019
From: report at bugs.python.org (Thomas Viehmann)
Date: Fri, 07 Jun 2019 14:54:02 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559919242.67.0.141834155325.issue33826@roundup.psfhosted.org>


Change by Thomas Viehmann <tv.python.org at beamnet.de>:


----------
nosy:  -t-vi
resolution:  -> rejected

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:54:24 2019
From: report at bugs.python.org (Thomas Viehmann)
Date: Fri, 07 Jun 2019 14:54:24 +0000
Subject: [issue33826] enable discovery of class source code in IPython
 interactively defined classes
In-Reply-To: <1528697796.87.0.592728768989.issue33826@psf.upfronthosting.co.za>
Message-ID: <1559919264.09.0.0783828161528.issue33826@roundup.psfhosted.org>


Change by Thomas Viehmann <tv.python.org at beamnet.de>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33826>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:54:57 2019
From: report at bugs.python.org (=?utf-8?q?Pekka_Kl=C3=A4rck?=)
Date: Fri, 07 Jun 2019 14:54:57 +0000
Subject: [issue36300] eval of comprehension cannot access local variables
In-Reply-To: <1552646652.54.0.949988321046.issue36300@roundup.psfhosted.org>
Message-ID: <1559919297.95.0.617559323573.issue36300@roundup.psfhosted.org>


Pekka Kl?rck <pekka.klarck at gmail.com> added the comment:

More ways to be bitten by this strange behavior:

    >>> d = {'a': 1, 'b': 2}
    >>> eval('[x[k] for k in x]', {}, {'x': d})
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "<string>", line 1, in <module>
      File "<string>", line 1, in <listcomp>
    NameError: name 'x' is not defined
    >>> 
    >>> def f():
    ...     x = {'a': 1, 'b': 2}
    ...     return eval('[x[k] for k in x]')
    ... 
    >>> f()
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
      File "<stdin>", line 3, in f
      File "<string>", line 1, in <module>
      File "<string>", line 1, in <listcomp>
    NameError: name 'x' is not defined



In both of the above cases changing

    eval('[x[k] for k in x]')

to

    eval('[v for v in x.values()]')

avoids the problem. There are no problems when using

    [x[k] for k in x]

without `eval()` either. I'd prefer this to be changed, but there should at least be a note in the documentation of `eval()` about this.

----------
nosy: +pekka.klarck

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36300>
_______________________________________

From report at bugs.python.org  Fri Jun  7 10:56:27 2019
From: report at bugs.python.org (=?utf-8?q?Pekka_Kl=C3=A4rck?=)
Date: Fri, 07 Jun 2019 14:56:27 +0000
Subject: [issue36300] eval of comprehension cannot access local variables
In-Reply-To: <1552646652.54.0.949988321046.issue36300@roundup.psfhosted.org>
Message-ID: <1559919387.02.0.211646382664.issue36300@roundup.psfhosted.org>


Pekka Kl?rck <pekka.klarck at gmail.com> added the comment:

I encountered this issue because Robot Framework -- a generic Python based test automation framework -- supports evaluating Python expressions and this issue was reported for us:
https://github.com/robotframework/robotframework/issues/3207

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36300>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:21:15 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 07 Jun 2019 15:21:15 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559920875.31.0.876490053842.issue37176@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Steven D'Aprano

> What matters is the __mro__ attribute of the first argument. It matters 
because that is how the MRO actually is searched.

By the way, if it was true (it is not), then what did you think was the purpose of the second parameter of super(type, obj-or-type)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:34:12 2019
From: report at bugs.python.org (Christoph Reiter)
Date: Fri, 07 Jun 2019 15:34:12 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559921652.2.0.710316898873.issue37191@roundup.psfhosted.org>


Christoph Reiter <reiter.christoph at gmail.com> added the comment:

I've removed -Wdeclaration-after-statement in upstream pygobject: https://gitlab.gnome.org/GNOME/pygobject/merge_requests/119

----------
nosy: +lazka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:35:16 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 07 Jun 2019 15:35:16 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
In-Reply-To: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>
Message-ID: <1559921716.26.0.487101732843.issue37196@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Guido van Rossum

> What you want to write is as unreadable as it ever was.

How is @g(f()()) more readable than @f()()? Yet the former is allowed.

----------
resolution: wont fix -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:41:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 15:41:32 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559922092.34.0.869424868958.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset e36ed475ea429f7cc80a4d65f80b44686a74b246 by Victor Stinner (Zackery Spytz) in branch '3.7':
[3.7] bpo-37170: Fix the cast on error in PyLong_AsUnsignedLongLongMask() (GH-13860) (GH-13896)
https://github.com/python/cpython/commit/e36ed475ea429f7cc80a4d65f80b44686a74b246


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:41:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 15:41:43 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559922103.09.0.851852809726.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 357626676035d2bb12ea92e0edf3c7b383d627ec by Victor Stinner in branch '3.8':
bpo-37169: Rewrite _PyObject_IsFreed() unit tests (GH-13888) (GH-13895)
https://github.com/python/cpython/commit/357626676035d2bb12ea92e0edf3c7b383d627ec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:51:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 15:51:34 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559922694.95.0.195459663262.issue37191@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 740a84de73ad8d02655de0a084036f4b7e49a01b by Victor Stinner in branch 'master':
bpo-37191: Move TestPEP590 from test_capi to test_call (GH-13892)
https://github.com/python/cpython/commit/740a84de73ad8d02655de0a084036f4b7e49a01b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:52:42 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 15:52:42 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559922762.8.0.730376645718.issue37191@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13772
pull_request: https://github.com/python/cpython/pull/13897

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:57:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 15:57:37 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1559923057.29.0.926500984415.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Matej Cepl: thanks for the bug report, it should now be fixed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun  7 11:59:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 15:59:04 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559923144.49.0.798982862372.issue37191@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I've removed -Wdeclaration-after-statement in upstream pygobject: https://gitlab.gnome.org/GNOME/pygobject/merge_requests/119

Thanks! Enjoy C99! :-) IMHO C99 with variables in the middle of a function helps to write more reliable code: we better control the scope of a variable. It reduces the risk of using an uninitialized variable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:07:19 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 07 Jun 2019 16:07:19 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559923639.55.0.797608991948.issue37170@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +13773
pull_request: https://github.com/python/cpython/pull/13898

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:08:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:08:24 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
In-Reply-To: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>
Message-ID: <1559923704.4.0.972914893757.issue37180@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Regarding the file named: "Lib/encodings/mac_farsi.py", the numbers are inserted in the wrong way, they are inserted Arabic numbers instead of Persian, they are edited in the comment.

Python implements the Unicode standard. In the master branch, it's the Unicode standard version 11.0. It gives these character names:

$ python3
>>> import unicodedata
>>> for ch in list(range(0x06f0, 0x06f9+1)) + [0x06A9]:
...  print("U+%04x: %s" % (ch, unicodedata.name(chr(ch))))
... 

U+06f0: EXTENDED ARABIC-INDIC DIGIT ZERO
U+06f1: EXTENDED ARABIC-INDIC DIGIT ONE
U+06f2: EXTENDED ARABIC-INDIC DIGIT TWO
U+06f3: EXTENDED ARABIC-INDIC DIGIT THREE
U+06f4: EXTENDED ARABIC-INDIC DIGIT FOUR
U+06f5: EXTENDED ARABIC-INDIC DIGIT FIVE
U+06f6: EXTENDED ARABIC-INDIC DIGIT SIX
U+06f7: EXTENDED ARABIC-INDIC DIGIT SEVEN
U+06f8: EXTENDED ARABIC-INDIC DIGIT EIGHT
U+06f9: EXTENDED ARABIC-INDIC DIGIT NINE
U+06a9: ARABIC LETTER KEHEH

>>> unicodedata.unidata_version
'11.0.0'

I still see "ARABIC" in character names.

> The KAF character (?)

That's the Unicode character: U+0643 called "ARABIC LETTER KAF".

Comments in https://github.com/python/cpython/blob/master/Lib/encodings/mac_farsi.py still seems to be up to date.

SilentGhost:
> The replacement character that you're proposing is called (according to the same database) 'ARABIC LETTER KEHEH', whereas the old one was 'ARABIC LETTER KAF'. This encoding was originally generated based on data from unicode.org, I'd think a reference would be needed making clear that this is indeed a valid replacement.

mac_farsi.py docstring says:

""" Python Character Mapping Codec mac_farsi generated from 'MAPPINGS/VENDORS/APPLE/FARSI.TXT' with gencodec.py.

The mapping comes from Unicode. Was it updated since this file was created?

The latest change in this file was made in 2007, a few years ago :-)

--

I don't see anything wrong, I suggest to close the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:13:19 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 16:13:19 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559923999.65.0.216189426122.issue37191@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5effd10bf14ab0a8a6695100aaf0b687eca68e6d by Miss Islington (bot) in branch '3.8':
bpo-37191: Move TestPEP590 from test_capi to test_call (GH-13892)
https://github.com/python/cpython/commit/5effd10bf14ab0a8a6695100aaf0b687eca68e6d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:14:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:14:50 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1559924090.94.0.0377368702976.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh, I used the wrong bpo number for this change:

New changeset 740a84de73ad8d02655de0a084036f4b7e49a01b by Victor Stinner in branch 'master':
bpo-37191: Move TestPEP590 from test_capi to test_call (GH-13892)
https://github.com/python/cpython/commit/740a84de73ad8d02655de0a084036f4b7e49a01b

New changeset 5effd10bf14ab0a8a6695100aaf0b687eca68e6d by Miss Islington (bot) in branch '3.8':
bpo-37191: Move TestPEP590 from test_capi to test_call (GH-13892)
https://github.com/python/cpython/commit/5effd10bf14ab0a8a6695100aaf0b687eca68e6d

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:23:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:23:01 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559924581.57.0.243285271316.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 2bfc2dc214445550521074f428245b502d215eac by Victor Stinner (Zackery Spytz) in branch '2.7':
[2.7] bpo-37170: Fix the cast on error in PyLong_AsUnsignedLongLongMask() (GH-13860) (GH-13898)
https://github.com/python/cpython/commit/2bfc2dc214445550521074f428245b502d215eac


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:23:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:23:38 +0000
Subject: [issue37170] Wrong return value from PyLong_AsUnsignedLongLongMask on
 PyErr_BadInternalCall
In-Reply-To: <1559803961.74.0.856942246401.issue37170@roundup.psfhosted.org>
Message-ID: <1559924618.36.0.355957413067.issue37170@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Antti Haapala for the bug report and thanks Zackery Spytz for the fix!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37170>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:26:13 2019
From: report at bugs.python.org (Irv Kalb)
Date: Fri, 07 Jun 2019 16:26:13 +0000
Subject: [issue37197] [Idle-dev] Feedback appreciated for two suggested new
 features
In-Reply-To: <CALWZvp6UkL2hspKPW2uG3U8XjMTuQ-5jNzBRbamzkYpV_TBrAQ@mail.gmail.com>
Message-ID: <183F716E-E3A9-46DE-879A-CC7D02870ECB@furrypants.com>


New submission from Irv Kalb <Irv at furrypants.com>:

[I'm not sure of the proper protocol here, I hope sending a message this way is OK.]

Hi,

I am writing about the potential fix to the Search Dialog box problem in IDLE that I reported a while back.  I can see that there is a flurry of activity on this bug.  I saw that there was a code change, but since I have never looked at IDLE source code, I really cannot comment on the fix.

However, I did see comments that it might be difficult to reproduce, so I made a short video to clearly demonstrate the bug.  (This is on IDLE/Python 3.6.1 Mac)  You can see it here:

http://www.youtube.com/watch?v=YWDsOEN8qsE <http://www.youtube.com/watch?v=YWDsOEN8qsE>

I did not get a chance to test this out on Window, but the bug is easily reproducible on a Mac.

If the change is to leave the dialog box in front of the editing window, that would be be fine.  But long term, if it is possible to incorporate a search bar like the one in PyCharm, that would be even better.

Thanks for addressing the issue and I hope this video is helpful.

Irv

> On Jun 6, 2019, at 9:28 AM, Tal Einat <taleinat at gmail.com> wrote:
> 
> After a great delay, I've created an issue[0] about the search dialogs being hidden behind the main window, and have a PR[1] up with a proposed fix.
> 
> [0] https://bugs.python.org/issue37177 <https://bugs.python.org/issue37177>
> [1] https://github.com/python/cpython/pull/13869 <https://github.com/python/cpython/pull/13869>
> On Thu, Oct 18, 2018 at 8:13 PM Irv Kalb <Irv at furrypants.com <mailto:Irv at furrypants.com>> wrote:
> Hi,
> 
> I don't have a strong opinion about the details of the search and replace dialogs.  However, I can tell you that a change replacing the dialog box would be greatly appreciated.
> 
> I teach Python classes using IDLE.  The search dialog is a real a problem for new students and me as the teacher.  My students and I often get into a scenario where the search dialog gets hidden behind a editing window.  When that happens, then you try to make edits in code and nothing happens.  This happens to very often.  I have learned to look for the hidden search dialog window, but my students get very flustered.
> 
> I think that a search bar would be a great improvement.  If you can model it similar to the one in PyCharm, that would be wonderful.
> 
> Thanks for looking into this issue.
> 
> Irv
> 
> 
>> On Oct 13, 2018, at 2:51 PM, Tal Einat <taleinat at gmail.com <mailto:taleinat at gmail.com>> wrote:
>> 
>> Hi,
>> 
>> I've recently been working on two new features, for which I'd like to discuss whether it would be wise to include in IDLE. Each has a working implementation in a PR to make it easy to give it a try.
>> 
>> 1. Replace the search and replace dialogs with a search bar
>> https://bugs.python.org/issue34976 <https://bugs.python.org/issue34976>
>> https://github.com/python/cpython/pull/9855 <https://github.com/python/cpython/pull/9855>
>> 
>> 2. Ability to run 3rd party code checkers
>> https://bugs.python.org/issue21880 <https://bugs.python.org/issue21880>
>> https://github.com/python/cpython/pull/9802 <https://github.com/python/cpython/pull/9802>
>> 
>> Any thoughts would be greatly appreciated!
>> 
>> - Tal Einat
>> _______________________________________________
>> IDLE-dev mailing list
>> IDLE-dev at python.org <mailto:IDLE-dev at python.org>
>> https://mail.python.org/mailman/listinfo/idle-dev <https://mail.python.org/mailman/listinfo/idle-dev>
> 
> _______________________________________________
> IDLE-dev mailing list
> IDLE-dev at python.org <mailto:IDLE-dev at python.org>
> https://mail.python.org/mailman/listinfo/idle-dev <https://mail.python.org/mailman/listinfo/idle-dev>

----------
messages: 344963
nosy: IrvKalb, taleinat
priority: normal
severity: normal
status: open
title: [Idle-dev] Feedback appreciated for two suggested new features

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37197>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:30:38 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 07 Jun 2019 16:30:38 +0000
Subject: [issue37197] [Idle-dev] Feedback appreciated for two suggested new
 features
In-Reply-To: <183F716E-E3A9-46DE-879A-CC7D02870ECB@furrypants.com>
Message-ID: <1559925038.85.0.177487873772.issue37197@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

This seems to have been posted to bpo by mistake. I'm going to close this issue as a duplicate of #37177 and I would appreciate if you would send your e-mail to the idle-dev mailing list instead.

----------
nosy: +SilentGhost
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> IDLE: Search dialogs can be hidden behind the main window
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37197>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:32:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:32:00 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1559925120.19.0.683298372696.issue37191@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 9689f80e61e5863668a562793ebb85031ef9fd3e by Victor Stinner (Petr Viktorin) in branch '3.8':
bpo-37191: Avoid declaration-after-statement in header included from Python.h (GH-13887)
https://github.com/python/cpython/commit/9689f80e61e5863668a562793ebb85031ef9fd3e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:33:21 2019
From: report at bugs.python.org (hodai goldman)
Date: Fri, 07 Jun 2019 16:33:21 +0000
Subject: [issue37198] _parse_localename fail to parse 'US_IL'
Message-ID: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>


New submission from hodai goldman <hodaig at gmail.com>:

_parse_localename fail to parse 'US_IL':

Traceback (most recent call last):
  File "/usr/bin/flowblade", line 78, in <module>
    app.main(modules_path)
  File "/usr/share/flowblade/Flowblade/app.py", line 194, in main
    translations.init_languages()
  File "/usr/share/flowblade/Flowblade/translations.py", line 39, in init_languages
    lc, encoding = locale.getdefaultlocale()
  File "/usr/lib/python2.7/locale.py", line 545, in getdefaultlocale
    return _parse_localename(localename)
  File "/usr/lib/python2.7/locale.py", line 477, in _parse_localename
    raise ValueError, 'unknown locale: %s' % localename
ValueError: unknown locale: en_IL


need to add another check for '_' separator, code:

    if '.' in code:
        return tuple(code.split('.')[:2])

----------
messages: 344966
nosy: hodai goldman
priority: normal
severity: normal
status: open
title: _parse_localename fail to parse 'US_IL'
type: crash
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:44:00 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Fri, 07 Jun 2019 16:44:00 +0000
Subject: [issue37198] _parse_localename fail to parse 'US_IL'
In-Reply-To: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>
Message-ID: <1559925840.82.0.472997730662.issue37198@roundup.psfhosted.org>


Michele Angrisano <michele.angrisano at gmail.com> added the comment:

Hi Hodai, thank you for the report.
Would you be interested to propose a Pull Request for this issue?

You can read the devguide for more informations.

Thank you. :)

----------
nosy: +lemburg, mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:45:09 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 07 Jun 2019 16:45:09 +0000
Subject: [issue37198] _parse_localename fail to parse 'en_IL'
In-Reply-To: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>
Message-ID: <1559925909.41.0.877940970656.issue37198@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

How come your locale doesn't have encoding associated with it? The bit you're looking at is not really relevant, though.

----------
components: +Library (Lib)
nosy: +SilentGhost
title: _parse_localename fail to parse 'US_IL' -> _parse_localename fail to parse 'en_IL'
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:50:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 16:50:37 +0000
Subject: [issue15913] Add PyBuffer_SizeFromFormat() C helper for
 struct.calcsize()
In-Reply-To: <1347312444.09.0.484126652005.issue15913@psf.upfronthosting.co.za>
Message-ID: <1559926237.0.0.552617419138.issue15913@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: PyBuffer_SizeFromFormat is missing -> Add PyBuffer_SizeFromFormat() C helper for struct.calcsize()
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15913>
_______________________________________

From report at bugs.python.org  Fri Jun  7 12:58:40 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 07 Jun 2019 16:58:40 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559926720.35.0.0513536980991.issue37195@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

FWIW, it doesn't fail for me and I don't recall ever seeing a failure like this on macOS.  What hardware? ./python.exe -m test.pythoninfo please!

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:00:30 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Fri, 07 Jun 2019 17:00:30 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
Message-ID: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>


New submission from N.P. Khelili <nophke at free.fr>:

The test suite does not handle an OS that does not have IPv6.
When Linux kernel is started with argument:

ipv6.disable=1

The test suite fails. ( See attached file )

5 tests failed:
    test_asyncio test_imaplib test_importlib test_socket test_zipapp

----------
files: test_suite_fail.txt
messages: 344970
nosy: Nophke
priority: normal
severity: normal
status: open
title: Test suite fails when Ipv6 is unavailable
type: behavior
versions: Python 3.9
Added file: https://bugs.python.org/file48402/test_suite_fail.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:02:27 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 07 Jun 2019 17:02:27 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559926947.46.0.3224997509.issue37195@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Also, what utime* results show up in ./configure output?  I see

checking utime.h usability... yes
checking utime.h presence... yes
checking for utime.h... yes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:03:23 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 07 Jun 2019 17:03:23 +0000
Subject: [issue37180] Fix Persian KAF in mac_farsi.py
In-Reply-To: <1559846153.37.0.617648704502.issue37180@roundup.psfhosted.org>
Message-ID: <1559927003.94.0.865707857687.issue37180@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

Ramin, I agree with Victor, if you have any information contrary to what we posted, please feel free to post it here so that we can consider re-opening the issue.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37180>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:11:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 17:11:27 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1559927487.61.0.832892202745.issue37199@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:16:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 17:16:53 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559927813.66.0.453889035503.issue36742@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: urlsplit doesn't accept a NFKD hostname with a port number -> CVE-2019-10160: urlsplit NFKD normalization vulnerability in user:password@

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:17:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 17:17:04 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559927824.47.0.349885068165.issue36742@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

CVE-2019-10160 has been assigned by Red Hat to this flaw.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:25:55 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 07 Jun 2019 17:25:55 +0000
Subject: [issue10915] Make the PyGILState API compatible with multiple
 interpreters
In-Reply-To: <1295103161.75.0.771875465176.issue10915@psf.upfronthosting.co.za>
Message-ID: <1559928355.98.0.929891464743.issue10915@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10915>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:26:07 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 07 Jun 2019 17:26:07 +0000
Subject: [issue15751] Support subinterpreters in the GIL state API
In-Reply-To: <1345526301.75.0.455071650321.issue15751@psf.upfronthosting.co.za>
Message-ID: <1559928367.78.0.901384591523.issue15751@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
versions: +Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15751>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:29:01 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 07 Jun 2019 17:29:01 +0000
Subject: [issue37186] Everyone uses GIL wrong! = DEADLOCK
In-Reply-To: <1559865784.82.0.0210813088917.issue37186@roundup.psfhosted.org>
Message-ID: <1559928541.72.0.854829458505.issue37186@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

The situation with subinterpreters and the gilstate API is a known problem (see issues #10915 and #15751).  We plan on fixing that in the near future for 3.9 (and probably for 3.8).  Feel free to chime in on those earlier issues.  Note that the subinterpreter experience is going to be much improved with the 3.9 release.

You also mentioned an issue with PyEval_AcquireThread().  If you don't think this is directly related to the gilstate API (I suspect it is) then please open a new issue for that.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Make the PyGILState API compatible with multiple interpreters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37186>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:30:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 17:30:31 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1559928631.79.0.220303693368.issue18299@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I dislike script_helper API. I doesn't allow to pass arbitrary keyword parameters to subprocess.Popen. IMHO a new API should be added, but I didn't check if script_helper already contains such API or not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:38:50 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 07 Jun 2019 17:38:50 +0000
Subject: [issue37175] make install: make compileall optional
In-Reply-To: <1559826192.88.0.243223248459.issue37175@roundup.psfhosted.org>
Message-ID: <1559929130.91.0.121579003783.issue37175@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

In many installations, the user running Python would not have write access to the lib directory tree where the compiled byte files need to be created so we would not want to change the current default behavior.  On the other hand, I could see some times when testing where it would speed things up to skip compiling.

The issue of tons of output is really a more important issue; it would be useful to be able to suppress all those lines of compile output as they rarely provide any useful information, perhaps even suppressing by default.

----------
nosy: +ned.deily
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37175>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:44:26 2019
From: report at bugs.python.org (Carol Willing)
Date: Fri, 07 Jun 2019 17:44:26 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559929466.95.0.180291825489.issue37195@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Confirming that they do pass on my Mojave system. 

test_utime (test.test_os.UtimeTests) ... ok
test_utime_by_indexed (test.test_os.UtimeTests) ... ok
...
test_utime_dir_fd (test.test_os.UtimeTests) ... ok

Though I did have to go through some shenanigans (which may or may not be related) to get configure and make to run cleanly:
- open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg
- removed brewed binutils 
- removed all brewed pythons
- make clean all

Then the normal process worked.

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:48:43 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 17:48:43 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559929723.16.0.441184050206.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Python debug information
========================

CC.version: Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Py_DEBUG: Yes (sys.gettotalrefcount() present)
_decimal.__libmpdec_version__: 2.4.2
builtins.float.double_format: IEEE, little-endian
builtins.float.float_format: IEEE, little-endian
config[_config_init]: 2
config[_init_main]: 1
config[_install_importlib]: 1
config[argv]: ['-m']
config[base_exec_prefix]: '/usr/local'
config[base_prefix]: '/usr/local'
config[buffered_stdio]: 1
config[bytes_warning]: 0
config[check_hash_pycs_mode]: 'default'
config[configure_c_stdio]: 1
config[dev_mode]: 0
config[dump_refs]: 0
config[exec_prefix]: '/usr/local'
config[executable]: '/Users/pgalindo3/github/cpython/python.exe'
config[faulthandler]: 0
config[filesystem_encoding]: 'utf-8'
config[filesystem_errors]: 'surrogateescape'
config[hash_seed]: 0
config[home]: None
config[import_time]: 0
config[inspect]: 0
config[install_signal_handlers]: 1
config[interactive]: 0
config[isolated]: 0
config[malloc_stats]: 0
config[module_search_paths]: ['/usr/local/lib/python39.zip', '/Users/pgalindo3/github/cpython/Lib', '/Users/pgalindo3/github/cpython/build/lib.macosx-10.14-x86_64-3.9-pydebug']
config[optimization_level]: 0
config[parse_argv]: 1
config[parser_debug]: 0
config[pathconfig_warnings]: 1
config[prefix]: '/usr/local'
config[program_name]: './python.exe'
config[pycache_prefix]: None
config[pythonpath_env]: None
config[quiet]: 0
config[run_command]: None
config[run_filename]: None
config[run_module]: 'test.pythoninfo'
config[show_alloc_count]: 0
config[show_ref_count]: 0
config[site_import]: 1
config[skip_source_first_line]: 0
config[stdio_encoding]: 'utf-8'
config[stdio_errors]: 'strict'
config[tracemalloc]: 0
config[use_environment]: 1
config[use_hash_seed]: 0
config[user_site_directory]: 1
config[verbose]: 0
config[warnoptions]: []
config[write_bytecode]: 1
config[xoptions]: []
datetime.datetime.now: 2019-06-07 18:47:42.879783
expat.EXPAT_VERSION: expat_2.2.6
gdbm.GDBM_VERSION: 1.18.1
global_config[Py_BytesWarningFlag]: 0
global_config[Py_DebugFlag]: 0
global_config[Py_DontWriteBytecodeFlag]: 0
global_config[Py_FileSystemDefaultEncodeErrors]: 'surrogateescape'
global_config[Py_FileSystemDefaultEncoding]: 'utf-8'
global_config[Py_FrozenFlag]: 0
global_config[Py_HasFileSystemDefaultEncoding]: 0
global_config[Py_HashRandomizationFlag]: 1
global_config[Py_IgnoreEnvironmentFlag]: 0
global_config[Py_InspectFlag]: 0
global_config[Py_InteractiveFlag]: 0
global_config[Py_IsolatedFlag]: 0
global_config[Py_NoSiteFlag]: 0
global_config[Py_NoUserSiteDirectory]: 0
global_config[Py_OptimizeFlag]: 0
global_config[Py_QuietFlag]: 0
global_config[Py_UTF8Mode]: 0
global_config[Py_UnbufferedStdioFlag]: 0
global_config[Py_VerboseFlag]: 0
global_config[_Py_HasFileSystemDefaultEncodeErrors]: 0
locale.encoding: UTF-8
os.cpu_count: 12
os.cwd: /Users/pgalindo3/github/cpython
os.environ[CFLAGS]: -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include
os.environ[CPPFLAGS]: -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include
os.environ[DISPLAY]: /private/tmp/com.apple.launchd.e9sp6YZNFd/org.macosforge.xquartz:0
os.environ[HOME]: /Users/pgalindo3
os.environ[LANG]: en_GB.UTF-8
os.environ[LC_CTYPE]: en_GB.UTF-8
os.environ[LDFLAGS]: -L/usr/local/opt/zlib/lib
os.environ[LD_LIBRARY_PATH]: /opt/cuda/lib64:
os.environ[PATH]: /Users/pgalindo3/.cargo/bin:/Users/pgalindo3/.cargo/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public/:/usr/local/MacGPG2/bin:/opt/X11/bin:/Users/pgalindo3/.cargo/bin:/opt/cuda/bin:/home/pablogsal/.bin:/Users/pgalindo3/.npm-global/bin/:/Users/pgalindo3/Library/Python/3.7/bin:/home/pablogsal/.gem/ruby/2.3.0/bin:/usr/local/opt/fzf/bin
os.environ[SHELL]: /bin/zsh
os.environ[TERM]: xterm-256color
os.environ[TMPDIR]: /var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/
os.gid: 20
os.groups: 20, 12, 61, 79, 80, 81, 98, 33, 100, 204, 250, 395, 398, 399, 701, 702
os.loadavg: (1.38916015625, 1.4130859375, 1.4541015625)
os.login: pgalindo3
os.name: posix
os.supports_bytes_environ: True
os.supports_effective_ids: ['access']
os.supports_fd: ['chdir', 'chmod', 'chown', 'listdir', 'pathconf', 'scandir', 'stat', 'statvfs', 'truncate', 'utime']
os.supports_follow_symlinks: ['access', 'chflags', 'chmod', 'chown', 'link', 'stat', 'utime']
os.uid: 504
os.umask: 022
os.uname: posix.uname_result(sysname='Darwin', nodename='C02XG51ZJGH5', release='18.6.0', version='Darwin Kernel Version 18.6.0: Thu Apr 25 23:16:27 PDT 2019; root:xnu-4903.261.4~2/RELEASE_X86_64', machine='x86_64')
platform.architecture: 64bit
platform.platform: macOS-10.14.5-x86_64-i386-64bit
platform.python_implementation: CPython
pre_config[_config_init]: 2
pre_config[allocator]: 0
pre_config[coerce_c_locale]: 0
pre_config[coerce_c_locale_warn]: 0
pre_config[configure_locale]: 1
pre_config[dev_mode]: 0
pre_config[isolated]: 0
pre_config[parse_argv]: 1
pre_config[use_environment]: 1
pre_config[utf8_mode]: 0
pymem.allocator: pymalloc_debug
pymem.with_pymalloc: True
readline._READLINE_LIBRARY_VERSION: EditLine wrapper
readline._READLINE_RUNTIME_VERSION: 0x402
readline._READLINE_VERSION: 0x402
resource.RLIMIT_AS: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_CORE: (0, 9223372036854775807)
resource.RLIMIT_CPU: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_DATA: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_FSIZE: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_MEMLOCK: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_NOFILE: (7168, 9223372036854775807)
resource.RLIMIT_NPROC: (1418, 2128)
resource.RLIMIT_RSS: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_STACK: (8388608, 67104768)
resource.pagesize: 4096
socket.hostname: C02XG51ZJGH5
sqlite3.sqlite_version: 3.24.0
sqlite3.version: 2.6.0
ssl.HAS_SNI: True
ssl.OPENSSL_VERSION: OpenSSL 1.0.2r  26 Feb 2019
ssl.OPENSSL_VERSION_INFO: (1, 0, 2, 18, 15)
ssl.OP_ALL: 0x800003ff
ssl.OP_NO_TLSv1_1: 0x10000000
subprocess._USE_POSIX_SPAWN: True
sys.abiflags: d
sys.api_version: 1013
sys.builtin_module_names: ('_abc', '_ast', '_codecs', '_collections', '_functools', '_imp', '_io', '_locale', '_operator', '_signal', '_sre', '_stat', '_string', '_symtable', '_thread', '_tracemalloc', '_warnings', '_weakref', 'atexit', 'builtins', 'errno', 'faulthandler', 'gc', 'itertools', 'marshal', 'posix', 'pwd', 'sys', 'time', 'xxsubtype')
sys.byteorder: little
sys.dont_write_bytecode: False
sys.executable: /Users/pgalindo3/github/cpython/python.exe
sys.filesystem_encoding: utf-8/surrogateescape
sys.flags: sys.flags(debug=0, inspect=0, interactive=0, optimize=0, dont_write_bytecode=0, no_user_site=0, no_site=0, ignore_environment=0, verbose=0, bytes_warning=0, quiet=0, hash_randomization=1, isolated=0, dev_mode=False, utf8_mode=0)
sys.float_info: sys.float_info(max=1.7976931348623157e+308, max_exp=1024, max_10_exp=308, min=2.2250738585072014e-308, min_exp=-1021, min_10_exp=-307, dig=15, mant_dig=53, epsilon=2.220446049250313e-16, radix=2, rounds=1)
sys.float_repr_style: short
sys.hash_info: sys.hash_info(width=64, modulus=2305843009213693951, inf=314159, nan=0, imag=1000003, algorithm='siphash24', hash_bits=64, seed_bits=128, cutoff=0)
sys.hexversion: 50921632
sys.implementation: namespace(_multiarch='darwin', cache_tag='cpython-39', hexversion=50921632, name='cpython', version=sys.version_info(major=3, minor=9, micro=0, releaselevel='alpha', serial=0))
sys.int_info: sys.int_info(bits_per_digit=30, sizeof_digit=4)
sys.maxsize: 9223372036854775807
sys.maxunicode: 1114111
sys.path: ['/Users/pgalindo3/github/cpython', '/usr/local/lib/python39.zip', '/Users/pgalindo3/github/cpython/Lib', '/Users/pgalindo3/github/cpython/build/lib.macosx-10.14-x86_64-3.9-pydebug']
sys.platform: darwin
sys.prefix: /usr/local
sys.stderr.encoding: utf-8/backslashreplace
sys.stdin.encoding: utf-8/strict
sys.stdout.encoding: utf-8/strict
sys.thread_info: sys.thread_info(name='pthread', lock='mutex+cond', version=None)
sys.version: 3.9.0a0 (heads/master:3f345c39255, Jun  7 2019, 14:02:55)  [Clang 10.0.1 (clang-1001.0.46.4)]
sys.version_info: sys.version_info(major=3, minor=9, micro=0, releaselevel='alpha', serial=0)
sysconfig[ABIFLAGS]: d
sysconfig[CC]: gcc
sysconfig[CFLAGS]: -Wno-unused-result -Wsign-compare -g -O0 -Wall -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include
sysconfig[CONFIG_ARGS]: '--with-pydebug' '--with-trace-refs' 'CFLAGS= -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include' 'LDFLAGS= -L/usr/local/opt/zlib/lib' 'CPPFLAGS= -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include' 'PKG_CONFIG_PATH=:/usr/local/opt/openssl/lib/pkgconfig:/usr/local/opt/zlib/lib/pkgconfig'
sysconfig[HOST_GNU_TYPE]: x86_64-apple-darwin18.6.0
sysconfig[MACHDEP]: darwin
sysconfig[MULTIARCH]: darwin
sysconfig[OPT]: -g -O0 -Wall
sysconfig[PY_CFLAGS]: -Wno-unused-result -Wsign-compare -g -O0 -Wall -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include
sysconfig[PY_CFLAGS_NODIST]: -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration -I./Include/internal
sysconfig[PY_CORE_LDFLAGS]: -L/usr/local/opt/zlib/lib -L/usr/local/opt/zlib/lib
sysconfig[PY_LDFLAGS]: -L/usr/local/opt/zlib/lib -L/usr/local/opt/zlib/lib
sysconfig[PY_STDMODULE_CFLAGS]: -Wno-unused-result -Wsign-compare -g -O0 -Wall -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration -I./Include/internal -I. -I./Include -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include -I/usr/local/opt/openssl/include -I/usr/local/opt/zlib/include
sysconfig[Py_DEBUG]: 1
sysconfig[Py_ENABLE_SHARED]: 0
sysconfig[SHELL]: /bin/sh
sysconfig[SOABI]: cpython-39d-darwin
sysconfig[prefix]: /usr/local
test_socket.HAVE_SOCKET_ALG: False
test_socket.HAVE_SOCKET_CAN: False
test_socket.HAVE_SOCKET_CAN_ISOTP: False
test_socket.HAVE_SOCKET_QIPCRTR: False
test_socket.HAVE_SOCKET_RDS: False
test_socket.HAVE_SOCKET_VSOCK: False
test_support.IPV6_ENABLED: True
test_support._is_gui_available: False
test_support.python_is_optimized: False
time.altzone: -3600
time.daylight: 1
time.get_clock_info(monotonic): namespace(adjustable=False, implementation='mach_absolute_time()', monotonic=True, resolution=1e-09)
time.get_clock_info(perf_counter): namespace(adjustable=False, implementation='mach_absolute_time()', monotonic=True, resolution=1e-09)
time.get_clock_info(process_time): namespace(adjustable=False, implementation='clock_gettime(CLOCK_PROCESS_CPUTIME_ID)', monotonic=True, resolution=1.0000000000000002e-06)
time.get_clock_info(thread_time): namespace(adjustable=False, implementation='clock_gettime(CLOCK_THREAD_CPUTIME_ID)', monotonic=True, resolution=1e-09)
time.get_clock_info(time): namespace(adjustable=True, implementation='clock_gettime(CLOCK_REALTIME)', monotonic=False, resolution=1.0000000000000002e-06)
time.time: 1559929662.8793879
time.timezone: 0
time.tzname: ('GMT', 'BST')
tkinter.TCL_VERSION: 8.5
tkinter.TK_VERSION: 8.5
tkinter.info_patchlevel: 8.5.9
zlib.ZLIB_RUNTIME_VERSION: 1.2.11
zlib.ZLIB_VERSION: 1.2.11



------------------------------------------

./configure

checking utime.h usability... yes
checking utime.h presence... yes
checking for utime.h... yes

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:53:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 17:53:26 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559930006.24.0.794028077237.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The failure tends to be very reliable when running with -R, running the test in isolation or only one time normally succeeds. I will try to investigate more.

The hardware is a MacBook Pro with Mojave 10.14.5, 2.2 GHz Intel Core i7 and 16 GB 2400 MHz DDR4.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:58:52 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 07 Jun 2019 17:58:52 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
Message-ID: <1559930332.06.0.798599689966.issue37181@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:


New changeset e7e5039d6940e41839dcef0433262ff363408dad by Steve Dower (Paul Monson) in branch 'master':
bpo-37181: Fix test_regrtest failures on Windows arm64 (GH-13872)
https://github.com/python/cpython/commit/e7e5039d6940e41839dcef0433262ff363408dad


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:58:53 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 17:58:53 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
In-Reply-To: <1559930332.06.0.798599689966.issue37181@roundup.psfhosted.org>
Message-ID: <1559930333.16.0.357760055036.issue37181@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13774
pull_request: https://github.com/python/cpython/pull/13899

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:59:17 2019
From: report at bugs.python.org (Riccardo Schirone)
Date: Fri, 07 Jun 2019 17:59:17 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1559930357.74.0.640852548427.issue36742@roundup.psfhosted.org>


Riccardo Schirone <rschiron at redhat.com> added the comment:

The fix for python-2.7 (https://github.com/python/cpython/pull/13815/files#diff-b577545d73dd0cdb2c337a4c5f89e1d7R183) causes errors when netloc contains characters that can't be encoded by 'ascii' codec.

You can see it by doing:
>>> netloc = u'example.com\uFF03 at bing.com'
>>> raise ValueError(u"netloc '" + netloc + u"' contains invalid characters under NFKC normalization")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ValueError: <exception str() failed>
>>> str(netloc)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeEncodeError: 'ascii' codec can't encode character u'\uff03' in position 11: ordinal not in range(128)

I suggest we use `repr(netloc)` instead of `netloc` in the ValueError message.

----------
nosy: +rschiron

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Fri Jun  7 13:59:19 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 07 Jun 2019 17:59:19 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1559930359.19.0.259619435198.issue37189@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Guessing Victor may have touched something in this area.

Was it exported before? Or did we just have a macro for it? Maybe the macro was moved to an internal header by mistake?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:01:10 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:01:10 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559930470.47.0.50315784952.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The problem is that one of the filenames that the test creates has this inode information for some mysterious reason:

? ll @test_25508_tmp/f1
-rw-r--r--  1 pgalindo3  staff     7B  1 Jan  1970 @test_25508_tmp/f1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:01:58 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 07 Jun 2019 18:01:58 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559930518.05.0.0449096359888.issue37138@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 1f9531764cc0f8dbca1d8f429d162dc28282f4b4 by Gregory P. Smith (Jeroen Demeyer) in branch 'master':
bpo-37138: fix undefined behaviour with memcpy() on NULL array (GH-13867)
https://github.com/python/cpython/commit/1f9531764cc0f8dbca1d8f429d162dc28282f4b4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:02:07 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 18:02:07 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559930527.59.0.352731197097.issue37138@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13775
pull_request: https://github.com/python/cpython/pull/13900

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:02:09 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:02:09 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559930529.05.0.818338975677.issue37195@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
Removed message: https://bugs.python.org/msg344983

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:05:12 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:05:12 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559930712.21.0.441207749457.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

For some reason, the files created for this test has a very weird inode information:

? ll test_python_**/**/f*
-rw-r--r--  1 pgalindo3  staff     7B  1 Jan  1970 test_python_26370/@test_26370_tmp/f1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:08:49 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 07 Jun 2019 18:08:49 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1559930929.93.0.326208952139.issue13501@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:09:20 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:09:20 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559930960.09.0.35915348514.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> For some reason, the files created for this test has a very weird inode information.

Ok, disregard what I am saying, that's actually part of the test. But I think this is related to the failure. I keep investigating.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:10:53 2019
From: report at bugs.python.org (Phil Frost)
Date: Fri, 07 Jun 2019 18:10:53 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559931053.12.0.145757878108.issue37168@roundup.psfhosted.org>


Phil Frost <phil.frost at postmates.com> added the comment:

I'm afraid that won't be of much use since the object is statically allocated. Besides, the trouble isn't finding what created the object, but what mutated an int object which should be immutable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:13:01 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:13:01 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559931181.0.0.880483966705.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Ok, this is the failure once I investigated with pdb:

(Pdb) filename
'@test_28886_tmp/f1'
(Pdb) atime_ns
1002003000
(Pdb) mtime_ns
4005006000
(Pdb) set_time(filename, (atime_ns, mtime_ns))
(Pdb) st = os.stat(filename)
(Pdb) st.st_atime, st.st_mtime
(1559931081.6983175, 4.005006)

Not sure why is that happening.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:13:47 2019
From: report at bugs.python.org (Christoph Gohlke)
Date: Fri, 07 Jun 2019 18:13:47 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1559931227.67.0.117818488231.issue37189@roundup.psfhosted.org>


Christoph Gohlke <cgohlke at uci.edu> added the comment:

`PyRun_String` was exported at least since `python23.dll`.

Python.Net relies on it at <https://github.com/pythonnet/pythonnet/blob/master/src/runtime/runtime.cs#L858>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:15:47 2019
From: report at bugs.python.org (Carol Willing)
Date: Fri, 07 Jun 2019 18:15:47 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559931347.02.0.713966297462.issue37195@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

@pablogsal My debug info looks similar to yours other than shell/terminal preferences. Similar specs on HW and OS.

./python.exe -m test test_os -R : -v Any other configs that you are frequently seeing the failures?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:16:49 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 07 Jun 2019 18:16:49 +0000
Subject: [issue13501] Make libedit support more generic;
 port readline / libedit to FreeBSD
In-Reply-To: <1322579942.3.0.601983912656.issue13501@psf.upfronthosting.co.za>
Message-ID: <1559931409.87.0.432367646637.issue13501@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

In PR it you refer to -ledit and to editline.  libedit and libeditline appear to be two different libraries.

I was under the impression that libedit is the desirable one (it's what *BSD uses - coming originally from NetBSD if I understand correctly - which is how it wound up being macOS's choice).  I could also be wrong.

Is there a relationship between libedit and libeditline?  They both look like useful non-GPL readline alternatives.

We're building CPython internally at Google with libedit instead of readline of late and our initial patch to do this looks similar (though simpler) than your PR's readline.c changes.  The #ifdef __APPLE__ checks are replaced with a #ifdef HAVE_LIBEDIT check which we set in our pyconfig.h.

I'm interested in seeing this stuff get in one way or another, there's no reason we should tie people to GNU readline. :)

----------
assignee:  -> gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13501>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:18:05 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 18:18:05 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
In-Reply-To: <1559930332.06.0.798599689966.issue37181@roundup.psfhosted.org>
Message-ID: <1559931485.2.0.773140338419.issue37181@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 84d47bd8ad48f29ed5d333f4307408ad1e081f59 by Miss Islington (bot) in branch '3.8':
bpo-37181: Fix test_regrtest failures on Windows arm64 (GH-13872)
https://github.com/python/cpython/commit/84d47bd8ad48f29ed5d333f4307408ad1e081f59


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:20:17 2019
From: report at bugs.python.org (Zachary Ware)
Date: Fri, 07 Jun 2019 18:20:17 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1559931617.72.0.177184846644.issue37189@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

A look through `git log -p` looks like bpo-34646 is likely to be related.

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:26:07 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 18:26:07 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559931967.02.0.232020762791.issue37138@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6e053079ac3fe50ffbe9128bcf766298168c31cb by Miss Islington (bot) in branch '3.8':
bpo-37138: fix undefined behaviour with memcpy() on NULL array (GH-13867)
https://github.com/python/cpython/commit/6e053079ac3fe50ffbe9128bcf766298168c31cb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:30:26 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Fri, 07 Jun 2019 18:30:26 +0000
Subject: [issue37138] PEP 590 method_vectorcall calls memcpy with NULL src
In-Reply-To: <1559535370.56.0.947989437279.issue37138@roundup.psfhosted.org>
Message-ID: <1559932226.64.0.167400779096.issue37138@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Thanks Jeroen!

----------
resolution:  -> fixed
stage: patch review -> commit review
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37138>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:30:38 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 07 Jun 2019 18:30:38 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559932238.08.0.739275648818.issue37176@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Please make a concrete proposal (a PR or somesuch). That will make it much easier to determine whether a particular bit of word-smithing is a improvement.

Of the issues discussed so far, these are the most promising:
* Document how the zero argument form of super() infers its arguments.
* Be clear that it is the mro of type(self) that determines the search path and that the role of super() is to the next in the mro after the current class.

----------
versions:  -Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:40:15 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 07 Jun 2019 18:40:15 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559932815.49.0.338068762935.issue37195@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

WHat kind of file system is @test_28886_tmp/f1 created on?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:42:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:42:26 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559932946.18.0.356147644943.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I will test this on other laptops to try to "bisect" configuration-wise, but for my investigation so far, it seems that the value in the (STRUCT_STAT) st->st_atime is directly wrong (is 1559932701 when the test fails and 1 when the test succeeds).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:44:02 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 07 Jun 2019 18:44:02 +0000
Subject: [issue37195] test_utime fails on MacOS Mojave (Kernel Version 18.6.0:)
In-Reply-To: <1559912694.09.0.24854010798.issue37195@roundup.psfhosted.org>
Message-ID: <1559933042.53.0.190779522201.issue37195@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> WHat kind of file system is @test_28886_tmp/f1 created on?

Apple_APFS

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37195>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:44:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 18:44:38 +0000
Subject: [issue21492] email.header.decode_header sometimes returns bytes,
 sometimes str
In-Reply-To: <1399972085.94.0.85314895463.issue21492@psf.upfronthosting.co.za>
Message-ID: <1559933078.68.0.198152941608.issue21492@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.7, Python 3.8, Python 3.9 -Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21492>
_______________________________________

From report at bugs.python.org  Fri Jun  7 14:58:45 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 18:58:45 +0000
Subject: [issue37129] Add os.RWF_APPEND flag for os.pwritev
Message-ID: <1559933925.78.0.510794410466.issue37129@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

Issues need a more complete title and at least *some* explanation.

----------
nosy: +terry.reedy
title: Add RWF_APPEND flag -> Add os.RWF_APPEND flag for os.pwritev
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37129>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:14:24 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 19:14:24 +0000
Subject: [issue37130] pathlib.with_name() doesn't like unnamed files.
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1559934864.81.0.254556749892.issue37130@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Welcome to Python.  If you end up proposing a change to code or doc, this will end up being the right place.  A change to a documented behavior be called an 'enhancement' and only applied to the next version.  A doc change will likely be backported.

----------
nosy: +terry.reedy
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:30:32 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Fri, 07 Jun 2019 19:30:32 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559935832.53.0.710254541197.issue37150@roundup.psfhosted.org>


Change by Michele Angrisano <michele.angrisano at gmail.com>:


----------
nosy: +bethard

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:32:16 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Fri, 07 Jun 2019 19:32:16 +0000
Subject: [issue37200] PyType_GenericAlloc might over-allocate memory
Message-ID: <1559935936.79.0.824964365383.issue37200@roundup.psfhosted.org>


New submission from Neil Schemenauer <nas-python at arctrix.com>:

In the process of working on some garbage collector/obmalloc experiments, I noticed what seems to be a quirk about PyType_GenericAlloc().  It calls:

size = _PyObject_VAR_SIZE(type, nitems+1);

Note the "+1" which is documented as "for the sentinel".  That code dates back to change "e5c691abe3946ddbaa00730b92f3b96f96903f7d" when Guido added support for heap types.  This extra item is not added by _PyObject_GC_NewVar().  Also, the documentation for tp_alloc says that the size of the allocated block should be:

  tp_basicsize + nitems*tp_itemsize, rounded up to a multiple of sizeof(void*);

The "+1" for the sentinel is definitely needed in certain cases.  I think it might only be needed if 'type' is a subtype of 'type'.  I.e. if Py_TPFLAGS_TYPE_SUBCLASS is set on 'type'.

I haven't done enough analysis to fully understand this quirk yet but I think we are allocating extra memory quite regularly.  Quite a lot of types use tp_alloc = PyType_GenericAlloc.  E.g. the 'list' type or a subclass of the tuple type.

It seems with the attached patch, unit tests still pass.  Perhaps the +1 could be removed on the non-GC branch of the code as well.

----------
components: Interpreter Core
files: generic_alloc_sentinel.txt
messages: 345002
nosy: nascheme
priority: normal
severity: normal
status: open
title: PyType_GenericAlloc might over-allocate memory
type: performance
Added file: https://bugs.python.org/file48403/generic_alloc_sentinel.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37200>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:50:05 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 19:50:05 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1559937005.27.0.30018100026.issue37133@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

In command prompt, I see the following, with comments added.

f:\dev\3x>PCbuild\build.bat -e
  # -e should not be needed, but explicitly says to build externals
Using py -3.7 (found 3.7 with py.exe)
  # You must have an installed python to build python.
Fetching external libraries...
  # There are 4.
bzip2-1.0.6 already exists, skipping.
  # You should see something about fetching.
...
Fetching external binaries...
  # There are 3
libffi already exists, skipping.
  # Again, you should see something about fetching.
  # Although the .c files are not downloaded, the include files, including ffi.h, are, in externals/libffi/(win32|amd64)/include.

I personally have not used PCBuild\pcbuild.sln for years, since Zach added a fully functional build.bat.  After running the resulting binary, I pin the icon to the taskbar, so I can easily run freshly compiled python interactively without blocking the command window.  The pinned icon remains valid after re-compiles, which I do often.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:56:12 2019
From: report at bugs.python.org (Marco Sulla)
Date: Fri, 07 Jun 2019 19:56:12 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559937372.64.0.175078722487.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

Please Mr. Cannon, can you read my last posts? I think they are not describing a mad idea, but something reasonable.

----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:57:03 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 19:57:03 +0000
Subject: [issue37141] Allow multiple separators in Stream.readuntil
In-Reply-To: <1559554350.7.0.981137522594.issue37141@roundup.psfhosted.org>
Message-ID: <1559937423.56.0.423664121829.issue37141@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
stage:  -> test needed
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37141>
_______________________________________

From report at bugs.python.org  Fri Jun  7 15:59:04 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 19:59:04 +0000
Subject: [issue37144] tarfile.open: improper handling of path-like object
In-Reply-To: <1559573660.5.0.124771167649.issue37144@roundup.psfhosted.org>
Message-ID: <1559937544.13.0.711906943035.issue37144@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

3.6 only gets security patches.  Thanks for testing with 3.7 also.

----------
nosy: +terry.reedy
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37144>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:01:24 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 20:01:24 +0000
Subject: [issue37149] link to official documentation tkinter failed  !!!
In-Reply-To: <1559649566.96.0.759993950384.issue37149@roundup.psfhosted.org>
Message-ID: <1559937684.77.0.25295901439.issue37149@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
Removed message: https://bugs.python.org/msg344550

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37149>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:08:41 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 20:08:41 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559938121.73.0.828415999402.issue37150@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 03d5831a2d62c68654ec223168e574cd546efbf6 by Miss Islington (bot) (zygocephalus) in branch 'master':
bpo-37150: Throw ValueError if FileType class object was passed in add_argument (GH-13805)
https://github.com/python/cpython/commit/03d5831a2d62c68654ec223168e574cd546efbf6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:08:58 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 20:08:58 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559938138.28.0.0650123454792.issue37150@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13776
pull_request: https://github.com/python/cpython/pull/13901

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:19:30 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Fri, 07 Jun 2019 20:19:30 +0000
Subject: [issue37196] Allowing arbitrary expressions in the @expression syntax
In-Reply-To: <1559916315.57.0.952678742799.issue37196@roundup.psfhosted.org>
Message-ID: <1559938770.85.0.531194890852.issue37196@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37196>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:30:25 2019
From: report at bugs.python.org (Evita Cano)
Date: Fri, 07 Jun 2019 20:30:25 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1559939425.68.0.719305745705.issue37151@roundup.psfhosted.org>


Change by Evita Cano <evitaesmecano4321 at gmail.com>:


----------
nosy: +Evita Cano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:43:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 07 Jun 2019 20:43:46 +0000
Subject: [issue37168] Decimal divisions sometimes 10x or 100x too large
In-Reply-To: <1559772321.45.0.42770583159.issue37168@roundup.psfhosted.org>
Message-ID: <1559940226.3.0.345495943663.issue37168@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Can you try to reproduce your workflow with Python compiled in debug mode (./configure --with-pydebug)? With Python 3.8, you can now use a debug Python without having to recompile your C extensions :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37168>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:47:57 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 07 Jun 2019 20:47:57 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
Message-ID: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

There are a few places where ARM64 is not correctly specified in order for distutils to work for on-target builds using Visual Studio (32-bit x86 emulation).

----------
components: Tests, Windows
messages: 345008
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: fix test_distutils failures for Windows ARM64
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:55:24 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 07 Jun 2019 20:55:24 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
In-Reply-To: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>
Message-ID: <1559940924.19.0.711188327424.issue37201@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13777
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13902

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Fri Jun  7 16:56:46 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 07 Jun 2019 20:56:46 +0000
Subject: [issue37162] new importlib dependencies csv, email and zipfile
In-Reply-To: <1559732109.6.0.0655643851833.issue37162@roundup.psfhosted.org>
Message-ID: <1559941006.44.0.08671715584.issue37162@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

@serhiy: mind opening a new issue for your zipfile.Path worry?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37162>
_______________________________________

From report at bugs.python.org  Fri Jun  7 17:00:27 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 07 Jun 2019 21:00:27 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559941227.77.0.554892780158.issue36964@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Please do not add me back to the nosy list as I stand by my thinking that this feature isn't worth pursuing. I understand you feel they are reasonable, Marco, but I don't like the idea of changing what VIRTUAL_ENV gets set to when I believe you should recreate the virtual environment as necessary and risk surprising people who expect VIRTUAL_ENV to function as it does today and has for years.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Fri Jun  7 17:00:37 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 07 Jun 2019 21:00:37 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1559941237.45.0.944552263534.issue36964@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Fri Jun  7 17:12:04 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 07 Jun 2019 21:12:04 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559941924.47.0.0562452610754.issue37150@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 606ac581e2451c420117c55632f0fe13d4cec2cd by Miss Islington (bot) in branch '3.8':
bpo-37150: Throw ValueError if FileType class object was passed in add_argument (GH-13805)
https://github.com/python/cpython/commit/606ac581e2451c420117c55632f0fe13d4cec2cd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Fri Jun  7 17:12:36 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 07 Jun 2019 21:12:36 +0000
Subject: [issue37150] Do not allow to pass FileType class object instead of
 instance in add_argument
In-Reply-To: <1559654520.68.0.135252915467.issue37150@roundup.psfhosted.org>
Message-ID: <1559941956.34.0.469277649107.issue37150@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 2.7, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37150>
_______________________________________

From report at bugs.python.org  Fri Jun  7 18:51:52 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 22:51:52 +0000
Subject: [issue37161] Pre-populate user editable text in input()
In-Reply-To: <1559731249.86.0.916028878199.issue37161@roundup.psfhosted.org>
Message-ID: <1559947912.84.0.346640030736.issue37161@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I like the idea, but doubt this can be implemented.  Python assumes a least-common-denominator dumb terminal.  Program output is sent on stdout/err and displayed read-only.  Used input is read from stdin.  It is put there either key by key or after the Enter key is hit.  An input buffer allows editing before hitting enter.

'Dumb' means 'No smart escape code to put following output into the user input buffer.' Actually, I don't know that there is an ansi codes to do that.  I am curious how readline.insert_text works.  (I don't have it on Windows.)

Even if the feature could be made to run on Mac/Linux/Windows10 system consoles with custom , there is the issue of supporting other displays, such as IDLE.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37161>
_______________________________________

From report at bugs.python.org  Fri Jun  7 19:07:59 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 07 Jun 2019 23:07:59 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1559948879.38.0.546890060391.issue37172@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
title: Odd error awating a Future -> Odd error awaiting a Future
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Fri Jun  7 19:09:40 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 07 Jun 2019 23:09:40 +0000
Subject: [issue18355] Merge super() guide into documentation
In-Reply-To: <1372901200.41.0.725969821731.issue18355@psf.upfronthosting.co.za>
Message-ID: <1559948980.2.0.0445530548621.issue18355@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I think for now I'll leave this as an external supplement to the documentation.  My previous experience with moving a personal blog post into the main docs didn't go so well.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18355>
_______________________________________

From report at bugs.python.org  Fri Jun  7 19:11:45 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Fri, 07 Jun 2019 23:11:45 +0000
Subject: [issue37200] PyType_GenericAlloc might over-allocate memory
In-Reply-To: <1559935936.79.0.824964365383.issue37200@roundup.psfhosted.org>
Message-ID: <1559949105.71.0.149269754607.issue37200@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

Updated patch is attached.  It appears that the extra item is only needed if Py_TPFLAGS_TYPE_SUBCLASS set.  In all other cases, it seems we don't need the extra space for the sentinel.  At least, the unit tests pass with this change.  It could be that some extension module depends on this extra allocated spaced.

The number of types affected by this change seem relatively small.  The 'list' type is not affected because tp_itemsize is 0.  I did a little test by running some unit tests, here are some type names that have a smaller amount of memory allocated for them:

   _NamedIntConstant
   CodecInfo
   Point
   TestResults
   madtuple

----------
priority: normal -> low
stage:  -> patch review
Added file: https://bugs.python.org/file48404/generic_alloc_sentinel_v2.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37200>
_______________________________________

From report at bugs.python.org  Fri Jun  7 19:23:55 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 07 Jun 2019 23:23:55 +0000
Subject: [issue36924] Simplify implementation of
 classmethod_descriptor.__call__
In-Reply-To: <1557921506.83.0.125634021475.issue36924@roundup.psfhosted.org>
Message-ID: <1559949835.92.0.767736011126.issue36924@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> However, calling them is unlikely to happen in practice: the 
> only way to obtain such an object is to extract from the 
> class __dict__.

Generally the experience of the PyPy team has been that every code that a user can take is in fact taken by some users.  Usually, we don't get to change a publicly accessible API to facilitate an optimization.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36924>
_______________________________________

From report at bugs.python.org  Fri Jun  7 19:45:38 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 07 Jun 2019 23:45:38 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559915805.1.0.622151012135.issue37176@roundup.psfhosted.org>
Message-ID: <20190607234532.GN4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> I'm sorry to say that you're wrong here. 

I'm happy to be corrected.

It is fair to say I failed to take the multiple inheritance case into 
account. Clearly super can't *only* look at the MRO of the first object 
since that will miss the multiple inheritance case, as you point out. 
Thank you.

But neither can it *only* look at the MRO of the second class, because 
that would restart the search at the top of the hierarchy; also if 
type(second argument) was the only thing that mattered, that would make 
the first argument redundant and pointless.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 20:20:08 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 00:20:08 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1559953208.98.0.112702865809.issue37178@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +13778
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13905

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Fri Jun  7 20:26:57 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 00:26:57 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559953617.49.0.384556494473.issue37176@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee: docs at python -> rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 21:40:13 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 08 Jun 2019 01:40:13 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1559958013.21.0.19055377318.issue37172@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Dima, unless you want to make a specific doc change suggestion, I think this should be closed.  The planned code changes will be on other issues.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Fri Jun  7 21:48:22 2019
From: report at bugs.python.org (Eric Wieser)
Date: Sat, 08 Jun 2019 01:48:22 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559958502.68.0.257598382428.issue37188@roundup.psfhosted.org>


Change by Eric Wieser <wieser.eric+pybug at gmail.com>:


----------
pull_requests: +13779
stage: backport needed -> patch review
pull_request: https://github.com/python/cpython/pull/13906

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Fri Jun  7 22:47:09 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 08 Jun 2019 02:47:09 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559962029.74.0.656499631503.issue37173@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The correct message would be
"<class 'str'> is a built-in class"

We do not backport exception message changes unless 'buggy enough'.  I asked on core-mentorship whether this fix qualifies.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Fri Jun  7 23:08:55 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sat, 08 Jun 2019 03:08:55 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559920875.31.0.876490053842.issue37176@roundup.psfhosted.org>
Message-ID: <20190608030849.GO4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> > What matters is the __mro__ attribute of the first argument. It matters 
> because that is how the MRO actually is searched.
> 
> By the way, if it was true (it is not), 

Yes, I see that now.

> then what did you think was 
> the purpose of the second parameter of super(type, obj-or-type)?

Given super(T, obj).method the method object is bound to instance obj; 
how else could it return a bound method instead of an unbound one?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Fri Jun  7 23:21:17 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 03:21:17 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1559964077.57.0.261024483991.issue37178@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

It's possible the word permutations means something different to you than it does to me.  The itertools.permutations() function is only one function, one that includes the default option to generate all permutations.  It does the same as permute(n, r) and permute(n) in Maple; and the same as Permutations[list, n] and Permutations[list] in Mathematica.  For the math module, perm(n) is just a common special case that means all possible arrangements.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Fri Jun  7 23:32:20 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 08 Jun 2019 03:32:20 +0000
Subject: [issue37174] sched.py: run() is caught in delayfunc even if all
 events are cancelled.
In-Reply-To: <1559822786.43.0.93146538102.issue37174@roundup.psfhosted.org>
Message-ID: <1559964740.08.0.97939456021.issue37174@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

3.6 only gets security fixes.  3.7, 3.8 only get bugfixes.  Something new should be a separate PR.

----------
nosy: +terry.reedy
stage:  -> test needed
versions:  -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37174>
_______________________________________

From report at bugs.python.org  Sat Jun  8 00:26:10 2019
From: report at bugs.python.org (Ammar Askar)
Date: Sat, 08 Jun 2019 04:26:10 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1559967970.28.0.749986986483.issue29505@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
pull_requests: +13780
pull_request: https://github.com/python/cpython/pull/13907

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 01:32:38 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 08 Jun 2019 05:32:38 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1559971958.55.0.329117490118.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Another data point:

On macOS 10.14.4, unlink() returns EBUSY when it tries to delete the mount point. tempfile.TemporaryDirectory() doesn't handle EBUSY and ends up skipping over the mount point and propagates the OSError exception up to the caller.  It leaves the mounted directory tree untouched.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Sat Jun  8 01:49:36 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 05:49:36 +0000
Subject: [issue37174] sched.py: run() is caught in delayfunc even if all
 events are cancelled.
In-Reply-To: <1559822786.43.0.93146538102.issue37174@roundup.psfhosted.org>
Message-ID: <1559972976.8.0.0255330321627.issue37174@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Marking this as 3.9 because it is an API change.  Also, you can already control the delayfunc through the current API, so I don't see the necessity of a changing the default which seems to work fine for most users.

Tim, what do you think?

----------
nosy: +rhettinger, tim.peters
versions:  -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37174>
_______________________________________

From report at bugs.python.org  Sat Jun  8 02:54:16 2019
From: report at bugs.python.org (hai shi)
Date: Sat, 08 Jun 2019 06:54:16 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1559976856.0.0.581227719791.issue18299@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
pull_requests: +13781
pull_request: https://github.com/python/cpython/pull/13908

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Sat Jun  8 03:30:48 2019
From: report at bugs.python.org (Ma Lin)
Date: Sat, 08 Jun 2019 07:30:48 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559979048.7.0.131971882813.issue37188@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

> 3.7/3.8 are done

3.7 and master (3.9) are done, 3.8 was missed.

----------
nosy: +Ma Lin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Sat Jun  8 03:50:27 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 08 Jun 2019 07:50:27 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1559980227.52.0.29655295123.issue36520@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +13782
pull_request: https://github.com/python/cpython/pull/13909

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Sat Jun  8 03:50:37 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 08 Jun 2019 07:50:37 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1559980237.0.0.132607405329.issue36520@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +13783
pull_request: https://github.com/python/cpython/pull/13910

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Sat Jun  8 05:19:36 2019
From: report at bugs.python.org (Stefan Krah)
Date: Sat, 08 Jun 2019 09:19:36 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559985576.73.0.957841681242.issue37188@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:


New changeset 48f190f79cd89f7ad4409b3c782e462368583309 by Stefan Krah (Eric Wieser) in branch '2.7':
[2.7] bpo-37188: Fix a divide-by-zero in arrays of size-0 objects (#13906)
https://github.com/python/cpython/commit/48f190f79cd89f7ad4409b3c782e462368583309


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Sat Jun  8 05:24:49 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 09:24:49 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559985889.06.0.363125512237.issue37188@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13784
pull_request: https://github.com/python/cpython/pull/13911

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Sat Jun  8 05:46:58 2019
From: report at bugs.python.org (Stefan Krah)
Date: Sat, 08 Jun 2019 09:46:58 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559987218.41.0.636376667949.issue37188@roundup.psfhosted.org>


Stefan Krah <stefan at bytereef.org> added the comment:


New changeset 3d03a35ba0f162a350898100efc95fdf392070a2 by Stefan Krah (Miss Islington (bot)) in branch '3.8':
[3.8] bpo-37188: Fix a divide-by-zero in arrays of size-0 objects (#13911)
https://github.com/python/cpython/commit/3d03a35ba0f162a350898100efc95fdf392070a2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Sat Jun  8 05:56:26 2019
From: report at bugs.python.org (Stefan Krah)
Date: Sat, 08 Jun 2019 09:56:26 +0000
Subject: [issue37188] Creating a ctypes array of an element with size zero
 causes "Fatal Python error: Floating point exception"
In-Reply-To: <1559889694.06.0.92762632537.issue37188@roundup.psfhosted.org>
Message-ID: <1559987786.54.0.0639204402089.issue37188@roundup.psfhosted.org>


Change by Stefan Krah <stefan at bytereef.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37188>
_______________________________________

From report at bugs.python.org  Sat Jun  8 06:27:52 2019
From: report at bugs.python.org (Martin Panter)
Date: Sat, 08 Jun 2019 10:27:52 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559989672.01.0.144658126548.issue37176@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

Some of the problems brought up here (which sibling or subclass, and which parameter?s MRO) also came up a few years ago in Issue 23674.

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Sat Jun  8 06:28:54 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 08 Jun 2019 10:28:54 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1559989734.66.0.564873636961.issue37176@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Steven D'Aprano

> But neither can it *only* look at the MRO of the second class, because that would restart the search at the top of the hierarchy; also if type(second argument) was the only thing that mattered, that would make the first argument redundant and pointless.

Yes of course, but nobody states the opposite. Both parameters are necessary super(type1, obj-or-type2):

? the first one for getting the start class in the MRO, which is the class following type1 in the MRO;
? the second one for getting the MRO, which is type(obj).__mro__ if it is an instance of type1 or type2.__mro__ if it is a subclass of type1, and for binding the function into a method in a super(type1, obj).function expression (as you correctly said in your last message).

Guido's Python equivalent implementation of super() given in his 2002 paper Unifying types and classes in Python 2.2 is very informative:
https://www.python.org/download/releases/2.2.3/descrintro/#cooperation

All this confusion around super() shows that there is room for improvement in the documentation.

@Raymond Hettinger

> Please make a concrete proposal (a PR or somesuch).

I will try to make a PR this weekend if I find some time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Sat Jun  8 07:07:20 2019
From: report at bugs.python.org (Roland Netzsch)
Date: Sat, 08 Jun 2019 11:07:20 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
Message-ID: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>


New submission from Roland Netzsch <stuxcrystal at gmail.com>:

The attached file produces the following output:

    wait is still running
    wait is not set to cancelled!
    Awaiting cancelled future produced a CancelledError.

A look a the documentation does not suggest a need to await the future in order to make sure the cancelled-flag is being set.

----------
components: asyncio
files: test.py
messages: 345029
nosy: Roland Netzsch, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Future.cancelled is not set to true immediately after calling Future.cancel
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48405/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 07:14:36 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 08 Jun 2019 11:14:36 +0000
Subject: [issue33071] Document that PyPI no longer requires 'register'
In-Reply-To: <1520950887.05.0.467229070634.issue33071@psf.upfronthosting.co.za>
Message-ID: <1559992476.94.0.89996064626.issue33071@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33071>
_______________________________________

From report at bugs.python.org  Sat Jun  8 07:15:16 2019
From: report at bugs.python.org (Roland Netzsch)
Date: Sat, 08 Jun 2019 11:15:16 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1559992516.07.0.0278368696038.issue37202@roundup.psfhosted.org>


Roland Netzsch <stuxcrystal at gmail.com> added the comment:

Python-Version:

[stuxcrystal at caprica ~]$ python3.7 --version
Python 3.7.3


Additional Notes:
Distribution: Fedora 30 (Workstation Edition)
Kernel: x86_64 Linux 5.0.9-301.fc30.x86_64

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 07:51:27 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 08 Jun 2019 11:51:27 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
Message-ID: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>


New submission from G?ry <gery.ogam at gmail.com>:

With the current Python equivalent `ClassMethod` implementation of `classmethod` given in Raymond Hettinger's _Descriptor HowTo Guide_, the following code snippet:

```
class A:
    @ClassMethod
    def f(cls, *, x): pass

print(A.f)
A.f(x=3)
```

prints:

> <function ClassMethod.\_\_get\_\_.<locals>.newfunc at 0x106b76268>

and raises:

> TypeError: newfunc() got an unexpected keyword argument 'x'

instead of only printing:

> <bound method A.f of <class '\_\_main\_\_.A'>>

like the `@classmethod` decorator would do.

So the `ClassMethod` implementation fails in two regards:
* it does not return a bound method to a class;
* it does not handle keyword-only arguments.

With this PR `ClassMethod` will correctly emulate `classmethod`. This approach (`types.MethodType`) is already used in the Python equivalent `Function` implementation of functions given earlier in the same guide.

----------
assignee: docs at python
components: Documentation
messages: 345031
nosy: docs at python, eric.araujo, ezio.melotti, maggyero, mdk, rhettinger, willingc
priority: normal
pull_requests: 13785
severity: normal
status: open
title: Correct classmethod emulation in Descriptor HowTo Guide
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:04:37 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 08 Jun 2019 12:04:37 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559995477.12.0.279917624477.issue37173@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I think landing the fix to 3.8 only is just fine

----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:04:44 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 08 Jun 2019 12:04:44 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559995484.1.0.660050745465.issue37173@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
versions:  -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:05:51 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 12:05:51 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559995551.27.0.305787039468.issue37173@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d407d2a7265f6102e51a1d62b3fd28b4f7a78d16 by Miss Islington (bot) (Philipp A) in branch 'master':
bpo-37173: Show passed class in inspect.getfile error (GH-13861)
https://github.com/python/cpython/commit/d407d2a7265f6102e51a1d62b3fd28b4f7a78d16


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:06:23 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 12:06:23 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559995583.29.0.45661009413.issue37173@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13786
pull_request: https://github.com/python/cpython/pull/13913

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:15:47 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 08 Jun 2019 12:15:47 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559996147.32.0.63027408678.issue37173@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 08:25:04 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 12:25:04 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1559996704.42.0.389182108129.issue37173@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c5daae4ef6d09269c95ed1023e76932cc179f309 by Miss Islington (bot) in branch '3.8':
bpo-37173: Show passed class in inspect.getfile error (GH-13861)
https://github.com/python/cpython/commit/c5daae4ef6d09269c95ed1023e76932cc179f309


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 09:17:26 2019
From: report at bugs.python.org (Tal Einat)
Date: Sat, 08 Jun 2019 13:17:26 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1559999846.9.0.270594855174.issue37177@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

The issue Irv reported happened on macOS but not on Windows. I've reproduced his issue without this fix, and checked that this fix does indeed fix his issue.

For future reference, Irv also posted a video showing his issue on YouTube[1] (he sent a link to idle-dev).

[1] http://www.youtube.com/watch?v=YWDsOEN8qsE

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Sat Jun  8 09:21:37 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 08 Jun 2019 13:21:37 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1560000097.01.0.954638205945.issue37202@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

This is the expected behavior.

asyncio.ensure_future() returns not a future but a task for your case.
Task cancellation requires at least one context switch to finish the task.

P.S.
I suggest replacing `asyncio.ensure_future()` with `asyncio.create_task()` to avoid confusion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 09:56:52 2019
From: report at bugs.python.org (Vlad Shcherbina)
Date: Sat, 08 Jun 2019 13:56:52 +0000
Subject: [issue37204] Scripts and binaries in PYTHON_PREFIX/Scripts contain
 unnecessarily lowercased path to Python location on Windows
Message-ID: <1560002212.48.0.983837427907.issue37204@roundup.psfhosted.org>


New submission from Vlad Shcherbina <vlad.shcherbina at gmail.com>:

To reproduce:

1. Download and run Python installer (I used python-3.7.3-amd64-webinstall.exe).
2. Modify install settings:
   - Install for all users: yes
   - Customize install location: "C:\Python37"
   (don't know if it's relevant, mentioning it just in case)
3. Install.
4. Run the following commands:
    pip --version
    py -m pip --version

Expected result:

> pip --version
pip 19.0.3 from C:\Python37\lib\site-packages\pip (python 3.7)
> py -m pip --version
pip 19.0.3 from C:\Python37\lib\site-packages\pip (python 3.7)

Actual result:

> pip --version
pip 19.0.3 from c:\python37\lib\site-packages\pip (python 3.7)
> py -m pip --version
pip 19.0.3 from C:\Python37\lib\site-packages\pip (python 3.7)


Same happens for all binaries and scripts in PYTHON_PREFIX/Scripts, not only for pip.exe.

For example, if I install pytest (using "pip install pytest" or "py -m pip install pytest", doesn't matter), I get the following:

> pytest -v
============================================================ test session starts ============================================================
platform win32 -- Python 3.7.3, pytest-4.6.2, py-1.8.0, pluggy-0.12.0 -- c:\python37\python.exe
cachedir: .pytest_cache
rootdir: C:\temp\qqq
collected 0 items
======================================================= no tests ran in 0.02 seconds ========================================================

> py -m pytest -v
============================================================ test session starts ============================================================
platform win32 -- Python 3.7.3, pytest-4.6.2, py-1.8.0, pluggy-0.12.0 -- C:\Python37\python.exe
cachedir: .pytest_cache
rootdir: C:\temp\qqq
collected 0 items
======================================================= no tests ran in 0.02 seconds ========================================================

----------
components: Distutils, Installation, Windows
messages: 345037
nosy: dstufft, eric.araujo, paul.moore, steve.dower, tim.golden, vlad, zach.ware
priority: normal
severity: normal
status: open
title: Scripts and binaries in PYTHON_PREFIX/Scripts contain unnecessarily lowercased path to Python location on Windows
type: behavior
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37204>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:03:55 2019
From: report at bugs.python.org (Roland Netzsch)
Date: Sat, 08 Jun 2019 14:03:55 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1560002635.46.0.469626760791.issue37202@roundup.psfhosted.org>


Roland Netzsch <stuxcrystal at gmail.com> added the comment:

So there is no way to reliably find out whether a task has been cancelled by calling Task.cancelled()?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:43:19 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 08 Jun 2019 14:43:19 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560004999.69.0.597752132482.issue29505@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset a15a7bcaea54e1845ab2abe27e6f583294cd715b by Gregory P. Smith (Ammar Askar) in branch 'master':
bpo-29505: Fix interpreter in fuzzing targets to be relocatable (GH-13907)
https://github.com/python/cpython/commit/a15a7bcaea54e1845ab2abe27e6f583294cd715b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:43:47 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 14:43:47 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560005027.77.0.978286704477.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13787
pull_request: https://github.com/python/cpython/pull/13914

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:43:55 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 14:43:55 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560005035.46.0.0746585234072.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13788
pull_request: https://github.com/python/cpython/pull/13915

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:46:59 2019
From: report at bugs.python.org (Owais Kazi)
Date: Sat, 08 Jun 2019 14:46:59 +0000
Subject: [issue10880] do_mkvalue and 'boolean'
In-Reply-To: <1294678522.28.0.674271875959.issue10880@psf.upfronthosting.co.za>
Message-ID: <1560005219.09.0.308378134517.issue10880@roundup.psfhosted.org>


Owais Kazi <owaiskazi19 at gmail.com> added the comment:

If it's a easy patch, I would like to pick it up. Can someone please explain how should I proceed with this? I am already done with the setup.
TIA

----------
nosy: +Owais Kazi
type: enhancement -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue10880>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:50:30 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 08 Jun 2019 14:50:30 +0000
Subject: [issue37204] Scripts and binaries in PYTHON_PREFIX/Scripts contain
 unnecessarily lowercased path to Python location on Windows
In-Reply-To: <1560002212.48.0.983837427907.issue37204@roundup.psfhosted.org>
Message-ID: <1560005430.41.0.304574062599.issue37204@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This is due to how the pip.exe launcher is generated, which is part of pip itself (actually distlib, I think, but someone over there can redirect).

Please report this at https://github.com/pypa/pip

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37204>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:56:27 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 08 Jun 2019 14:56:27 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560005787.69.0.752030537519.issue34886@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 8cc605acdda5aff250ab4c9b524a7560f90ca9f3 by Gregory P. Smith (R?mi Lapeyre) in branch 'master':
bpo-34886: Fix subprocess.run handling of exclusive arguments (GH-11727)
https://github.com/python/cpython/commit/8cc605acdda5aff250ab4c9b524a7560f90ca9f3


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:56:35 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 14:56:35 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560005795.95.0.0887574083293.issue34886@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13789
pull_request: https://github.com/python/cpython/pull/13916

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:56:42 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 14:56:42 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560005802.2.0.351465659875.issue34886@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13790
pull_request: https://github.com/python/cpython/pull/13917

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Sat Jun  8 10:58:49 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 08 Jun 2019 14:58:49 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1560005929.44.0.37637619643.issue37173@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Right, 3.8 not being released yet makes it different.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:02:52 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:02:52 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1560006172.27.0.287999315764.issue37173@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13791
pull_request: https://github.com/python/cpython/pull/13918

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:03:08 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:03:08 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560006188.63.0.5594151341.issue29505@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 22b69da4c38042e923d633530bdafc1b5fb94928 by Miss Islington (bot) in branch '3.8':
bpo-29505: Fix interpreter in fuzzing targets to be relocatable (GH-13907)
https://github.com/python/cpython/commit/22b69da4c38042e923d633530bdafc1b5fb94928


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:03:49 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:03:49 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560006229.34.0.00817532303248.issue29505@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6692d35317a45905a043dccae3940ea5d5d84352 by Miss Islington (bot) in branch '3.7':
bpo-29505: Fix interpreter in fuzzing targets to be relocatable (GH-13907)
https://github.com/python/cpython/commit/6692d35317a45905a043dccae3940ea5d5d84352


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:15:10 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:15:10 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560006910.5.0.560287403337.issue34886@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6324ac1293b2cf71559869b88f89f510f9a62a8e by Miss Islington (bot) in branch '3.8':
bpo-34886: Fix subprocess.run handling of exclusive arguments (GH-11727)
https://github.com/python/cpython/commit/6324ac1293b2cf71559869b88f89f510f9a62a8e


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:16:31 2019
From: report at bugs.python.org (Vlad Shcherbina)
Date: Sat, 08 Jun 2019 15:16:31 +0000
Subject: [issue37204] Scripts and binaries in PYTHON_PREFIX/Scripts contain
 unnecessarily lowercased path to Python location on Windows
In-Reply-To: <1560002212.48.0.983837427907.issue37204@roundup.psfhosted.org>
Message-ID: <1560006991.81.0.780152543961.issue37204@roundup.psfhosted.org>


Vlad Shcherbina <vlad.shcherbina at gmail.com> added the comment:

https://github.com/pypa/pip/issues/6582

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37204>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:23:55 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 08 Jun 2019 15:23:55 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1560007435.8.0.490450106252.issue37202@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I don't follow what reliability guarantee are you requesting.

A cite from task.cancel() docstring:

> Request that this task cancel itself.

        This arranges for a CancelledError to be thrown into the
        wrapped coroutine on the next cycle through the event loop.
        The coroutine then has a chance to clean up or even deny
        the request using try/except/finally.

        Unlike Future.cancel, this does not guarantee that the
        task will be cancelled: the exception might be caught and
        acted upon, delaying cancellation of the task or preventing
        cancellation completely.  The task may also return a value or
        raise a different exception.

        Immediately after this method is called, Task.cancelled() will
        not return True (unless the task was already cancelled).  A
        task will be marked as cancelled when the wrapped coroutine
        terminates with a CancelledError exception (even if cancel()
        was not called).

task.cancelled() returns True for canceled and finished tasks, but task.cancel() is a request for cancellation. The requested task needs some time to gracefully finish itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:24:13 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:24:13 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560007453.61.0.302359730855.issue34886@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 10b4fd98142edef6ab7b034e10ae5c9551043999 by Miss Islington (bot) in branch '3.7':
bpo-34886: Fix subprocess.run handling of exclusive arguments (GH-11727)
https://github.com/python/cpython/commit/10b4fd98142edef6ab7b034e10ae5c9551043999


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:27:09 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:27:09 +0000
Subject: [issue37173] inspect.getfile error names module instead of passed
 class
In-Reply-To: <1559819294.25.0.844595961888.issue37173@roundup.psfhosted.org>
Message-ID: <1560007629.22.0.360392479638.issue37173@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 51c9cc73cb8768a691688755af0a8b6b12cf712c by Miss Islington (bot) in branch '3.7':
bpo-37173: Show passed class in inspect.getfile error (GH-13861)
https://github.com/python/cpython/commit/51c9cc73cb8768a691688755af0a8b6b12cf712c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37173>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:27:31 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 08 Jun 2019 15:27:31 +0000
Subject: [issue37177] IDLE: Search dialogs can be hidden behind the main window
In-Reply-To: <1559838119.79.0.14038633601.issue37177@roundup.psfhosted.org>
Message-ID: <1560007651.74.0.376411495249.issue37177@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I saw the email, thanks for testing.

Irv, a reminder: All reports of IDLE UI behavior (and some of internal behavior) need to be tagged with OS.  Working 'cross-platform' does not mean 'the same across platforms'.  In particular, tcl/tk long ago made a decision to adjust to platform conventions (which have sometimes changed ;-).  I should have asked 'what OS' when I saw your report.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37177>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:42:23 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 15:42:23 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560008543.53.0.570121462832.issue37203@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee: docs at python -> rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:48:39 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 15:48:39 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560008919.13.0.561973062155.issue37203@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

This wasn't intended to be an exact equivalent. Instead, it focuses on the key action of classmethod which is prepending the class to the call.  Though less accurate, the current version communicates better.  I suggest adding a short comment to the effect that "newfunc" emulates "types.MethodType(self.f, klass)".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:58:15 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 15:58:15 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1560009495.72.0.330987500584.issue37178@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset e119b3d136bd94d880bce4b382096f6de3f38062 by Raymond Hettinger in branch 'master':
bpo-37178: Allow a one argument form of math.perm() (GH-13905)
https://github.com/python/cpython/commit/e119b3d136bd94d880bce4b382096f6de3f38062


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Sat Jun  8 11:59:30 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 15:59:30 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1560009570.19.0.769874946925.issue37178@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13792
pull_request: https://github.com/python/cpython/pull/13919

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Sat Jun  8 12:17:37 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 16:17:37 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1560010657.16.0.391148432401.issue37178@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset feaceaafe816e95c4aff15eab0bea6dc2bbfe4fd by Raymond Hettinger (Miss Islington (bot)) in branch '3.8':
bpo-37178: Allow a one argument form of math.perm() (GH-13905) (GH-13919)
https://github.com/python/cpython/commit/feaceaafe816e95c4aff15eab0bea6dc2bbfe4fd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Sat Jun  8 12:26:43 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Sat, 08 Jun 2019 16:26:43 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1560011203.12.0.742115892101.issue37176@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Some of the problems brought up here (which sibling or subclass, and which parameter?s MRO) also came up a few years ago in Issue 23674.

Indeed. I would actually say that these two issues are duplicates of each other.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Sat Jun  8 13:21:00 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 08 Jun 2019 17:21:00 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560014460.18.0.784093150168.issue37189@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

It shouldn't break existing code because PyRun_String has a macro expansion to PyRun_StringFlags. ABI compatibility between major releases is not provded.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Sat Jun  8 13:49:25 2019
From: report at bugs.python.org (Emmanuel Arias)
Date: Sat, 08 Jun 2019 17:49:25 +0000
Subject: [issue36373] Deprecate explicit loop parameter in all public asyncio
 APIs
In-Reply-To: <1553025335.55.0.640410639085.issue36373@roundup.psfhosted.org>
Message-ID: <1560016165.62.0.233732314895.issue36373@roundup.psfhosted.org>


Change by Emmanuel Arias <emmanuelarias30 at gmail.com>:


----------
pull_requests: +13793
pull_request: https://github.com/python/cpython/pull/13920

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36373>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:00:30 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 08 Jun 2019 18:00:30 +0000
Subject: [issue12144] cookielib.CookieJar.make_cookies fails for cookies with
 'expires' set
In-Reply-To: <1306033124.86.0.836605602237.issue12144@psf.upfronthosting.co.za>
Message-ID: <1560016830.72.0.823741027572.issue12144@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +13794
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/13921

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12144>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:15:00 2019
From: report at bugs.python.org (Ken Healy)
Date: Sat, 08 Jun 2019 18:15:00 +0000
Subject: [issue37205] time.perf_counter() is not system-wide on Windows,
 in disagreement with documentation
Message-ID: <1560017700.11.0.127727162727.issue37205@roundup.psfhosted.org>


New submission from Ken Healy <healykb+pythonbugs at gmail.com>:

The documentation for time.perf_counter() indicates it should return a system-wide value: https://docs.python.org/3/library/time.html#time.perf_counter

This is not true on Windows, as a process-specific offset is subtracted from the underlying QueryPerformanceCounter() value. The code comments indicate this is to reduce precision loss: https://github.com/python/cpython/blob/master/Python/pytime.c#L995-L997

This is relevant in multiprocess applications, where accurate timing is required across multiple processes. Here is a simple test case:

-----------------------------------------------------------
import concurrent.futures
import time

def worker():
    return time.perf_counter()

if __name__ == '__main__':
    pool = concurrent.futures.ProcessPoolExecutor()
    futures = []
    for i in range(3):
        print('Submitting worker {:d} at time.perf_counter() == {:.3f}'.format(i, time.perf_counter()))
        futures.append(pool.submit(worker))
        time.sleep(1)

    for i, f in enumerate(futures):
        print('Worker {:d} started at time.perf_counter() == {:.3f}'.format(i, f.result()))
-----------------------------------------------------------

Output:
-----------------------------------------------------------
C:\...>Python37\python.exe -VV
Python 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05)
[MSC v.1916 64 bit (AMD64)]

C:\...>Python37\python.exe perf_counter_across_processes.py
Submitting worker 0 at time.perf_counter() == 0.376
Submitting worker 1 at time.perf_counter() == 1.527
Submitting worker 2 at time.perf_counter() == 2.529
Worker 0 started at time.perf_counter() == 0.380
Worker 1 started at time.perf_counter() == 0.956
Worker 2 started at time.perf_counter() == 1.963
-----------------------------------------------------------

See my stackoverflow question for a comparison with Linux: https://stackoverflow.com/questions/56502111/should-time-perf-counter-be-consistent-across-processes-in-python-on-windows

----------
assignee: docs at python
components: Documentation, Library (Lib), Windows
messages: 345057
nosy: docs at python, kh90909, paul.moore, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
type: behavior
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37205>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:18:49 2019
From: report at bugs.python.org (Tal Einat)
Date: Sat, 08 Jun 2019 18:18:49 +0000
Subject: [issue36003] set better defaults for TCPServer options
In-Reply-To: <1550238279.45.0.385319342978.issue36003@roundup.psfhosted.org>
Message-ID: <1560017929.47.0.491791957289.issue36003@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

I'm not sure that changing the default value for "reuse address" justifies breaking backwards compatibility like this. Admittedly, I'm not an expert on networking, so perhaps there's a good reason that I'm unaware of.

As for the queue size, passing 0 to socket.listen() does seem like a more reasonable default than the rather arbitrary value of 5. Again, it's arguable whether it's worth changing this given that it has been like this for a long time, but in this case at least the potential for harm seems negligible.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36003>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:19:39 2019
From: report at bugs.python.org (Ken Healy)
Date: Sat, 08 Jun 2019 18:19:39 +0000
Subject: [issue37205] time.perf_counter() is not system-wide on Windows,
 in disagreement with documentation
In-Reply-To: <1560017700.11.0.127727162727.issue37205@roundup.psfhosted.org>
Message-ID: <1560017979.98.0.718285594986.issue37205@roundup.psfhosted.org>


Ken Healy <healykb+pythonbugs at gmail.com> added the comment:

Note that this offset subtraction behavior appears to be inherited from time.clock(), which did not make any guarantees about returning a system-wide value: 

https://github.com/python/cpython/commit/ec89539ccccd6103665a7a5c7234cf09f27c1c72#diff-4a575e94d6ac98a0d82fd93509b6bfd3L91

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37205>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:34:20 2019
From: report at bugs.python.org (Tal Einat)
Date: Sat, 08 Jun 2019 18:34:20 +0000
Subject: [issue34235] PyArg_ParseTupleAndKeywords: support required keyword
 arguments
In-Reply-To: <1532610257.0.0.56676864532.issue34235@psf.upfronthosting.co.za>
Message-ID: <1560018860.46.0.744885958818.issue34235@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

How about allowing '|' to be used again after '$'? Keyword arguments would be optional by default, but if there is a '|' after the '$', then those before it are required.

Examples:
"O|O$O|O" -- one required keyword arg and one optional one.
"O|O$OO" -- both keyword args are optional.
"O|O$|OO" -- both keyword args are optional.
"O|O$OO|" -- both keyword args are required.

Pros:
1. Backwards-compatible with current notation.
2. No additional characters used as sigils.
3. Similar meaning as existing use of '|' to separate required and optional args.
4. Same order as for Python function.

Cons:
1. Need to scan to the end of the format string to figure out whether keyword args are optional or required.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34235>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:47:49 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sat, 08 Jun 2019 18:47:49 +0000
Subject: [issue37091] subprocess - uncaught PermissionError in send_signal can
 cause hang
In-Reply-To: <1559170322.53.0.309237543574.issue37091@roundup.psfhosted.org>
Message-ID: <1560019669.75.0.612245129359.issue37091@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

even with that initially proposed patch, the subprocess.run code is going to hang if the .kill() fails without raising an exception:

The run() TimeoutExpired path calls communicate() after the kill to consume all remaining output: 
  https://github.com/python/cpython/blob/master/Lib/subprocess.py#L478

and the __exit__ code path calls wait().

both assume that the kill() succeeded because the normal case is not someone launching a child process that they are unable to kill (as happens when sudo or similar is used).

Today's workarounds: Don't use timeout when launching a child you cannot kill.  OR  launch it via an intermediate process that you can kill (shell=True or equivalent).

To address this issue, catching a PermissionError exception around both of those kill() calls and preventing it from calling either communicate() or wait() as we cannot force the child process to exit makes sense.  With some indication that this happened left as a hint to the user on the TimeoutExpired itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37091>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:48:05 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 18:48:05 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
Message-ID: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

help(dict.pop) was correct in 3.7:

    pop(...)
        D.pop(k[,d]) -> v

and incorrect for 3.8:

     pop(self, key, default=None, /)

This happened in:
     https://github.com/python/cpython/commit/9e4f2f3a6b8ee995c365e86d976937c141d867f8
     https://github.com/python/cpython/pull/12792

We've long known that the Argument Clinic was not applicable to all functions and methods, including this one in particular.  The issue is that the one argument form does not set the default to None; rather, it triggers a KeyError when the key is missing.  In other words, there is an important and long-standing semantic difference between d.pop(k) and d.pop(k,None).

When reverting this change, please add a note about why the ArgumentClinic is not being applied to this function until its capabilities have been built-out to handle functions that have different behaviors depending on the number of arguments.

Also, we should review other recent applications of the ArgumentClinic to make sure they didn't make the same mistake.

----------
components: Argument Clinic
keywords: 3.8regression
messages: 345062
nosy: larry, rhettinger
priority: high
severity: normal
status: open
title: Incorrect application of Argument Clinic to dict.pop()
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sat Jun  8 14:50:59 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 08 Jun 2019 18:50:59 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560019859.77.0.346868004025.issue37206@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sat Jun  8 15:13:08 2019
From: report at bugs.python.org (Jakub Wilk)
Date: Sat, 08 Jun 2019 19:13:08 +0000
Subject: [issue31652] make install fails: no module _ctypes
In-Reply-To: <1506812661.87.0.213398074469.issue31652@psf.upfronthosting.co.za>
Message-ID: <1560021188.26.0.89815807144.issue31652@roundup.psfhosted.org>


Change by Jakub Wilk <jwilk at jwilk.net>:


----------
nosy: +jwilk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31652>
_______________________________________

From report at bugs.python.org  Sat Jun  8 15:32:39 2019
From: report at bugs.python.org (Roland Netzsch)
Date: Sat, 08 Jun 2019 19:32:39 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1560022359.95.0.963581864844.issue37202@roundup.psfhosted.org>


Change by Roland Netzsch <stuxcrystal at gmail.com>:


----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:05:09 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 08 Jun 2019 21:05:09 +0000
Subject: [issue11122] bdist_rpm should use rpmbuild, not rpm
In-Reply-To: <1296854362.61.0.538085175842.issue11122@psf.upfronthosting.co.za>
Message-ID: <1560027909.95.0.1277480436.issue11122@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:


New changeset 45a14942c969ed508b35abd5e116cb18f84ce5b4 by Cheryl Sabella (Marcin Niemira) in branch 'master':
bpo-11122: fix hardcoded path checking for rpmbuild in bdist_rpm.py (GH-10594)
https://github.com/python/cpython/commit/45a14942c969ed508b35abd5e116cb18f84ce5b4


----------
nosy: +cheryl.sabella

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11122>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:06:22 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Sat, 08 Jun 2019 21:06:22 +0000
Subject: [issue11122] bdist_rpm should use rpmbuild, not rpm
In-Reply-To: <1296854362.61.0.538085175842.issue11122@psf.upfronthosting.co.za>
Message-ID: <1560027982.88.0.615147986752.issue11122@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11122>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:07:15 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 21:07:15 +0000
Subject: [issue11122] bdist_rpm should use rpmbuild, not rpm
In-Reply-To: <1296854362.61.0.538085175842.issue11122@psf.upfronthosting.co.za>
Message-ID: <1560028035.24.0.478032469233.issue11122@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13795
pull_request: https://github.com/python/cpython/pull/13922

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11122>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:07:32 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 08 Jun 2019 21:07:32 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560028052.97.0.679820321603.issue37203@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Raymond Hettinger

> Though less accurate, the current version communicates better

I agree that types.MethodType is more accurate but may be less understandable. But in this case I think that the Function class for emulating instance methods should not use types.MethodType either, but a custom newfunc function as well. And **kwargs parameters should be added to both newfunc functions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:14:18 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 21:14:18 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1560028458.73.0.760090177142.issue37176@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Yes, issue 23674 seems to be at least a partial duplicate.  We should just get this fixed and close both issues.

Ideally, the text can also be made more compact.  Having eight paragraphs sends an implicit message that this is too complex to understand and that it should be avoided.

One essential goal is that we need to overcome strong preconceptions about about what super() might do versus what it actually does.  Those with experience of super() in other languages tend to presume that it would be a keyword rather than a builtin type that needs to be instantiated, that it can only work within a class, that it has lower computational overhead than it does, that it only calls parents rather than siblings, that search order is controlled by the method using super() rather than the child instance, that operators will work, or that the search order is something is something other than the C3 algorithm.

The core challenge of documenting super() is that it is so different from what a person might imagine.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:20:23 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 21:20:23 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560028823.29.0.844848428234.issue37203@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I'm going to close this because 1) I'm working on a somewhat major set of updates this guide already and 2) I think this tracker issue misses the point of what those guide is trying to do (communicating that the class is prepended to the argument stream but not trying to be a fully accurate drop in substitute).  The responsibility for describing in detail what @classmethod does belongs in libstdtypes.rst.  The goal in the descriptor how-to is to give an understanding of how descriptors work.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sat Jun  8 17:25:24 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 08 Jun 2019 21:25:24 +0000
Subject: [issue11122] bdist_rpm should use rpmbuild, not rpm
In-Reply-To: <1296854362.61.0.538085175842.issue11122@psf.upfronthosting.co.za>
Message-ID: <1560029124.65.0.0944351753071.issue11122@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3f7629d93c8cb3e0ee118c6a6463250f03d6c9f9 by Miss Islington (bot) in branch '3.8':
bpo-11122: fix hardcoded path checking for rpmbuild in bdist_rpm.py (GH-10594)
https://github.com/python/cpython/commit/3f7629d93c8cb3e0ee118c6a6463250f03d6c9f9


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11122>
_______________________________________

From report at bugs.python.org  Sat Jun  8 19:55:34 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 08 Jun 2019 23:55:34 +0000
Subject: [issue37178] One argument form of math.perm()
In-Reply-To: <1559838628.34.0.228461842236.issue37178@roundup.psfhosted.org>
Message-ID: <1560038134.9.0.472079402483.issue37178@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37178>
_______________________________________

From report at bugs.python.org  Sat Jun  8 21:06:51 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 09 Jun 2019 01:06:51 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1560028458.73.0.760090177142.issue37176@roundup.psfhosted.org>
Message-ID: <20190609010644.GP4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

On Sat, Jun 08, 2019 at 09:14:18PM +0000, Raymond Hettinger wrote:

> Ideally, the text can also be made more compact.  Having eight 
> paragraphs sends an implicit message that this is too complex to 
> understand and that it should be avoided.

But it is complex -- as you point out, there are *at least* seven 
potential misapprehensions here.

super does a lot: there are at least four ways to call it (zero-argument 
form, unbound super, class+instance and class+subclass). And as the old 
"super considered harmful" versus "super considered super" debate shows, 
there are pitfalls in multiple inheritance that people run into.

The challenge here is that for 95% of cases (plucking a number from thin 
air) using super is simple: just follow the example in the docs. But the 
remaining troublesome cases can be very troublesome, and people running 
into those cases do need to understand the gory details.

> One essential goal is that we need to overcome strong preconceptions 
> about about what super() might do versus what it actually does.
[...]

Here's two more that you missed:

- that you should call super with super(type(self), self);

- that unbound super objects dispatch to unbound methods.

At some point or another over the last decade I've misunderstood super 
to do almost all of those things. As this thread shows, I thought I had 
understood it but I still misunderstood the role of the class calling 
super.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Sun Jun  9 00:58:58 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Sun, 09 Jun 2019 04:58:58 +0000
Subject: [issue37107] ensurepip --upgrade doesn't change the version of pip
 used by venv
In-Reply-To: <1559283295.29.0.266679199585.issue37107@roundup.psfhosted.org>
Message-ID: <1560056338.74.0.274966138167.issue37107@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

(Added packaging, Linux distro, and Windows and macOS installer folks to the cc list)

Chris and I were discussing this behaviour, and it turns out even I had forgotten how we had specified this feature in PEP 453: `ensurepip --upgrade` ensures that an older pip is brought up to date with the bundled version, but it does *not* check PyPI for the latest version the way that `python3 -m pip install --upgrade pip` does.

We both expected the ensurepip option to behave the same way as the pip option, since they share a name.

If I had the time machine keys, I'd use a more verbose name for the ensurepip flag (e.g. `--upgrade-to-match-bundle`) to help make it clearer that it does something different from the corresponding pip flag.

As it is though, for Python 3.9, I think we should change the behaviour of `--upgrade` to imply `python -m pip install --upgrade pip`, and then add a separate `--network-upgrade`/`--no-network-upgrade` option that allows folks to opt out of the PyPI part of the version check.

The make file would presumably be updated to pass the `--no-network-upgrade` flag, and I guess the macOS and Windows installers would as well (I'm not sure what the platform policies are around installers making random additional requests to external network services)

----------
nosy: +barry, doko, dstufft, ncoghlan, ned.deily, paul.moore, petr.viktorin, steve.dower
stage:  -> needs patch
type:  -> enhancement
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37107>
_______________________________________

From report at bugs.python.org  Sun Jun  9 01:10:16 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Sun, 09 Jun 2019 05:10:16 +0000
Subject: [issue37107] ensurepip --upgrade doesn't change the version of pip
 used by venv
In-Reply-To: <1559283295.29.0.266679199585.issue37107@roundup.psfhosted.org>
Message-ID: <1560057016.73.0.391539810796.issue37107@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

Addressing the other part of Chris's initial post: there's also no `--upgrade-pip` option on `venv` itself.

Instead, there's only an `--upgrade` option that is intended for *Python* version upgrades, and restructures the internal layout of the venv to switch the Python major version number.

Unless you're using a Linux distro Python that has been patched to inject the external pip installation with rewheel or dirtbike, getting a venv that uses the externally updated version of pip requires running `python3 - m venv --system-site-packages --without-pip ...`.

So my suggestion there would be to:

- rename "venv --upgrade" to "venv --set-interpreter" (keeping `--upgrade` as a legacy alias)
- default to running `ensurepip --upgrade` with its new behaviour
- add `--network-upgrade/--no-network-upgrade` options which get passed straight through to the updated ensurepip

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37107>
_______________________________________

From report at bugs.python.org  Sun Jun  9 01:45:09 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Sun, 09 Jun 2019 05:45:09 +0000
Subject: [issue34836] test_ssl.test_default_ecdh_curve needs no tls1.3 flag in
 2.7, for now
In-Reply-To: <1538152364.12.0.545547206417.issue34836@psf.upfronthosting.co.za>
Message-ID: <1560059109.91.0.14393159366.issue34836@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:


New changeset 99b5c940d3471e0ed6579771d94e7342d7c733e0 by Nick Coghlan (Dimitri John Ledkov) in branch '2.7':
[2.7] bpo-34836: fix test_default_ecdh_curve, needs no tlsv1.3. (GH-9626)
https://github.com/python/cpython/commit/99b5c940d3471e0ed6579771d94e7342d7c733e0


----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34836>
_______________________________________

From report at bugs.python.org  Sun Jun  9 01:49:36 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 09 Jun 2019 05:49:36 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560059376.37.0.923426811984.issue37206@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The code generated by Argument Clinic is correct.

>>> {}.pop(1)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
KeyError: 1
>>> {}.pop(1, None)

It is just a signature wrong. Some earlier versions of Argument Clinic allowed you to write "default=undefined" to specify an optional argument without default value, but this feature was lost a long time ago. So now signatures of some functions with optional arguments are false.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sun Jun  9 02:03:13 2019
From: report at bugs.python.org (Alejandro Gonzalez)
Date: Sun, 09 Jun 2019 06:03:13 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560060192.99.0.728589451468.issue28869@roundup.psfhosted.org>


Alejandro Gonzalez <alejandrojgt at gmail.com> added the comment:

Hello, I would like to add further on this issue.

(I'm new to bpo. Please advise if this report could be better)

Issue
-----

Pickling breaks when attempting to dump an instance of a class that was defined by calling ABCMeta directly, because it attempts to look for the class in `abc` rather than the module the class was defined in.

Below is a short snippet to reproduce the issue (my environment is Python 3.7.3 on Ubuntu 16.04)

>>> import pickle
>>> from abc import ABCMeta

>>> class Foo(metaclass=ABCMeta):
>>>     pass

>>> Bar = ABCMeta('Bar', (), {})

>>> foo = Foo()
>>> bar = Bar()

>>> foo_p = pickle.dumps(foo)  # OK
>>> bar_p = pickle.dumps(bar)  # PicklingError: Can't pickle <class 'abc.Bar'>: attribute lookup Bar on abc failed

I encountered this issue when working on a class factory to define classes dynamically. You can work around it if you smuggle `{'__module__': __name__}` when calling the metaclass, e.g.:

>>> Qux = ABCMeta('Qux', (), {'__module__': __name__})
>>> qux = Qux()
>>> qux_p = pickle.dumps(qux)  # OK

Apparently others have also stumbled upon this ABCMeta behavior before: https://stackoverflow.com/q/49457441

Some ideas to solve this
------------------------

A. Steven's proposal seems that could work (I haven't tested it myself yet though).
    - This, however, would be limited to ABCMeta. Any other metaclass subclassed from type would have to include that workaround too for it to play well with pickle, which leads to,

B. Do A. and include in the documentation some recipe that shows this workaround when subclassing from type.

C. Implement A. in type itself. (Maybe around here? https://github.com/python/cpython/blob/master/Objects/typeobject.c#L2603)
    - I'm not familiar with the internals of CPython, but I guess this would be the nuclear option.

If any of above ideas (or some other idea that could come up upon discussion) seems sensible, please allow me to work on it. I'd be happy to contribute :)

----------
nosy: +alegonz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Sun Jun  9 03:09:31 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 09 Jun 2019 07:09:31 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560064171.96.0.794533988618.issue37203@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Raymond Hettinger

> The goal in the descriptor how-to is to give an understanding of how descriptors work.

Okay. So I don't know if that was clear in my last message but that also means replacing the current "Function" implementation:

class Function(object):
    . . .
    def __get__(self, obj, objtype=None):
        "Simulate func_descr_get() in Objects/funcobject.c"
        if obj is None:
            return self
        return types.MethodType(self, obj)

with something like this:

class Function(object):
    . . .
    def __get__(self, obj, objtype=None):
        "Simulate func_descr_get() in Objects/funcobject.c"
        if obj is None:
            return self
        def newfunc(*args, **kwargs):
            return self(obj, *args, **kwargs)
        return newfunc
        # "newfunc" emulates "types.MethodType(self, obj)"

And as you said, adding a similar comment to the "ClassMethod" implementation (and **kwargs):

class ClassMethod(object):
    "Emulate PyClassMethod_Type() in Objects/funcobject.c"

    def __init__(self, f):
        self.f = f

    def __get__(self, obj, klass=None):
        if klass is None:
            klass = type(obj)
        def newfunc(*args, **kwargs):
            return self.f(klass, *args, **kwargs)
        return newfunc
        # "newfunc" emulates "types.MethodType(self.f, klass)"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sun Jun  9 04:21:47 2019
From: report at bugs.python.org (hodai goldman)
Date: Sun, 09 Jun 2019 08:21:47 +0000
Subject: [issue37198] _parse_localename fail to parse 'en_IL'
In-Reply-To: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>
Message-ID: <1560068507.77.0.473139904899.issue37198@roundup.psfhosted.org>


hodai goldman <hodaig at gmail.com> added the comment:

hi Michele,
Yes i wold propose a Pull Request.
SilentGhost: I don't know.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Sun Jun  9 05:02:57 2019
From: report at bugs.python.org (Lorenz Mende)
Date: Sun, 09 Jun 2019 09:02:57 +0000
Subject: [issue36670] test suite broken due to cpu usage feature on win 10/
 german
In-Reply-To: <1555689157.38.0.435665423105.issue36670@roundup.psfhosted.org>
Message-ID: <1560070977.25.0.134418861891.issue36670@roundup.psfhosted.org>


Lorenz Mende <lorenz.mende at gmail.com> added the comment:

Did some minor changes with win_utils.
Encoding changed to 'oem'.
@heckad: does this bugfix work for u?

@all: please verify working of the changes with different localizations.
thx

----------
Added file: https://bugs.python.org/file48406/win_utils.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36670>
_______________________________________

From report at bugs.python.org  Sun Jun  9 05:03:08 2019
From: report at bugs.python.org (Lorenz Mende)
Date: Sun, 09 Jun 2019 09:03:08 +0000
Subject: [issue36670] test suite broken due to cpu usage feature on win 10/
 german
In-Reply-To: <1555689157.38.0.435665423105.issue36670@roundup.psfhosted.org>
Message-ID: <1560070988.63.0.86749478462.issue36670@roundup.psfhosted.org>


Change by Lorenz Mende <lorenz.mende at gmail.com>:


Removed file: https://bugs.python.org/file48285/win_utils.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36670>
_______________________________________

From report at bugs.python.org  Sun Jun  9 05:23:47 2019
From: report at bugs.python.org (Mark Shannon)
Date: Sun, 09 Jun 2019 09:23:47 +0000
Subject: [issue37207] Use PEP 590 vectorcall to speed up calls to range(),
 list() and dict()
Message-ID: <1560072227.25.0.180298594259.issue37207@roundup.psfhosted.org>


New submission from Mark Shannon <mark at hotpy.org>:

PEP 590 allows us the short circuit the __new__, __init__ slow path for commonly created builtin types.
As an initial step, we can speed up calls to range, list and dict by about 30%.
See https://gist.github.com/markshannon/5cef3a74369391f6ef937d52cca9bfc8

----------
components: Interpreter Core
messages: 345077
nosy: Mark.Shannon
priority: normal
severity: normal
status: open
title: Use PEP 590 vectorcall to speed up calls to range(), list() and dict()
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37207>
_______________________________________

From report at bugs.python.org  Sun Jun  9 05:38:40 2019
From: report at bugs.python.org (Batuhan)
Date: Sun, 09 Jun 2019 09:38:40 +0000
Subject: [issue19666] Format string for ASCII unicode or bytes-like object as
 readonly buffer
In-Reply-To: <1384971256.72.0.0181602551145.issue19666@psf.upfronthosting.co.za>
Message-ID: <1560073120.32.0.873058141057.issue19666@roundup.psfhosted.org>


Batuhan <batuhanosmantaskaya at gmail.com> added the comment:

Don't we need to discuss it more before triage it as "patch required"?

----------
nosy: +BTaskaya

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19666>
_______________________________________

From report at bugs.python.org  Sun Jun  9 05:40:27 2019
From: report at bugs.python.org (Mark Shannon)
Date: Sun, 09 Jun 2019 09:40:27 +0000
Subject: [issue37207] Use PEP 590 vectorcall to speed up calls to range(),
 list() and dict()
In-Reply-To: <1560072227.25.0.180298594259.issue37207@roundup.psfhosted.org>
Message-ID: <1560073227.08.0.692054658573.issue37207@roundup.psfhosted.org>


Change by Mark Shannon <mark at hotpy.org>:


----------
keywords: +patch
pull_requests: +13796
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13930

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37207>
_______________________________________

From report at bugs.python.org  Sun Jun  9 07:04:00 2019
From: report at bugs.python.org (Iceflower)
Date: Sun, 09 Jun 2019 11:04:00 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
Message-ID: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>


New submission from Iceflower <iceflower at gmx.de>:

I don't really know where this belongs, but it is at least for me not an expected behaviour. It is weird for me at all. Please take a look if this is an intended behaviour and why it is like that.

Tested with py3.7.3, py3.8.0b1
```
A process in the process pool was terminated abruptly while the future was running or pending.
```

Tested with py 3.6.8:
```
Exception in thread Thread-1:
Traceback (most recent call last):
  File "C:\Python36\lib\threading.py", line 916, in _bootstrap_inner
    self.run()
  File "C:\Python36\lib\threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "C:\Python36\lib\concurrent\futures\process.py", line 272, in _queue_management_worker
    result_item = reader.recv()
  File "C:\Python36\lib\multiprocessing\connection.py", line 251, in recv
    return _ForkingPickler.loads(buf.getbuffer())
TypeError: __init__() missing 1 required positional argument: 'num'
```

I expect that the PoolBreaker exception would work too.

Code to test:
As attachment.

----------
components: Interpreter Core
files: ProcPoolEx-exception.py
messages: 345079
nosy: Iceflower
priority: normal
severity: normal
status: open
title: Weird exception behaviour in ProcessPoolExecutor
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file48407/ProcPoolEx-exception.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Sun Jun  9 08:37:19 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Sun, 09 Jun 2019 12:37:19 +0000
Subject: [issue36785] Implement PEP 574
In-Reply-To: <1556908101.83.0.107763193732.issue36785@roundup.psfhosted.org>
Message-ID: <1560083839.74.0.419925595238.issue36785@roundup.psfhosted.org>


Change by Antoine Pitrou <pitrou at free.fr>:


----------
pull_requests: +13797
pull_request: https://github.com/python/cpython/pull/13931

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36785>
_______________________________________

From report at bugs.python.org  Sun Jun  9 08:38:47 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Sun, 09 Jun 2019 12:38:47 +0000
Subject: [issue37209] Add what's new entries for pickle enhancements
Message-ID: <1560083927.43.0.0939739725641.issue37209@roundup.psfhosted.org>


New submission from Antoine Pitrou <pitrou at free.fr>:

The various pickle enhancements in 3.8 (apart from PEP 574) need to be mentioned in the What's New document (`Doc/whatsnew/3.8.rst`).

----------
assignee: docs at python
components: Documentation, Library (Lib)
messages: 345080
nosy: docs at python, ogrisel, pierreglaser, pitrou
priority: normal
severity: normal
stage: needs patch
status: open
title: Add what's new entries for pickle enhancements
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37209>
_______________________________________

From report at bugs.python.org  Sun Jun  9 08:47:20 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Sun, 09 Jun 2019 12:47:20 +0000
Subject: [issue36785] Implement PEP 574
In-Reply-To: <1556908101.83.0.107763193732.issue36785@roundup.psfhosted.org>
Message-ID: <1560084440.8.0.920252347902.issue36785@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset c879ff247ae1b67a790ff98d2d59145302cd4e4e by ?ukasz Langa (Antoine Pitrou) in branch 'master':
bpo-36785: PEP 574 What's New entry (#13931)
https://github.com/python/cpython/commit/c879ff247ae1b67a790ff98d2d59145302cd4e4e


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36785>
_______________________________________

From report at bugs.python.org  Sun Jun  9 09:32:30 2019
From: report at bugs.python.org (Chris Withers)
Date: Sun, 09 Jun 2019 13:32:30 +0000
Subject: [issue37107] ensurepip --upgrade doesn't change the version of pip
 used by venv
In-Reply-To: <1559283295.29.0.266679199585.issue37107@roundup.psfhosted.org>
Message-ID: <1560087150.44.0.771860305996.issue37107@roundup.psfhosted.org>


Chris Withers <chris at withers.org> added the comment:

I don't suppose there's any chance we can treat the misnaming of these options as the bugs they feel like, so so fix them for 3.7+, rather than having people battle on with the confusion for another 3+ years until 3.9 is mainstream?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37107>
_______________________________________

From report at bugs.python.org  Sun Jun  9 09:36:12 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 09 Jun 2019 13:36:12 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560087372.68.0.634038124122.issue37206@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> It is just a signature wrong.

Yes, that is the part that needs to be fixed.  The information it provides is incorrect.  That is why this function wasn't converted long ago.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sun Jun  9 11:40:19 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 09 Jun 2019 15:40:19 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560094819.47.0.582952370061.issue37206@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I am working on this issue and almost done.

The questions is what inspect.Signature() and inspect.getfullargspec() should do with such functions.

1. Raise an exception as they did in old Python versions and as they do with builtin functions not converted to Argument Clinic.

2. Return a value where a special placeholder is used as a default value for optional parameters which cannot have a default value. In this case there are other questions: what is better name for it (I considered "unspecified" and "unrepresentable") and should it be a single object used for all parameters or a separate object created for every parameter?

----------
nosy: +yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sun Jun  9 11:54:17 2019
From: report at bugs.python.org (=?utf-8?q?R=C3=A9mi_Lapeyre?=)
Date: Sun, 09 Jun 2019 15:54:17 +0000
Subject: [issue35954] Incoherent type conversion in configparser
In-Reply-To: <1549801714.53.0.77041525212.issue35954@roundup.psfhosted.org>
Message-ID: <1560095657.0.0.763039076319.issue35954@roundup.psfhosted.org>


R?mi Lapeyre <remi.lapeyre at henki.fr> added the comment:

> IMO we should at most clarify in the docs.

This makes sense, I will update my PR tomorrow.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35954>
_______________________________________

From report at bugs.python.org  Sun Jun  9 12:00:38 2019
From: report at bugs.python.org (=?utf-8?q?R=C3=A9mi_Lapeyre?=)
Date: Sun, 09 Jun 2019 16:00:38 +0000
Subject: [issue32884] Adding the ability for getpass to print asterisks when
 passowrd is typed
In-Reply-To: <1519122533.37.0.467229070634.issue32884@psf.upfronthosting.co.za>
Message-ID: <1560096038.29.0.686433983214.issue32884@roundup.psfhosted.org>


Change by R?mi Lapeyre <remi.lapeyre at henki.fr>:


----------
nosy: +remi.lapeyre

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32884>
_______________________________________

From report at bugs.python.org  Sun Jun  9 12:24:48 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sun, 09 Jun 2019 16:24:48 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560097488.21.0.718986402955.issue37111@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
keywords: +patch
pull_requests: +13798
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/13932

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Sun Jun  9 14:31:23 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 09 Jun 2019 18:31:23 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
In-Reply-To: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>
Message-ID: <1560105083.49.0.256677463655.issue37208@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +bquinlan, pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:09:10 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 09 Jun 2019 19:09:10 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560107350.76.0.162726188063.issue35922@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:14:00 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 09 Jun 2019 19:14:00 +0000
Subject: [issue36853] inconsistencies in docs builds (Sphinx 2)
In-Reply-To: <1557331408.26.0.606381835406.issue36853@roundup.psfhosted.org>
Message-ID: <1560107640.25.0.35704531343.issue36853@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
keywords: +patch
pull_requests: +13799
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13579

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36853>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:20:49 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Sun, 09 Jun 2019 19:20:49 +0000
Subject: [issue36853] inconsistencies in docs builds (Sphinx 2)
In-Reply-To: <1557331408.26.0.606381835406.issue36853@roundup.psfhosted.org>
Message-ID: <1560108049.61.0.297378185431.issue36853@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36853>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:26:39 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 09 Jun 2019 19:26:39 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560108399.66.0.601705657938.issue37206@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +13800
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13933

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:34:32 2019
From: report at bugs.python.org (Bachsau)
Date: Sun, 09 Jun 2019 19:34:32 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560108872.92.0.852575285165.issue34850@roundup.psfhosted.org>


Bachsau <web at bachsau.name> added the comment:

This is bullshit. SyntaxWarnings should be raised on problems with the *syntax* not for ProgrammerMightBeDumb errors. There are a whole lot of things a programmer not knowing the language could do wrong. But these are syntactically valid expressions and it is not the purpose of a compiler to teach.

----------
nosy: +Bachsau

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:49:26 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 09 Jun 2019 19:49:26 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560109766.15.0.933430978438.issue26806@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
components:  -Documentation
versions: +Python 3.8, Python 3.9 -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Sun Jun  9 15:56:45 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 09 Jun 2019 19:56:45 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560110205.96.0.589345569664.issue26806@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

IMO just updating the documentation would not be enough.

I suggest wrapping sys.setrecursionlimit() and *adding* 30 to the given limit, to offset the call stack depth added by IDLE. This makes more sense to me than max(n, 50), which I imagine would cause a lot of confusion in cases where it comes into effect.

If that's not acceptable, then I suggest wrapping it to raise an informative exception if the given limit is too low.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:23:32 2019
From: report at bugs.python.org (Christian Heimes)
Date: Sun, 09 Jun 2019 20:23:32 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
Message-ID: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>


New submission from Christian Heimes <lists at cheimes.de>:

In https://twitter.com/moreati/status/1137815804530049028 Alex Willmer wrote:

> In CPython 3.8dev the pure http://pickle.py  module now depends on the C _pickle module, but only for one class https://github.com/python/cpython/blob/c879ff247ae1b67a790ff98d2d59145302cd4e4e/Lib/pickle.py#L39

Antoine, would it make sense turn _pickle.PickleBuffer into an optional dependency? The class is only used for pickle 5 as described in PEP 574, https://www.python.org/dev/peps/pep-0574/

----------
components: Library (Lib)
keywords: 3.8regression
messages: 345088
nosy: christian.heimes, pitrou
priority: normal
severity: normal
status: open
title: Pure Python pickle module should not depend on _pickle.PickleBuffer
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:40:44 2019
From: report at bugs.python.org (Alex Willmer)
Date: Sun, 09 Jun 2019 20:40:44 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560112844.81.0.072747220217.issue37210@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

I noticed this because I was experimenting with pickle.py from the 3.8 branch to support protocol 5 in https://github.com/moreati/pikl (and later to https://pypi.org/project/zodbpickle/).

However I want to make it clear, if CPython maintainers wish to keep the code as it is I will deal with it. Maximizing our convenience, and minimizing your maintenance workload is paramount.

----------
nosy: +Alex.Willmer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:43:47 2019
From: report at bugs.python.org (Alex Willmer)
Date: Sun, 09 Jun 2019 20:43:47 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560113027.06.0.312136060186.issue37210@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

Arggh, typo. I mean maximizing *your* convenience is paramount.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:44:32 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 09 Jun 2019 20:44:32 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560113072.77.0.00730030679386.issue37206@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I would think that the best course of action is to revert the dict.pop() check-in for Python3.8, then reapply in 3.9 once a plan is worked out to expand the capabilities of the argument clinic and the expressiveness of signatures.  The latter seem more like enhancements that need time to mature rather than putting them in to 3.8b2.

There's no real downside to reverting the dict.pop() checkin.  It's only effects were to generate an incorrect signature and to make help() misleading.

The patch is too extensive for backporting to 3.8 and 3.7.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:52:21 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 09 Jun 2019 20:52:21 +0000
Subject: [issue37203] Correct classmethod emulation in Descriptor HowTo Guide
In-Reply-To: <1559994687.73.0.550711459072.issue37203@roundup.psfhosted.org>
Message-ID: <1560113541.73.0.408733630897.issue37203@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

How about taking another look at this after I've finished my more extensive rewrite based on my course materials.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37203>
_______________________________________

From report at bugs.python.org  Sun Jun  9 16:58:53 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Sun, 09 Jun 2019 20:58:53 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560113933.6.0.568808991342.issue37210@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Note that PickleBuffer is really a built-in type (it's defined in Objects/picklebufobject.c). However it's exposed from _pickle.c because it doesn't make sense to expose it in the `builtins` module.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 17:01:07 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Sun, 09 Jun 2019 21:01:07 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560114067.72.0.2072738214.issue37210@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

In short I'm not against making PickleBuffer optional but I'm not sure it makes a lot of sense.  Would you make memoryview optional because it's written in C?  Is anyone annoyed by the fact that something comes from _pickle.c.

(note that the pure Python Pickler class *does* work with PickleBuffer; so you don't lose any extensability or customizability by using PickleBuffer)

In any case, I won't do the work myself, so feel free to draft a PR so that we see the magnitude of the changes required.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 17:27:25 2019
From: report at bugs.python.org (Alex Willmer)
Date: Sun, 09 Jun 2019 21:27:25 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560115645.97.0.266262514071.issue37210@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

Attempting a PR

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Sun Jun  9 17:43:56 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 09 Jun 2019 21:43:56 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560116636.01.0.314844019436.issue34850@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
Removed message: https://bugs.python.org/msg345086

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 17:44:18 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 09 Jun 2019 21:44:18 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560116658.79.0.0248456046604.issue34850@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

(message from a code of conduct violating troll deleted)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 18:36:40 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 09 Jun 2019 22:36:40 +0000
Subject: [issue23649] tarfile not re-entrant for multi-threading
In-Reply-To: <1426178401.83.0.913984210908.issue23649@psf.upfronthosting.co.za>
Message-ID: <1560119800.42.0.540859250723.issue23649@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23649>
_______________________________________

From report at bugs.python.org  Sun Jun  9 20:36:19 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 10 Jun 2019 00:36:19 +0000
Subject: [issue37211] obmalloc:  eliminate limit on pool size
Message-ID: <1560126979.94.0.247484308186.issue37211@roundup.psfhosted.org>


New submission from Tim Peters <tim at python.org>:

On 64-bit Python, many object sizes essentially doubled over 32-bit Python, because Python objects are so heavy with pointers.  More recently, forcing alignment to 16 bytes on 64-bit boxes boosted the memory requirements more modestly.

But obmalloc's 256 KiB arenas and 4 KiB pools haven't changed since obmalloc was first written, and its `address_in_range()` machinery cannot deal with pools bigger than that (they're segfault factories, because the machinery relies on that a pool is no larger than a system page).

obmalloc's fastest paths are those that stay within a pool.  Whenever a pool boundary is hit, it necessarily gets slower, then slower still if an arena boundary is hit.

So I propose to:

- Remove the 4 KiB pool limit, by making `address_in_range()` page-based rather than pool-based.  Pools should be able to span any power-of-2 number of pages.  Then a pool for a given size class will be able to hold that many more times as many objects too, and so stay in the fastest paths more often.

- On 64-bit boxes, increase both POOL_SIZE and ARENA_SIZE.

----------
components: Interpreter Core
messages: 345097
nosy: tim.peters
priority: normal
severity: normal
status: open
title: obmalloc:  eliminate limit on pool size
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37211>
_______________________________________

From report at bugs.python.org  Sun Jun  9 20:43:42 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 10 Jun 2019 00:43:42 +0000
Subject: [issue37211] obmalloc:  eliminate limit on pool size
In-Reply-To: <1560126979.94.0.247484308186.issue37211@roundup.psfhosted.org>
Message-ID: <1560127422.76.0.392186342776.issue37211@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
keywords: +patch
pull_requests: +13801
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13934

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37211>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:25:46 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 01:25:46 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560129946.45.0.261840023122.issue26806@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

'max(n, 50)' should have been 'min(n, 50)'  Tal, does you comment avove about the former apply when corrected to the latter?

Both get... and setrecursionlimit should be wrapped in a function, such as 'wrap_recursionlimits', called from run.main, each decorated with functools.wraps.  Both docstrings should be augmented with ... .__doc__ += "\n\nWhen running under IDLE, ..."  This is all that is needed for getrecursionlimit.  The question is to do with setrecursionlimit.

Whatever is chosen should be added to the IDLE doc section mentioned above.

Currently, at least on CPython, n must be >= 1 or ValueError is raised.  I don't like changing that.  I don't have a strong feeling about threshholding versus incrementing, but see my question above.

----------
versions:  -Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:32:11 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 10 Jun 2019 01:32:11 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1560116658.79.0.0248456046604.issue34850@roundup.psfhosted.org>
Message-ID: <20190610013201.GR4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

> (message from a code of conduct violating troll deleted)

How did Bachsau violate the code of conduct, and what evidence do you 
have that they were anything but 100% sincere in their comments?

>From where I am sitting, the only person violating the CoC is you 
(Gregory) with your hair-trigger accusation of trolling and zero- 
tolerance removal of a critical message. Your behaviour fails the CoC on 
all three points: it is not open, considerate or respectful.

It is not open to criticism: in #msg333923 Gregory wrote "let's see if 
anyone complains during the betas" but the first complaint gets censored 
without one word acknowledging the substance of the complaint.

Think about the message that sends about our openess to criticism.

Its not considerate: Bachsau took the time to comment about something 
they clearly feel very strongly about, even if only 30 seconds, and your 
response was to delete their comments with only a vague hand-wavy claim 
of a CoC violation. You didn't bother to explain what the claimed 
violation was. Even if the violation was clear in your head, it is not 
considerate of others who may not have that clarity of thought you do. 
How is Bachsau supposed to learn what to avoid doing in the future?

Backsau attacked the feature. Instead of assuming good faith until 
proven otherwise, you (Gregory) assumed bad faith from the first post, 
and attacked the *person*, labelling them a troll on zero evidence.

Being called a troll is not a small thing: it is an accusation that the 
poster is an insincere, dishonest, lying troublemaker. That's not 
respectful.

Accusations of trolling should only be made on the basis of a pattern of 
behaviour, not because you don't like the poster's comment or disapprove 
of how they say it. Tone policing ("its not what you said, its how you 
said it") is an act of oppression and a derailing tactic. The stakes 
here may not be high (it's just a syntax warning!) but being passionate 
about Python is a good thing.

Vigourous and passionate disagreement with a feature is not trolling. It 
is not a violate the CoC to use strong language or to disagree with a 
feature. I don't believe anything in Bachsau's post violated the CoC. 
But I am sure that your heavy-handed act did.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:48:56 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Mon, 10 Jun 2019 01:48:56 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560131336.2.0.0164219241116.issue37172@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Hi Terry,

Yes, I have a specific suggestion:

The error `RuntimeError: await wasn't used with future` is misleading.
I'm not sure if changing error text is enough.
I think that Future.__await__ should be fixed; I think that `await f` should be idempotent, that the same exception should be raised in single and double await examples.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:50:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 01:50:38 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560131438.04.0.204124413371.issue34850@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

"This is bullshit." struck me as jarring and rude.  I will stop there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:51:01 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 01:51:01 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560131461.14.0.489284207292.issue34850@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy:  -terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:54:44 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 01:54:44 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560131684.38.0.943009507994.issue37172@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

OK.  I am quitting here because asyncio and futures are outside my expertise.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Sun Jun  9 21:54:54 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 01:54:54 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560131694.57.0.323362479135.issue37172@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
nosy:  -terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Sun Jun  9 22:02:15 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Mon, 10 Jun 2019 02:02:15 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1560108872.92.0.852575285165.issue34850@roundup.psfhosted.org>
Message-ID: <20190610020209.GS4221@ando.pearwood.info>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Bachsau,

to respond to the substance of your comments: it is not the *primary* 
purpose of a compiler to teach, but compiler warnings on potentially 
wrong behaviour is a long-standing tradition in many languages, 
including Python.

This is not the first such warning in Python: it has warned on incorrect 
assertions for a few releases now:

py> assert (flag, "error")
<stdin>:1: SyntaxWarning: assertion is always true, perhaps remove parentheses?

Ideally a language should have no warts, gotchas or features which are 
easy to misuse, but in practice that's not the case. Identity testing in 
Python is, unfortunately, one of those features which are easy to 
misuse, and it has real consequences.

If you go back to the very first post in the discussion which launched 
this feature, Gregory points out that PyPy had to change their behaviour 
to work around so many bugs in Python code from people wrongly using 
identity tests over equality.

https://discuss.python.org/t/demoting-the-is-operator-to-avoid-an-identity-crisis/86

As the Zen says, "practicality beats purity" and this is a low-impact 
change with no runtime cost that we expect will nevertheless help catch 
many logical errors.

Apart from your aesthetic sense that the compiler shouldn't try to 
educate users into using correct code rather than wrong code that works 
by accident, do you have any objections to this feature?

Evidence of code that breaks because of this change is especially 
valuable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Sun Jun  9 22:07:14 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 10 Jun 2019 02:07:14 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560132434.92.0.469768314108.issue37206@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +13803
pull_request: https://github.com/python/cpython/pull/13935

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Mon Jun 10 00:15:11 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 04:15:11 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560140111.08.0.651305069798.issue37206@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 13933 implements the first option. It fixes similar issues with other functions so it should be backported to 3.7.

The second option is considered as a new feature and can go only in 3.9.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Mon Jun 10 00:18:00 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 04:18:00 +0000
Subject: [issue32884] Adding the ability for getpass to print asterisks when
 password is typed
In-Reply-To: <1519122533.37.0.467229070634.issue32884@psf.upfronthosting.co.za>
Message-ID: <1560140280.32.0.0510305959993.issue32884@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
title: Adding the ability for getpass to print asterisks when passowrd is typed -> Adding the ability for getpass to print asterisks when password is typed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32884>
_______________________________________

From report at bugs.python.org  Mon Jun 10 00:25:22 2019
From: report at bugs.python.org (Tim Peters)
Date: Mon, 10 Jun 2019 04:25:22 +0000
Subject: [issue37211] obmalloc:  eliminate limit on pool size
In-Reply-To: <1560126979.94.0.247484308186.issue37211@roundup.psfhosted.org>
Message-ID: <1560140722.83.0.369941151555.issue37211@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
assignee:  -> tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37211>
_______________________________________

From report at bugs.python.org  Mon Jun 10 00:28:14 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 04:28:14 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560140894.86.0.711037309299.issue34850@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Should this also produce warnings for `list` / `dict` / `set` literals?

No, because these cases are useless expressions, but they are not hidden bugs. The result is always False and does not rely on the implementation.

> SyntaxWarnings should be raised on problems with the *syntax* not for ProgrammerMightBeDumb errors. There are a whole lot of things a programmer not knowing the language could do wrong. But these are syntactically valid expressions and it is not the purpose of a compiler to teach.

SyntaxErrors should be raised on problems with the syntax. SyntaxWarnings *can* be raised for the syntax which is valid but is definitely a bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Mon Jun 10 01:32:24 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 10 Jun 2019 05:32:24 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560144744.05.0.33550093864.issue34850@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
nosy:  -gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Mon Jun 10 03:53:37 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 10 Jun 2019 07:53:37 +0000
Subject: [issue37212] ordered keyword arguments in unittest.mock.call repr and
 error messages
Message-ID: <1560153217.35.0.990763770677.issue37212@roundup.psfhosted.org>


New submission from Karthikeyan Singaravelan <tir.karthi at gmail.com>:

With PEP 468 implemented in Python 3.6 the order of keyword arguments are preserved. In mock.call the arguments are sorted [0]. This makes the output different from the expectation that order should be same as the one passed. This was implemented in issue21256 where ordered kwargs was suggested but I guess it was not implemented and hence sort was used for deterministic output. The PEP also links to the discussion where ordered kwargs was discussed [1] in 2009 before ordered dict implementation.

Given that keyword argument dictionary is now deterministic is it okay to drop sorting in 3.9? This is backwards incompatible with 3.8 where code might have depended upon the sorted output so if this requires a python-dev discussion I would be happy to start one.


# (b=1, a=2) is the actual call but "actual" in error message is noted as (a=2, b=1)

>>> from unittest.mock import call, Mock
>>> call(b=1, a=2)
call(a=2, b=1)
>>> m = Mock()
>>> m(b=1, a=2)
<Mock name='mock()' id='4477750800'>
>>> m.assert_called_with(c=3)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 870, in assert_called_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected call not found.
Expected: mock(c=3)
Actual: mock(a=2, b=1)

# With proposed change removing sorting

>>> from unittest.mock import call, Mock
>>> call(b=1, a=2)
call(b=1, a=2)
>>> m = Mock()
>>> m(b=1, a=2)
<Mock name='mock()' id='4419010880'>
>>> m.assert_called_with(c=3)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 870, in assert_called_with
    raise AssertionError(_error_message()) from cause
AssertionError: expected call not found.
Expected: mock(c=3)
Actual: mock(b=1, a=2)

[0] https://github.com/python/cpython/blob/c879ff247ae1b67a790ff98d2d59145302cd4e4e/Lib/unittest/mock.py#L2284
[1] https://mail.python.org/pipermail/python-ideas/2009-April/004163.html

----------
components: Library (Lib)
messages: 345106
nosy: cjw296, mariocj89, michael.foord, xtreak
priority: normal
severity: normal
status: open
title: ordered keyword arguments in unittest.mock.call repr and error messages
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37212>
_______________________________________

From report at bugs.python.org  Mon Jun 10 04:01:11 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 08:01:11 +0000
Subject: [issue37074] os.stat() does not work for NUL and CON
In-Reply-To: <1559029061.14.0.328684807212.issue37074@roundup.psfhosted.org>
Message-ID: <1560153671.1.0.586072282285.issue37074@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Do you mind to create a PR Eryk?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37074>
_______________________________________

From report at bugs.python.org  Mon Jun 10 04:02:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 08:02:04 +0000
Subject: [issue36548] Make the repr of re flags more readable
In-Reply-To: <1554632881.49.0.427945168441.issue36548@roundup.psfhosted.org>
Message-ID: <1560153724.01.0.993619868344.issue36548@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36548>
_______________________________________

From report at bugs.python.org  Mon Jun 10 04:24:23 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 08:24:23 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
Message-ID: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

The optimization is skipped if lnotab contains 255. It was very uncommon in older versions (only when the function contains very large expressions, larger than hundreds of lines or bytecode instructions), but in 3.8 this situation is common.

For example:

[x
 for x in a if x]

  1           0 BUILD_LIST               0
              2 LOAD_FAST                0 (.0)
        >>    4 FOR_ITER                12 (to 18)

  2           6 STORE_FAST               1 (x)
              8 LOAD_FAST                1 (x)
             10 POP_JUMP_IF_FALSE       16

  1          12 LOAD_FAST                1 (x)
             14 LIST_APPEND              2
        >>   16 JUMP_ABSOLUTE            4
        >>   18 RETURN_VALUE

if x:
    if (y and
        z):
        foo()
else:
    bar()

  1           0 LOAD_NAME                0 (x)
              2 POP_JUMP_IF_FALSE       20

  2           4 LOAD_NAME                1 (y)
              6 POP_JUMP_IF_FALSE       18

  3           8 LOAD_NAME                2 (z)

  2          10 POP_JUMP_IF_FALSE       18

  4          12 LOAD_NAME                3 (foo)
             14 CALL_FUNCTION            0
             16 POP_TOP
        >>   18 JUMP_FORWARD             6 (to 26)

  6     >>   20 LOAD_NAME                4 (bar)
             22 CALL_FUNCTION            0
             24 POP_TOP
        >>   26 LOAD_CONST               0 (None)
             28 RETURN_VALUE

You can see non-optimized jumps to jumps (from 10 to 16 and from 6 and 10 to 16 correspondingly).

This is a consequence of two features: ability to encode negative line differences in lnotab and setting lines for both outer and inner expressions.

Two ways to solve this issue:

1. Move optimizations from Python/peephole.c to Python/compile.c (see issue32477 and issue33318). This is a new feature and it is too late for 3.8.

2. Make the peepholer to work with lnotab containing 255.

Pablo, are you interesting?

----------
components: Interpreter Core
messages: 345108
nosy: benjamin.peterson, pablogsal, serhiy.storchaka, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: Peeephole optimizer does not optimize functions with multiline expressions
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Mon Jun 10 04:32:36 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 08:32:36 +0000
Subject: [issue32477] Move jumps optimization from the peepholer to the
 compiler
In-Reply-To: <1514844207.77.0.467229070634.issue32477@psf.upfronthosting.co.za>
Message-ID: <1560155556.67.0.468190295841.issue32477@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Opened issue37213 for the regression in the peepholer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32477>
_______________________________________

From report at bugs.python.org  Mon Jun 10 04:32:54 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 08:32:54 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560155574.2.0.102238599388.issue37213@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +3.8regression

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Mon Jun 10 05:00:04 2019
From: report at bugs.python.org (=?utf-8?b?0JDQu9C10LrRgdC10Lkg0JrQvtGB0YLRi9GA0LjQvQ==?=)
Date: Mon, 10 Jun 2019 09:00:04 +0000
Subject: [issue29717] `loop.add_reader` and `<<EOF`
In-Reply-To: <1488580437.95.0.510009265804.issue29717@psf.upfronthosting.co.za>
Message-ID: <1560157204.17.0.800616719746.issue29717@roundup.psfhosted.org>


??????? ???????? <alex.kostirin at gmail.com> added the comment:

Checked latest master (c879ff247ae1b67a790ff98d2d59145302cd4e4e), 3.8 - 3.5 branches - can not reproduce.
OS - macOS

----------
nosy: +??????? ????????

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29717>
_______________________________________

From report at bugs.python.org  Mon Jun 10 05:37:25 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 10 Jun 2019 09:37:25 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560159445.21.0.688477007924.issue37172@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Not sure what "idempotency fix" means in the context of Future objects.

Could you describe desired behavior or, even better, provide a pull request that demonstrates your desire?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Mon Jun 10 05:42:11 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 10 Jun 2019 09:42:11 +0000
Subject: [issue29717] `loop.add_reader` and `<<EOF`
In-Reply-To: <1488580437.95.0.510009265804.issue29717@psf.upfronthosting.co.za>
Message-ID: <1560159731.24.0.0821395080539.issue29717@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

If fd is a regular file it is not supported well by all select/poll/epoll.
Registration may succeed but the data is marked as "already ready for reading".

Not sure if we should do anything.
The situation may be changed after eventual providing asyncio API for files (there is no actual work for it yet).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29717>
_______________________________________

From report at bugs.python.org  Mon Jun 10 05:44:19 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 10 Jun 2019 09:44:19 +0000
Subject: [issue37107] ensurepip --upgrade doesn't change the version of pip
 used by venv
In-Reply-To: <1559283295.29.0.266679199585.issue37107@roundup.psfhosted.org>
Message-ID: <1560159859.24.0.0219017486081.issue37107@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

Please don't forget that it is possible to use venv without PyPI.

With my Fedora hat on: as a distro, we don't trust PyPI as a package delivery infrastructure. Lots of users do, and we allow the users to easily but explicitly opt in to trusting it by running "pip install". (In the same way, we don't trust rubygems, npm, CPAN, hackage, etc. -- there are too many, and PyPI is not special.)

Changing venv's existing `--upgrade` option to start installing from PyPI is problematic. We'd probably need to patch it out, creating an inconsistency between the distro and upstream: it would not do what `python3 -m pip install --upgrade pip` does.

ISTM, the proposed semantics aren't consistent: "venv --upgrade" would not match what "pip --upgrade" does: it would do what "pip install --upgrade pip" does. The latter needs an extra argument, explicitly saying *what* to upgrade. Making "pip" implicit makes sense for "ensurepip", but not for "venv".

Also, in my view, "network" should not be used as a synonym for PyPI (outside pip).

Could we instead make `venv --upgrade` print out a warning, saying that it upgrades Python, and to upgrade pip you should `python -m pip install --upgrade pip` instead?

---

> Unless you're using a Linux distro Python that has been patched
> to inject the external pip installation with rewheel or dirtbike,
> getting a venv that uses the externally updated version of pip
> requires running
> `python3 - m venv --system-site-packages --without-pip ...`.

FWIW, "rewheel" is no more: Fedora now distributes the wheels themselves, and patches system ensurepip to look in /usr/share/python-wheels/.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37107>
_______________________________________

From report at bugs.python.org  Mon Jun 10 05:57:54 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Mon, 10 Jun 2019 09:57:54 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560160674.49.0.767700756794.issue37172@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

I think that if a Future is abused, the following two should return *same* error:

async def test():
    await asyncio.gather(reader(), writer())

-vs-

async def test():
    await asyncio.gather(reader(), reader(), writer())

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:00:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 10:00:52 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1560160852.72.0.202704478152.issue36742@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13804
pull_request: https://github.com/python/cpython/pull/13937

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:05:04 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 10 Jun 2019 10:05:04 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560161104.76.0.814566566954.issue37172@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Agree, it would be fine.
So the behavior is not changed but the error text should be clear, right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:12:29 2019
From: report at bugs.python.org (Riccardo Schirone)
Date: Mon, 10 Jun 2019 10:12:29 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1560161549.9.0.00285261427466.issue36742@roundup.psfhosted.org>


Riccardo Schirone <rschiron at redhat.com> added the comment:

> CVE-2019-10160 has been assigned by Red Hat to this flaw.

For clarity, CVE-2019-10160 has been assigned to the bug introduced with the fix for the functional regression mentioned in this bug, and not to the bug itself explained in the first comment. See https://bugzilla.redhat.com/show_bug.cgi?id=1718388 for more details about it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:12:40 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 10 Jun 2019 10:12:40 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560161560.77.0.191455340681.issue37213@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thank you very much, Serhiy!

I am interested, I will try to look at the problem and try to get a PR soon.

What of the two possible solutions that you mention you think is better? I assume if we make the peephole optimizer work with lnotab containing 255 we could backport to 3.8 as a bugfix, right?

----------
assignee:  -> pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:18:40 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Mon, 10 Jun 2019 10:18:40 +0000
Subject: [issue37172] Odd error awaiting a Future
In-Reply-To: <1559816999.36.0.898434753785.issue37172@roundup.psfhosted.org>
Message-ID: <1560161920.19.0.348015716212.issue37172@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Yes, I think that would be sufficient!

I don't know about implementation though, as there's some magic in the way Future.__await__ tries to guess how it was called. I hope one day that magic could go away, but I neither understand the origin nor the mechanics of it, so... My gut tells me that fixing the error involves digging into that magic.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37172>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:31:43 2019
From: report at bugs.python.org (shafiq sahil)
Date: Mon, 10 Jun 2019 10:31:43 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560162703.72.0.770737969134.issue37151@roundup.psfhosted.org>


shafiq sahil <sahilshafiq571 at gmail.com> added the comment:

http://www.mobile-phone.pk/search/

----------
nosy: +shafiq sahil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:39:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 10 Jun 2019 10:39:04 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560163144.51.0.125777897059.issue37213@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, we should backport the fix to 3.8. There is a bug in 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:39:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 10:39:37 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
Message-ID: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Spin-off of INADA-san's PEP 597: I propose to emit a new EncodingWarning warning when the locale encoding is used implicitly.

I propose to add a new warning to be able to control how they are handled: either make them hard error (python3.9 -W error::EncodingWarning) or ignore them (python3.9 -W ignore::EncodingWarning).

Displaying these warnings by default or not is an open question discussed in PEP 597 discussion:
https://discuss.python.org/t/pep-597-use-utf-8-for-default-text-file-encoding/1819

I propose to only emit a warning which can be turned off easily to not bother people who don't care of encodings. There are many legit cases where a Python application works well in a control environment whereas it would break on any other environment, but the application is only used in one specific environment. For example, an application may only be run in a container which has a well defined locale and locale encoding, but will never be run on Windows, macOS, FreeBSD or HP-UX.

Writing portable code is *great*. But I'm not sure that *all* code must be portable. For example, it's also fine to use Python to write applications specific to Linux, again, for code only run in a controlled environment. Many companies have private projects which will never run outside their "walls" (outside their datacenters ;-)).

----------
components: Library (Lib)
messages: 345121
nosy: vstinner
priority: normal
severity: normal
status: open
title: Add new EncodingWarning warning category: emitted when the locale encoding is used implicitly
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:47:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 10:47:15 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560163635.42.0.389104244409.issue37214@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13805
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13938

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:49:15 2019
From: report at bugs.python.org (Alexey Kostyrin)
Date: Mon, 10 Jun 2019 10:49:15 +0000
Subject: [issue36221] Setting PYTHONASYNCIODEBUG breaks warnings
In-Reply-To: <1551941918.68.0.578445039903.issue36221@roundup.psfhosted.org>
Message-ID: <1560163755.39.0.6507774484.issue36221@roundup.psfhosted.org>


Alexey Kostyrin <alex.kostirin at gmail.com> added the comment:

Can not reproduce - warning is displayed with PYTHONASYNCIODEBUG=1 
Python version:
Python 3.8.0b1+ (heads/3.8:3f7629d93c, Jun 10 2019, 13:46:55) 
[Clang 10.0.0 (clang-1000.10.44.4)] on darwin

----------
nosy: +def_bk

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 06:49:33 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 10 Jun 2019 10:49:33 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560163773.82.0.431232554959.issue37151@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
Removed message: https://bugs.python.org/msg345119

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Mon Jun 10 07:12:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 11:12:25 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560165145.61.0.401899983978.issue37214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Building Python (make) with PR 13938 emits 7 EncodingWarning warnings:

$ PYTHONWARNINGS=always::EncodingWarning make

/home/vstinner/prog/python/master/Lib/sysconfig.py:228: EncodingWarning: encoding=None
  with open(filename, errors="surrogateescape") as f:
/home/vstinner/prog/python/master/Lib/sysconfig.py:371: EncodingWarning: encoding=None
  with open(config_h) as f:

./setup.py:559: EncodingWarning: encoding=None
  with open(tmpfile) as fp:
./setup.py:691: EncodingWarning: encoding=None
  with open(config_h) as file:
./setup.py:893: EncodingWarning: encoding=None
  with open(tmpfile) as fp:
./setup.py:1369: EncodingWarning: encoding=None
  with open(f) as file:
./setup.py:1496: EncodingWarning: encoding=None
  with open(zlib_h) as fp:


The test suite cannot be run if EncodingWarning are treated as error, an exception fails before running the first test:

$ PYTHONWARNINGS=error::EncodingWarning ./python -W error::EncodingWarning -m test -j0 -r
...
  File "/home/vstinner/prog/python/master/Lib/test/libregrtest/main.py", line 427, in display_header
    print("==", platform.platform(aliased=True),
  ...
  File "/home/vstinner/prog/python/master/Lib/platform.py", line 613, in _syscmd_uname
    output = subprocess.check_output(('uname', option),
  ...
  File "/home/vstinner/prog/python/master/Lib/subprocess.py", line 821, in __init__
    self.stdout = io.TextIOWrapper(self.stdout,
EncodingWarning: encoding=None


To be able to run the test suite, I turned off the warning in subprocess.Popen using this change:

diff --git a/Lib/subprocess.py b/Lib/subprocess.py
index d34c57828b..d89911cc32 100644
--- a/Lib/subprocess.py
+++ b/Lib/subprocess.py
@@ -749,6 +749,9 @@ class Popen(object):
         self.stderr = None
         self.pid = None
         self.returncode = None
+        if not encoding:
+            import locale
+            encoding = locale.getpreferredencoding(False)
         self.encoding = encoding
         self.errors = errors


Using PR 13938 and subprocess.Popen change, at least 136 tests are failing. I have to interrupt the test suite since 7 tests hang:

$ PYTHONWARNINGS=error::EncodingWarning ./python -W error::EncodingWarning -m test -j0 -r
...
7 tests omitted:
    test_cmd_line_script test_concurrent_futures test_httpservers
    test_multiprocessing_fork test_multiprocessing_spawn test_ssl
    test_subprocess

258 tests OK.

136 tests failed:
    test___all__ test__xxsubinterpreters test_argparse test_asyncio
    test_atexit test_base64 test_baseexception test_bdb test_bool
    test_builtin test_bz2 test_calendar test_capi test_cgi test_cgitb
    test_cmath test_cmd_line test_compile test_compileall test_complex
    test_configparser test_contextlib test_coroutines test_cprofile
    test_csv test_ctypes test_dbm test_dbm_dumb test_decimal
    test_defaultdict test_deque test_difflib test_distutils
    test_doctest test_eintr test_email test_embed test_eof
    test_exceptions test_faulthandler test_file test_file_eintr
    test_filecmp test_fileinput test_float test_gc test_gdb test_gzip
    test_hash test_http_cookiejar test_httplib test_idle test_imp
    test_import test_importlib test_inspect test_io test_iter
    test_json test_lib2to3 test_linecache test_list test_lltrace
    test_logging test_lzma test_mailbox test_mailcap test_math
    test_module test_modulefinder test_multiprocessing_forkserver
    test_multiprocessing_main_handling test_netrc test_ntpath
    test_opcodes test_os test_parser test_pathlib test_pdb test_pickle
    test_pipes test_pkg test_pkgimport test_pkgutil test_platform
    test_poll test_popen test_posix test_posixpath test_profile
    test_py_compile test_pydoc test_quopri test_random test_readline
    test_regrtest test_repl test_runpy test_sax test_script_helper
    test_select test_set test_shutil test_signal test_site test_socket
    test_source_encoding test_stat test_support test_symbol test_sys
    test_sysconfig test_tabnanny test_tarfile test_tcl test_tempfile
    test_threading test_tools test_trace test_traceback
    test_tracemalloc test_turtle test_unicodedata test_unittest
    test_univnewlines test_userlist test_utf8_mode test_venv
    test_warnings test_weakref test_webbrowser test_xml_etree
    test_xml_etree_c test_zipfile test_zipimport
    test_zipimport_support


For example, if EncodingWarning is treated as an error, test_cmd_line_script.test_repl_stderr_flush() hangs:

$ PYTHONWARNINGS=error::EncodingWarning ./python -W error::EncodingWarning -m test -v test_cmd_line_script -m test_repl_stderr_flush
...
0:00:00 load avg: 0.83 [1/1] test_cmd_line_script
test_repl_stderr_flush (test.test_cmd_line_script.CmdLineTest) ... 


I would like to believe that Python code base is sane in general and that we handle encodings properly (I spent a significant amount of time to ensure that it's the case ;-)). So even if Python itself emits so many warnings, I don't think that it would be a good idea to introduce this warning and make it an hard error (exception) in Python 3.9.

I even don't think that such warning must be displayed by default. As DeprecationWarning, it's more a notice that should only be displayed to developers. Users don't control the code and so cannot fix the warning just by tuning their locale or locale encoding.

I don't see the point of flooding users with such warnings just to be pedantic.

As I wrote, they are many legit cases for encoding=None.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Mon Jun 10 07:28:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 11:28:11 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560166091.5.0.474149864781.issue37214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Another test: try to build a venv to get pip:


Building a venv is ok. Good, our stdlib is not so bad :-)

$ PYTHONWARNINGS=error::EncodingWarning ./python -W error::EncodingWarning -m venv --without-pip env


But ensurepip fails soon:

$ PYTHONWARNINGS=error::EncodingWarning ./env/bin/python -W error::EncodingWarning -m ensurepip --verbose
/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
Exception:
Traceback (most recent call last):
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/cli/base_command.py", line 179, in main
    status = self.run(options, args)
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/commands/install.py", line 255, in run
    with self._build_session(options) as session:
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/cli/base_command.py", line 87, in _build_session
    session = PipSession(
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/download.py", line 344, in __init__
    self.headers["User-Agent"] = user_agent()
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/download.py", line 108, in user_agent
    zip(["name", "version", "id"], distro.linux_distribution()),
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 120, in linux_distribution
    return _distro.linux_distribution(full_distribution_name)
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 674, in linux_distribution
    self.name() if full_distribution_name else self.id(),
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 712, in name
    name = self.os_release_attr('name') \
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 883, in os_release_attr
    return self._os_release_info.get(attribute, '')
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 550, in __get__
    ret = obj.__dict__[self._fname] = self._f(obj)
  File "/tmp/tmpyxn9yklq/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py", line 921, in _os_release_info
    with open(self.os_release_file) as release_file:
EncodingWarning: encoding=None


Note: an "up to date" pip still emits many SyntaxWarning and DeprecationWarning warnings :-(


New attempt using "always" action:

$ PYTHONWARNINGS=always::EncodingWarning ./env/bin/python -W always::EncodingWarning -m ensurepip --verbose
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py:921: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py:995: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py:1131: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/distro.py:1030: EncodingWarning: encoding=None
/home/vstinner/prog/python/master/Lib/subprocess.py:824: EncodingWarning: encoding=None
  self.stdout = io.TextIOWrapper(self.stdout,
Ignoring indexes: https://pypi.org/simple
Created temporary directory: /tmp/pip-ephem-wheel-cache-2hizyo3q
Created temporary directory: /tmp/pip-req-tracker-kb535zvl
Created requirements tracker '/tmp/pip-req-tracker-kb535zvl'
Created temporary directory: /tmp/pip-install-_z_c4ze9
Looking in links: /tmp/tmpc309fubz
Collecting setuptools
  0 location(s) to search for versions of setuptools:
  Skipping link /tmp/tmpc309fubz (from -f); not a file
  Skipping link file:///tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl; wrong project name (not setuptools)
  Found link file:///tmp/tmpc309fubz/setuptools-40.8.0-py2.py3-none-any.whl, version: 40.8.0
  Local files found: /tmp/tmpc309fubz/setuptools-40.8.0-py2.py3-none-any.whl
  Using version 40.8.0 (newest of versions: 40.8.0)
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  Added setuptools from file:///tmp/tmpc309fubz/setuptools-40.8.0-py2.py3-none-any.whl to build tracker '/tmp/pip-req-tracker-kb535zvl'
  Removed setuptools from file:///tmp/tmpc309fubz/setuptools-40.8.0-py2.py3-none-any.whl from build tracker '/tmp/pip-req-tracker-kb535zvl'
Collecting pip
  0 location(s) to search for versions of pip:
  Found link file:///tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl, version: 19.0.3
  Skipping link file:///tmp/tmpc309fubz/setuptools-40.8.0-py2.py3-none-any.whl; wrong project name (not pip)
  Local files found: /tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl
  Using version 19.0.3 (newest of versions: 19.0.3)
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  Added pip from file:///tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl to build tracker '/tmp/pip-req-tracker-kb535zvl'
  Removed pip from file:///tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl from build tracker '/tmp/pip-req-tracker-kb535zvl'
Installing collected packages: setuptools, pip
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:140: EncodingWarning: encoding=None

/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:157: EncodingWarning: encoding=None
  changing mode of /home/vstinner/prog/python/master/env/bin/easy_install-3.9 to 775
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:140: EncodingWarning: encoding=None

/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:157: EncodingWarning: encoding=None
  changing mode of /home/vstinner/prog/python/master/env/bin/pip3 to 775
  changing mode of /home/vstinner/prog/python/master/env/bin/pip3.9 to 775
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
/tmp/tmpc309fubz/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
Successfully installed pip-19.0.3 setuptools-40.8.0
Cleaning up...
Removed build tracker '/tmp/pip-req-tracker-kb535zvl'


Hum, there are *a lot* of EncodingWarning warnings :-/


Trying to use pip fails with the same distro error:

$ PYTHONWARNINGS=error::EncodingWarning ./env/bin/python -W error::EncodingWarning -m pip install requests
...
  File "/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/distro.py", line 921, in _os_release_info
    with open(self.os_release_file) as release_file:
EncodingWarning: encoding=None


Installing requests using pip emits even more EncodingWarning warnings in many functions of pip, but also in distro and msgpack dependencies:

$ PYTHONWARNINGS=always::EncodingWarning ./env/bin/python -W always::EncodingWarning -m pip install requests
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
  from collections import Mapping
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/distro.py:921: EncodingWarning: encoding=None
  with open(self.os_release_file) as release_file:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/distro.py:995: EncodingWarning: encoding=None
  with open(os.devnull, 'w') as devnull:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/distro.py:1131: EncodingWarning: encoding=None
  with open(filepath) as fp:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/distro.py:1030: EncodingWarning: encoding=None
  with open(os.devnull, 'w') as devnull:
/home/vstinner/prog/python/master/Lib/subprocess.py:824: EncodingWarning: encoding=None
  self.stdout = io.TextIOWrapper(self.stdout,
Collecting requests
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/msgpack/fallback.py:220: PendingDeprecationWarning: encoding is deprecated, Use raw=False instead.
  warnings.warn(
  Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  with open(entry_path, 'w') as fp:
Collecting certifi>=2017.4.17 (from requests)
  Using cached https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  with open(entry_path, 'w') as fp:
Collecting chardet<3.1.0,>=3.0.2 (from requests)
  Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  with open(entry_path, 'w') as fp:
Collecting idna<2.9,>=2.5 (from requests)
  Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  with open(entry_path, 'w') as fp:
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests)
  Using cached https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/req/req_tracker.py:60: EncodingWarning: encoding=None
  with open(entry_path, 'w') as fp:
Installing collected packages: certifi, chardet, idna, urllib3, requests
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:140: EncodingWarning: encoding=None
  with open(os.path.join(wheeldir, item, 'WHEEL')) as wheel:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:140: EncodingWarning: encoding=None
  with open(os.path.join(wheeldir, item, 'WHEEL')) as wheel:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:157: EncodingWarning: encoding=None
  with open(filename) as fp:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:140: EncodingWarning: encoding=None
  with open(os.path.join(wheeldir, item, 'WHEEL')) as wheel:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:140: EncodingWarning: encoding=None
  with open(os.path.join(wheeldir, item, 'WHEEL')) as wheel:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:140: EncodingWarning: encoding=None
  with open(os.path.join(wheeldir, item, 'WHEEL')) as wheel:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/wheel.py:95: EncodingWarning: encoding=None
  return open(name, mode + bin, **nl)
Successfully installed certifi-2019.3.9 chardet-3.0.4 idna-2.8 requests-2.22.0 urllib3-1.25.3
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/utils/outdated.py:40: EncodingWarning: encoding=None
  with open(self.statefile_path) as statefile:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_vendor/msgpack/fallback.py:220: PendingDeprecationWarning: encoding is deprecated, Use raw=False instead.
  warnings.warn(
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/utils/outdated.py:64: EncodingWarning: encoding=None
  with open(self.statefile_path) as statefile:
/home/vstinner/prog/python/master/env/lib/python3.9/site-packages/pip/_internal/utils/outdated.py:74: EncodingWarning: encoding=None
  with open(self.statefile_path, "w") as statefile:
You are using pip version 19.0.3, however version 19.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Mon Jun 10 07:28:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 11:28:45 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560166125.56.0.19543869048.issue37214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My subprocess patch was wrong: you must use attached subprocess.patch.

----------
Added file: https://bugs.python.org/file48408/subprocess.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Mon Jun 10 07:48:23 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Mon, 10 Jun 2019 11:48:23 +0000
Subject: [issue34677] Event scheduler page example
In-Reply-To: <1536927469.93.0.956365154283.issue34677@psf.upfronthosting.co.za>
Message-ID: <1560167303.92.0.400210621975.issue34677@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

Thank you for the report.  As others have said, the actual time.time() value for the two `s.enter` events is different even though the `delay` value of 5 seems like it should be the same.  As @xtreak pointed out, the example is clever in showing that using `enter` instead of `enterabs` can make the queue behave in unexpected ways.

Closing as 'not a bug'.

----------
nosy: +cheryl.sabella
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34677>
_______________________________________

From report at bugs.python.org  Mon Jun 10 08:30:26 2019
From: report at bugs.python.org (Andrei Zene)
Date: Mon, 10 Jun 2019 12:30:26 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1560169826.14.0.00627691287503.issue28708@roundup.psfhosted.org>


Andrei Zene <andrei.zene at outlook.com> added the comment:

I have updated PR 13842(https://github.com/python/cpython/pull/13842) to dynamically alocate the fd_sets on windows.

I did some testing on windows with the following two paterns:
1. 10000 transient clients: (open connection, send message, close connection)
2. 1024 permanent clients: (open connection, then in infinite loop: (read message, send message back))

Everything seemed to be fine.

I didn't do any testing on Linux.

On windows I also had to remove the if that vstinner added to check if the greatest file descriptor is greater than the setsize. That condition always failed for me on Windows. Apparently, according to: https://docs.microsoft.com/en-us/windows/desktop/api/winsock2/nf-winsock2-select, windows ignores nfds and "is included only for compatibility with Berkeley sockets." The documentation also states that the FD_ "macros are compatible with those used in the Berkeley software, but the underlying representation is completely different.", and: "Internally, socket handles in an fd_set structure are not represented as bit flags as in Berkeley Unix. Their data representation is opaque."

This is why I chose to determine setsize based on the inputs. If you think that's not going to work, please say why :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:22:54 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Mon, 10 Jun 2019 13:22:54 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
Message-ID: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>


New submission from Jakub Kulik <kulikjak at gmail.com>:

After the integration of https://bugs.python.org/issue36842, build with dtrace is broken on systems where files that reference DTrace probes need to be modified in-place by dtrace (e.g., Solaris).

The reason for that is that Python/sysmodule.o, which newly contains some dtrace references, was not added to DTRACE_DEPS.

----------
components: Build
messages: 345128
nosy: kulikjak
priority: normal
severity: normal
status: open
title: Build with dtrace is broken on some systems
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:29:33 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Mon, 10 Jun 2019 13:29:33 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560173373.52.0.893837299459.issue37215@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
keywords: +patch
pull_requests: +13806
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13939

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:33:55 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 10 Jun 2019 13:33:55 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1560173635.44.0.463673413816.issue36842@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
pull_requests: +13808
pull_request: https://github.com/python/cpython/pull/13940

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:33:55 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 10 Jun 2019 13:33:55 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560173635.36.0.512301889777.issue37215@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
pull_requests: +13807
pull_request: https://github.com/python/cpython/pull/13940

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:38:14 2019
From: report at bugs.python.org (Charalampos Stratakis)
Date: Mon, 10 Jun 2019 13:38:14 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1560173894.53.0.290619351773.issue36742@roundup.psfhosted.org>


Change by Charalampos Stratakis <cstratak at redhat.com>:


----------
nosy: +cstratak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Mon Jun 10 09:51:32 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Mon, 10 Jun 2019 13:51:32 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560174692.19.0.0784997690576.issue37130@roundup.psfhosted.org>


N.P. Khelili <nophke at free.fr> added the comment:

First, there is no real special case about the '.' path. The parse_args() method simlply removes then during __new__() (around line 80) as they are not needed. Double dots having to be kept, are later considered valid by the name @property.

In test_pathlib.py, '..' are just ignored in a lot of tests. In my previous post, I pointed the bahaviour of .stem and .parent. But we should also consider the question of .anchor. The doc says that it should return the """The concatenation of the drive and root, or ''."""

but the code is:

anchor = self._drv + self._root
return anchor

leading to:

>>> Path('.').anchor
''
>>> Path('..').anchor
''

and:

>>> Path('foo').anchor
''

when one would probably expect '.', './..' and './foo'.

I also found:

>>> Path('*').match('.')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/nono/BUILD/cpython/Lib/pathlib.py", line 956, in match
    raise ValueError("empty pattern")
ValueError: empty pattern


>>> Path('*').match('..')
False

While the behaviour of .stem (cf up msg 344770) dates from initial commit of test_pathlib, maybe breaking it may be a bad idea... ( I really don't know.)

I have a working code that sets name to '' for '..' and adds a special case in .stem() so that we do not remove any line in test_pathlib, but only adds some.

I think anyway, it is too soon for any pull request. Questions are:

- Should .name allways return a string, even if empty?
- Should P('..').parent really return '.'?
- Is it ok that .match() make that much difference between '.' and '..'?
- Am I correct in my expectations about .anchor ?
- May .stem behaviour be changed ?

----------
title: pathlib.with_name() doesn't like unnamed files. -> pathlib does not handle '..' directory

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Mon Jun 10 10:54:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 14:54:06 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1560178446.24.0.691208562723.issue36842@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Mon Jun 10 10:55:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 14:55:28 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560178528.67.0.336911803514.issue34850@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Mon Jun 10 10:55:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 14:55:43 +0000
Subject: [issue23649] tarfile not re-entrant for multi-threading
In-Reply-To: <1426178401.83.0.913984210908.issue23649@psf.upfronthosting.co.za>
Message-ID: <1560178543.59.0.318568539503.issue23649@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23649>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:19:56 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:19:56 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1560179996.48.0.631612789446.issue36842@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8a8b59c9794674b50b2242698c29038034f4864c by Miss Islington (bot) (Christian Heimes) in branch 'master':
bpo-37215: Fix dtrace issue introduce by bpo-36842 (GH-13940)
https://github.com/python/cpython/commit/8a8b59c9794674b50b2242698c29038034f4864c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:19:56 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:19:56 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560179996.43.0.972040988198.issue37215@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8a8b59c9794674b50b2242698c29038034f4864c by Miss Islington (bot) (Christian Heimes) in branch 'master':
bpo-37215: Fix dtrace issue introduce by bpo-36842 (GH-13940)
https://github.com/python/cpython/commit/8a8b59c9794674b50b2242698c29038034f4864c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:20:13 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:20:13 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560180013.21.0.32202399356.issue37215@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13809
pull_request: https://github.com/python/cpython/pull/13942

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:20:13 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:20:13 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1560180013.26.0.800606336367.issue36842@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13810
pull_request: https://github.com/python/cpython/pull/13942

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:38:31 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:38:31 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560181111.72.0.484802291108.issue37215@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bac6e63fd63960a1ab862befab42de05d32667c2 by Miss Islington (bot) in branch '3.8':
bpo-37215: Fix dtrace issue introduce by bpo-36842 (GH-13940)
https://github.com/python/cpython/commit/bac6e63fd63960a1ab862befab42de05d32667c2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:38:31 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 10 Jun 2019 15:38:31 +0000
Subject: [issue36842] Implement PEP 578
In-Reply-To: <1557262112.79.0.0300199683807.issue36842@roundup.psfhosted.org>
Message-ID: <1560181111.77.0.257344232593.issue36842@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bac6e63fd63960a1ab862befab42de05d32667c2 by Miss Islington (bot) in branch '3.8':
bpo-37215: Fix dtrace issue introduce by bpo-36842 (GH-13940)
https://github.com/python/cpython/commit/bac6e63fd63960a1ab862befab42de05d32667c2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36842>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:40:22 2019
From: report at bugs.python.org (makdon)
Date: Mon, 10 Jun 2019 15:40:22 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
Message-ID: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>


New submission from makdon <makdon at makdon.me>:

According the mail in docs mailing list, there's a typo in python installation document on Macos. I will check it and create a PR if necessary.


The email says:


https://docs.python.org/3/using/mac.html#getting-and-installing-macpython

says
"What you get after installing is a number of things:

A MacPython 3.6 folder in your Applications folder."

However, after installing just now

$ /usr/local/bin/python3 -V
Python 3.7.3

I instead found a folder called

/Applications/Python 3.7

----------
assignee: docs at python
components: Documentation
messages: 345134
nosy: docs at python, makdon
priority: normal
severity: normal
status: open
title: mac installation document wrong for python 3.7.3
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 11:44:04 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 10 Jun 2019 15:44:04 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560181444.4.0.861303723832.issue37216@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Relevant email : https://mail.python.org/pipermail/docs/2019-June/041030.html

----------
components: +macOS
nosy: +ned.deily, ronaldoussoren, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 13:19:22 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 10 Jun 2019 17:19:22 +0000
Subject: [issue34850] Emit a syntax warning for "is" with a literal
In-Reply-To: <1538295319.77.0.545547206417.issue34850@psf.upfronthosting.co.za>
Message-ID: <1560187162.67.0.088611590068.issue34850@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34850>
_______________________________________

From report at bugs.python.org  Mon Jun 10 13:23:32 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 10 Jun 2019 17:23:32 +0000
Subject: [issue37107] ensurepip --upgrade doesn't change the version of pip
 used by venv
In-Reply-To: <1559283295.29.0.266679199585.issue37107@roundup.psfhosted.org>
Message-ID: <1560187412.46.0.153688935126.issue37107@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I'm with Petr here. ensurepip/venv should only go as far as we support, which is the version of the wheels included in our bundle. We should continue having the stdlib pretend that PyPI doesn't exist.

External network access would justify the longer option, in my opinion: "--upgrade-pip-from-pypi"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37107>
_______________________________________

From report at bugs.python.org  Mon Jun 10 13:23:42 2019
From: report at bugs.python.org (Tal Einat)
Date: Mon, 10 Jun 2019 17:23:42 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560187422.76.0.968075753784.issue26806@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

> 'max(n, 50)' should have been 'min(n, 50)'  Tal, does you comment avove about the former apply when corrected to the latter?

Yes. To use your terms, I prefer incrementing over thresholding.

> This is all that is needed for getrecursionlimit.

If we go with incrementing, then getrecursionlimit should likely decrement the returned value by the same amount, so that setrecursionlimit(getrecursionlimit()) doesn't change the recursion limit.

> Currently, at least on CPython, n must be >= 1 or ValueError is raised.  I don't like changing that.

This is another issue that incrementing avoids.

Since it looks like we're in general agreement, Terry, I'll work up a PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Mon Jun 10 13:48:58 2019
From: report at bugs.python.org (Tal Einat)
Date: Mon, 10 Jun 2019 17:48:58 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560188938.72.0.0201965415275.issue26806@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Setting the recursion limit too low also causes issues in a plain Python interactive session. With current master (to be 3.9) on Win10, I get issues with values up to 6. In IDLE values up to 20 cause an immediate exception similar to the one described by Serhiy.

Anyways, I think we should increment by 25, to always set "safe" values.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Mon Jun 10 14:49:58 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 10 Jun 2019 18:49:58 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560192598.99.0.00038972082295.issue37130@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
assignee:  -> brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Mon Jun 10 15:15:51 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 10 Jun 2019 19:15:51 +0000
Subject: [issue37206] Incorrect application of Argument Clinic to dict.pop()
In-Reply-To: <1560019685.35.0.640301237908.issue37206@roundup.psfhosted.org>
Message-ID: <1560194151.91.0.945041917245.issue37206@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As I noted on the PR: "I'm not going to get into whether this PR is appropriate for 3.8 but, assuming it were, I would be very concerned about making a change of this size and complexity in 3.7 at this stage in its lifecycle."

----------
nosy: +lukasz.langa, ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37206>
_______________________________________

From report at bugs.python.org  Mon Jun 10 15:51:00 2019
From: report at bugs.python.org (Tal Einat)
Date: Mon, 10 Jun 2019 19:51:00 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560196260.42.0.804769983345.issue26806@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
keywords: +patch
pull_requests: +13811
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13944

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:03:59 2019
From: report at bugs.python.org (kmille)
Date: Mon, 10 Jun 2019 20:03:59 +0000
Subject: [issue37217] SSL socket segfaults during a connect() using a punycode
 domain containg a umlaut
Message-ID: <1560197039.5.0.767955558559.issue37217@roundup.psfhosted.org>


New submission from kmille <christian.schneider at androidloves.me>:

Hey,

chs at gw-sss-nb8:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 16.04.4 LTS
Release:        16.04
Codename:       xenial
chs at gw-sss-nb8:~$ python3 --version
Python 3.5.2
chs at gw-sss-nb8:~$ cat segfault.py 
import ssl
import socket

hostname = "www.xn--b.buchhandlunggr?nden.de"

ctx = ssl.create_default_context()
s = ctx.wrap_socket(socket.socket(), server_hostname=hostname)
s.check_hostname = True
try:
    s.connect((hostname, 443))
except UnicodeError as incorrect_punycode:
    pass

chs at gw-sss-nb8:~$ python3 segfault.py 
Segmentation fault

The problem does not occur if I remove the ? in www.xn--b.buchhandlunggr?nden.de

On my Arch the DNS fails (above the name doesn't resolve too but I seems like it doesn't matter):
kmille at linbox timetracking master % python3 omg.py 
Traceback (most recent call last):
  File "omg.py", line 10, in <module>
    s.connect((hostname, 443))
  File "/usr/lib/python3.7/ssl.py", line 1150, in connect
    self._real_connect(addr, False)
  File "/usr/lib/python3.7/ssl.py", line 1137, in _real_connect
    super().connect(addr)
socket.gaierror: [Errno -2] Name or service not known
kmille at linbox timetracking master % python3 --version
Python 3.7.3

If you need further help please ask.

Thank you for python <3

kmille

----------
components: ctypes
messages: 345140
nosy: kmille
priority: normal
severity: normal
status: open
title: SSL socket segfaults during a connect() using a punycode domain containg a umlaut
versions: Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37217>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:26:08 2019
From: report at bugs.python.org (Tal Einat)
Date: Mon, 10 Jun 2019 20:26:08 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560198368.65.0.564859090846.issue26806@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

See PR GH-13944.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:38:54 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 10 Jun 2019 20:38:54 +0000
Subject: [issue26806] IDLE not displaying RecursionError tracebacks and hangs
In-Reply-To: <1461105544.08.0.0145590373976.issue26806@psf.upfronthosting.co.za>
Message-ID: <1560199134.35.0.129898127181.issue26806@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

[Initially written before you posted the PR]
Serhiy's result suggests that 25 might not always be enough and he suggested 50.  Plus IDLE sometimes makes more calls internally.  Lets go with at least 30.

I agree that "get...(set...(n)) == n" (when n is positive, a check we should emulate) and "set...(get...())" leaving limit as it was are desirable.  The docs and docstrings just need to say what we do.  Possible additions.
"This IDLE wrapper adds 30 to prevent possible uninterruptible loops."
"This IDLE wrapper subtracts 30 to compensate for the 30 IDLE adds when setting the limit."

The main reason I can think of for users to play with low recursion limits is to explore the implementation.  They simply cannot get stock CPython behavior when running with IDLE.  So I want the IDLE wrappers to not be completely transparent. For that to be obvious in calltips, the first line should say so.

The main reason I want to intervene is to prevent the not-nice behavior of hanging until a manual restart.  I checked, and it is still possible.

In 3.8.0b1, the min n is not 1 but current stack + 5.
>>> sys.setrecursionlimit(11)
Traceback (most recent call last):
  File "<pyshell#9>", line 1, in <module>
    sys.setrecursionlimit(11)
RecursionError: cannot set the recursion limit to 11 at the recursion depth 6: the limit is too low

Our increment will prevent a user from seeing this, but this is necessary to prevent ...

>>> sys.setrecursionlimit(12)
# hangs, once after printing "Exception ignored in thread started by"
# until manual restart.
# 18 hangs after printing 60 lines of a double exception.
# 20 does not hang and calling 'f' from the original message
# gets a truncated traceback ending with
   [Previous line repeated 12 more times]

----------
stage: patch review -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26806>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:42:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 20:42:50 +0000
Subject: [issue13889] str(float) and round(float) issues with FPU precision
In-Reply-To: <1327676303.66.0.487112802864.issue13889@psf.upfronthosting.co.za>
Message-ID: <1560199370.57.0.321176016701.issue13889@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13812
pull_request: https://github.com/python/cpython/pull/13946

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13889>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:45:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 20:45:58 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560199558.91.0.809301920873.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13813
pull_request: https://github.com/python/cpython/pull/13946

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 16:59:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 20:59:51 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560200391.81.0.920640613625.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh. Using PR 13889, I'm able to reproduce the bug up to Python 3.4. Example at commit commit e76cbc781044ee01b059f3702c580e66266b84c5 (tag: v3.4.10):

$ wget 'https://github.com/python/cpython/pull/13889.patch'
$ git apply 13889.patch
$ ./python -m test  -F -m test_threads_join_2  test_threading
[  1] test_threading
[  2] test_threading
(...)
[ 10] test_threading
[ 11] test_threading
Fatal Python error: Py_EndInterpreter: not the last thread

Current thread 0x00007f418b3280c0 (most recent call first):
  File "/home/vstinner/prog/python/3.4/Lib/test/support/__init__.py", line 2304 in run_in_subinterp
  File "/home/vstinner/prog/python/3.4/Lib/test/test_threading.py", line 877 in test_threads_join_2
  (...)
Aborted (core dumped)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 17:02:15 2019
From: report at bugs.python.org (Alex Willmer)
Date: Mon, 10 Jun 2019 21:02:15 +0000
Subject: [issue37218] Default hmac.new() digestmod has not been removed from
 documentation
Message-ID: <1560200535.68.0.253007657272.issue37218@roundup.psfhosted.org>


New submission from Alex Willmer <alex at moreati.org.uk>:

Until Python 3.8 hmc.new() defaulted the digestmod argument to 'hmac-md5'. This was deperecated, to be removed in Python 3.8. In Python 3.8.0b1 it is gone, e.g.

Python 3.8.0b1 (default, Jun  6 2019, 03:44:52) 
[GCC 7.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import hmac
>>> hmac.new(b'qwertyuiop').name
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.8/hmac.py", line 146, in new
    return HMAC(key, msg, digestmod)
  File "/usr/lib/python3.8/hmac.py", line 49, in __init__
    raise ValueError('`digestmod` is required.')
ValueError: `digestmod` is required.

but the deprecation note, and the documented signature haven't been updated.

PR incoming

----------
assignee: docs at python
components: Documentation
messages: 345144
nosy: Alex.Willmer, docs at python
priority: normal
severity: normal
status: open
title: Default hmac.new() digestmod has not been removed from documentation
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37218>
_______________________________________

From report at bugs.python.org  Mon Jun 10 17:20:37 2019
From: report at bugs.python.org (Alex Willmer)
Date: Mon, 10 Jun 2019 21:20:37 +0000
Subject: [issue37218] Default hmac.new() digestmod has not been removed from
 documentation
In-Reply-To: <1560200535.68.0.253007657272.issue37218@roundup.psfhosted.org>
Message-ID: <1560201637.45.0.769722893883.issue37218@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

Scratch the part about documented signature, it's still `hmac.new(... digestmod=None)`, the check happens in the body of the function

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37218>
_______________________________________

From report at bugs.python.org  Mon Jun 10 17:23:12 2019
From: report at bugs.python.org (Lisa Roach)
Date: Mon, 10 Jun 2019 21:23:12 +0000
Subject: [issue24412] setUpClass equivalent for addCleanup
In-Reply-To: <1433788299.35.0.440062273493.issue24412@psf.upfronthosting.co.za>
Message-ID: <1560201792.34.0.204292212258.issue24412@roundup.psfhosted.org>


Change by Lisa Roach <lisaroach14 at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24412>
_______________________________________

From report at bugs.python.org  Mon Jun 10 17:46:07 2019
From: report at bugs.python.org (Alex Willmer)
Date: Mon, 10 Jun 2019 21:46:07 +0000
Subject: [issue37218] Default hmac.new() digestmod has not been removed from
 documentation
In-Reply-To: <1560200535.68.0.253007657272.issue37218@roundup.psfhosted.org>
Message-ID: <1560203167.76.0.950777730782.issue37218@roundup.psfhosted.org>


Change by Alex Willmer <alex at moreati.org.uk>:


----------
keywords: +patch
pull_requests: +13814
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13947

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37218>
_______________________________________

From report at bugs.python.org  Mon Jun 10 17:57:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 21:57:27 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560203847.28.0.493356604945.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

threading._shutdown() uses threading.enumerate() which iterations on threading._active.

threading.Thread registers itself into threading._active using its _bootstrap_inner() method. It unregisters itself when _bootstrap_inner() completes, whereas its is_alive() method still returns true: since the underlying native thread still runs and the Python thread state still exists.

_thread._set_sentinel() creates a lock and registers a tstate->on_delete callback to release this lock. It's called by threading.Thread._set_tstate_lock() to set threading.Thread._tstate_lock. This lock is used by threading.Thread.join() to wait until the thread completes.


_thread.start_new_thread() calls the C function t_bootstrap() which ends with:

    tstate->interp->num_threads--;
    PyThreadState_Clear(tstate);
    PyThreadState_DeleteCurrent();
    PyThread_exit_thread();

_PyThreadState_DeleteCurrent() calls tstate->on_delete() which releases threading.Thread._tstate_lock lock.

In test_threads_join_2() test, PyThreadState_Clear() blocks on clearing thread variables: the Sleeper destructor of the Sleeper instance sleeps.

The race condition is that:

* threading._shutdown() rely on threading._alive
* Py_EndInterpreter() rely on the interpreter linked list of Python thread states: interp->tstate_head.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 18:01:36 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Mon, 10 Jun 2019 22:01:36 +0000
Subject: [issue37219] empty set difference does not check types of values
Message-ID: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>


New submission from Anthony Sottile <asottile at umich.edu>:

This is a regression from python2.x behaviour:

$ python2
Python 2.7.15rc1 (default, Nov 12 2018, 14:31:15) 
[GCC 7.3.0] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> x = set()
>>> x.difference(123)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: 'int' object is not iterable


$ python3.8
Python 3.8.0b1 (default, Jun  6 2019, 03:44:52) 
[GCC 7.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> x = set()
>>> x.difference(123)
set()

The regression appears to be introduced in this patch: 4103e4dfbce

https://github.com/python/cpython/commit/4103e4dfbce

----------
components: Library (Lib)
messages: 345147
nosy: Anthony Sottile, rhettinger
priority: normal
severity: normal
status: open
title: empty set difference does not check types of values
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Mon Jun 10 18:33:32 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 10 Jun 2019 22:33:32 +0000
Subject: [issue36905]
 test_typing.GetTypeHintTests.test_get_type_hints_modules_forwardref
 unexpected success while running whole test suite sequentially
In-Reply-To: <1557762722.1.0.805190875774.issue36905@roundup.psfhosted.org>
Message-ID: <1560206012.51.0.943423920787.issue36905@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Unexpected success of test_get_type_hints_modules_forwardref  in test_typing

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36905>
_______________________________________

From report at bugs.python.org  Mon Jun 10 18:39:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 22:39:36 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560206376.07.0.888465689277.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13816
pull_request: https://github.com/python/cpython/pull/13948

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 18:49:49 2019
From: report at bugs.python.org (Zachary Ware)
Date: Mon, 10 Jun 2019 22:49:49 +0000
Subject: [issue37220] test_idle crash on Windows when run with -R:
Message-ID: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>


New submission from Zachary Ware <zachary.ware at gmail.com>:

See for example https://buildbot.python.org/all/#/builders/33/builds/613

This build ended when I logged into the machine and clicked the "Close the program" button on the "python_d.exe crashed" dialog box.  Here's the details from that dialog:

Problem signature:
  Problem Event Name:	APPCRASH
  Application Name:	python_d.exe
  Application Version:	0.0.0.0
  Application Timestamp:	5cfe5fd5
  Fault Module Name:	tk85g.dll
  Fault Module Version:	8.5.2.19
  Fault Module Timestamp:	5bf46c38
  Exception Code:	c0000005
  Exception Offset:	000000000002ef7f
  OS Version:	6.3.9600.2.0.0.256.27
  Locale ID:	1033
  Additional Information 1:	0d70
  Additional Information 2:	0d701a26b222a63773c5247c2c1f6fa1
  Additional Information 3:	044d
  Additional Information 4:	044dd28b2ab7dea188c1da19a590076d



Bisection shows that the issue showed up with 1b57ab5c6478b93cf4150bd8c475022252776598 in bpo-37177.

----------
assignee: terry.reedy
components: IDLE, Windows
keywords: buildbot
messages: 345148
nosy: paul.moore, steve.dower, taleinat, terry.reedy, tim.golden, zach.ware
priority: normal
severity: normal
stage: test needed
status: open
title: test_idle crash on Windows when run with -R:
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Mon Jun 10 18:52:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 22:52:15 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560207135.96.0.22521810743.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Other references to test_threads_join_2() failures:

* bpo-36989: fails once AIX
* bpo-27791: 2 failures in 2016 in "AMD64 FreeBSD 10 Shared 3.x" buildbots (I closed the issue with: "Sadly, such bug is hard to reproduce. I didn't look at buildbots recently, and I don't have access to FreeBSD, so I just close the issue :-/")
* bpo-28084: once failure on "AMD64 FreeBSD 9.x 3.x" buildbot (closed as a duplicate of bpo-27791)

See also bpo-18808: "Thread.join returns before PyThreadState is destroyed" (issue which added the test).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:04:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:04:33 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560207873.65.0.4384886288.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13817
pull_request: https://github.com/python/cpython/pull/13949

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:10:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:10:50 +0000
Subject: [issue36402] test_threading: test_threads_join_2() failed with "Fatal
 Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD
 CURRENT Shared 3.x
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560208250.74.0.640234147344.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

test_threading: test_threads_join_2() was added by commit 7b47699 in 2013, but the test failed randomly since it was added. It's just that failures were ignored until I created https://bugs.python.org/issue36402 last March.

In fact, when the test failed randomly on buildbot (with tests run in parallel), it was fine since test_threading was re-run alone and then the test passed. The buildbot build was seen overall as a success. Previous issues were closed (see my previous comment).

The test shows the bug using subinterpreters (Py_EndInterpreter), but the bug also exists in Py_Finalize() which hash the same race condition (it also calls threading._shutdown()). It's just that Py_EndInterpreter() is stricter, it contains this assertion:

    if (tstate != interp->tstate_head || tstate->next != NULL)
        Py_FatalError("Py_EndInterpreter: not the last thread");

Attached py_finalize.patch adds the same assertion to Py_Finalize.

I added test_threading.test_finalization_shutdown() to PR 13948. If you run test_finalization_shutdown() with py_finalize.patch, Py_Finalize() fails with a similar assertion error.

But py_finalize.patch is incompatible with the principle of daemon threads and so cannot be commited.

----------
Added file: https://bugs.python.org/file48409/py_finalize.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:11:51 2019
From: report at bugs.python.org (Robert)
Date: Mon, 10 Jun 2019 23:11:51 +0000
Subject: [issue33591] ctypes does not support fspath protocol
In-Reply-To: <1526900168.47.0.682650639539.issue33591@psf.upfronthosting.co.za>
Message-ID: <1560208311.39.0.955905437454.issue33591@roundup.psfhosted.org>


Robert <lma at posteo.de> added the comment:

Can anyone do a review?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33591>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:12:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:12:29 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560208349.69.0.174567563674.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: test_threading: test_threads_join_2() failed with "Fatal Python error: Py_EndInterpreter: not the last thread" on AMD64 FreeBSD CURRENT Shared 3.x -> threading._shutdown() race condition: test_threading test_threads_join_2() fails randomly

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:19:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:19:38 +0000
Subject: [issue18808] Thread.join returns before PyThreadState is destroyed
In-Reply-To: <1377179797.68.0.40345735309.issue18808@psf.upfronthosting.co.za>
Message-ID: <1560208778.84.0.858364193471.issue18808@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

_thread._set_sentinel() and threading.Thread._tstate_lock is a great enhancement, as Py_EndInterprter() which now calls threading._shutdown().

FYI I found yet another race condition, this time in threading._shutdown(). See bpo-36402 follow-up: "threading._shutdown() race condition: test_threading test_threads_join_2() fails randomly".

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18808>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:24:27 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Mon, 10 Jun 2019 23:24:27 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
Message-ID: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>


New submission from Nick Coghlan <ncoghlan at gmail.com>:

The Porting section of the What's New guide is for changes where the old behaviour was at best arguably correct, but it's still possible someone was relying on it behaving exactly the way it used to.

It isn't for us to say "We broke all extensions that use this existing public C API by adding a new parameter to its signature".

For 3.8b2, the function with the extra parameter should be renamed to PyCode_NewEx, and a PyCode_New compatibility wrapper added that calls it with the extra parameter set to zero.

----------
keywords: 3.8regression
messages: 345153
nosy: lukasz.langa, ncoghlan, pablogsal
priority: release blocker
severity: normal
stage: needs patch
status: open
title: PyCode_New API change breaks backwards compatibility policy
type: compile error
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:28:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:28:10 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560209290.62.0.447776967486.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

PyCode_New() and types.CodeType constructor are actively discussed:

* https://mail.python.org/archives/list/python-dev at python.org/thread/VXDPH2TUAHNPT5K6HBUIV6VASBCKKY2K/
* bpo-36896
* bpo-36886

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:38:21 2019
From: report at bugs.python.org (Dan Hemberger)
Date: Mon, 10 Jun 2019 23:38:21 +0000
Subject: [issue37222] urllib missing voidresp breaks CacheFTPHandler
Message-ID: <1560209901.95.0.0637922149523.issue37222@roundup.psfhosted.org>


New submission from Dan Hemberger <daniel.hemberger at gmail.com>:

When using the CacheFTPHandler in the most basic of contexts, a URLError will be thrown if you try to reuse any of the FTP instances stored in the handler. This makes CacheFTPHandler unusable for its intended purpose. Note that the default FTPHandler circumvents this issue by creating a new ftplib.FTP instance for each connection (and thus never reuses any of them).

Here is a simple example illustrating the problem:

"""
import urllib.request as req 
import ftplib

opener = req.build_opener(req.CacheFTPHandler)
req.install_opener(opener)

ftplib.FTP.debugging = 2 

for _ in range(2):
    req.urlopen("ftp://www.pythontest.net/README", timeout=10)
"""

>From the ftplib debugging output, we see the following communication between the client and server:

"""
*cmd* 'TYPE I'
*put* 'TYPE I\r\n'
*get* '200 Switching to Binary mode.\n'
*resp* '200 Switching to Binary mode.'
*cmd* 'PASV'
*put* 'PASV\r\n'
*get* '227 Entering Passive Mode (159,89,235,38,39,111).\n'
*resp* '227 Entering Passive Mode (159,89,235,38,39,111).'
*cmd* 'RETR README'
*put* 'RETR README\r\n'
*get* '150 Opening BINARY mode data connection for README (123 bytes).\n'
*resp* '150 Opening BINARY mode data connection for README (123 bytes).'
*cmd* 'TYPE I'
*put* 'TYPE I\r\n'
*get* '226 Transfer complete.\n'
*resp* '226 Transfer complete.'
*cmd* 'PASV'
*put* 'PASV\r\n'
*get* '200 Switching to Binary mode.\n'
*resp* '200 Switching to Binary mode.'
ftplib.error_reply: 200 Switching to Binary mode.
"""

The client and the server have gotten out of sync due to the missing voidresp() call, i.e. the client sends 'Type I' but receives the response from the previous 'RETR README' command. When ftp.voidresp() is added anywhere between after the ftp.ntransfercmd() and before the next command is sent (i.e. by reverting 2d51f687e133fb8141f1a6b5a6ac51c9d5eddf58), we see the correct send/receive pattern:

"""
*cmd* 'TYPE I'
*put* 'TYPE I\r\n'
*get* '200 Switching to Binary mode.\n'
*resp* '200 Switching to Binary mode.'
*cmd* 'PASV'
*put* 'PASV\r\n'
*get* '227 Entering Passive Mode (159,89,235,38,39,107).\n'
*resp* '227 Entering Passive Mode (159,89,235,38,39,107).'
*cmd* 'RETR README'
*put* 'RETR README\r\n'
*get* '150 Opening BINARY mode data connection for README (123 bytes).\n'
*resp* '150 Opening BINARY mode data connection for README (123 bytes).'
*get* '226 Transfer complete.\n'
*resp* '226 Transfer complete.'
*cmd* 'TYPE I'
*put* 'TYPE I\r\n'
*get* '200 Switching to Binary mode.\n'
*resp* '200 Switching to Binary mode.'
*cmd* 'PASV'
*put* 'PASV\r\n'
*get* '227 Entering Passive Mode (159,89,235,38,39,107).\n'
*resp* '227 Entering Passive Mode (159,89,235,38,39,107).'
*cmd* 'RETR README'
*put* 'RETR README\r\n'
*get* '150 Opening BINARY mode data connection for README (123 bytes).\n'
*resp* '150 Opening BINARY mode data connection for README (123 bytes).'
*get* '226 Transfer complete.\n'
*resp* '226 Transfer complete.'
"""

By inspecting the methods of ftplib.FTP, we can see that every use of ntransfercmd() is followed by a voidresp(), see e.g. retrbinary, retrlines, storbinary, storlines, and voidcmd.

I hope that some experts in urllib and ftplib can weigh in on any of the subtleties of this issue, but I think it's clear that the missing ftp.voidresp() call is a significant bug.

--------------------------------------
Some historical notes about this issue
--------------------------------------

This issue has been documented in a number of other bug reports, but I don't think any have addressed the complete breakage of the CachedFTPHandler that it causes.

The breaking change was originally introduced as a resolution to issue16270. However, it's not clear from the comments why it was believed that removing ftp.voidresp() from endtransfer() was the correct solution. In either case, with this commit reverted, both the test outlined in this report and in issue16270 work correctly.

@orsenthil has suggested this fix (to revert the change to endtransfer) in msg286020, and has explained his reasoning in detail in msg286016.

@Ivan.Pozdeev has also explained this issue in msg282797 and provided a similar patch in issue28931, though it does more than just revert the breaking commit and I'm not sure what the additional changes are intending to fix.

----------
components: Library (Lib)
messages: 345155
nosy: danh
priority: normal
severity: normal
status: open
title: urllib missing voidresp breaks CacheFTPHandler
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37222>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:39:36 2019
From: report at bugs.python.org (Emmanuel Arias)
Date: Mon, 10 Jun 2019 23:39:36 +0000
Subject: [issue36373] Deprecate explicit loop parameter in all public asyncio
 APIs
In-Reply-To: <1553025335.55.0.640410639085.issue36373@roundup.psfhosted.org>
Message-ID: <1560209976.77.0.0840747621317.issue36373@roundup.psfhosted.org>


Change by Emmanuel Arias <emmanuelarias30 at gmail.com>:


----------
pull_requests: +13818
pull_request: https://github.com/python/cpython/pull/13950

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36373>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:44:24 2019
From: report at bugs.python.org (Dan Hemberger)
Date: Mon, 10 Jun 2019 23:44:24 +0000
Subject: [issue16270] urllib hangs when closing connection
In-Reply-To: <1350509929.7.0.680667591801.issue16270@psf.upfronthosting.co.za>
Message-ID: <1560210264.98.0.0307680197361.issue16270@roundup.psfhosted.org>


Change by Dan Hemberger <daniel.hemberger at gmail.com>:


----------
pull_requests: +13820
pull_request: https://github.com/python/cpython/pull/13951

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue16270>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:44:24 2019
From: report at bugs.python.org (Dan Hemberger)
Date: Mon, 10 Jun 2019 23:44:24 +0000
Subject: [issue37222] urllib missing voidresp breaks CacheFTPHandler
In-Reply-To: <1560209901.95.0.0637922149523.issue37222@roundup.psfhosted.org>
Message-ID: <1560210264.93.0.320036747802.issue37222@roundup.psfhosted.org>


Change by Dan Hemberger <daniel.hemberger at gmail.com>:


----------
keywords: +patch
pull_requests: +13819
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13951

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37222>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:45:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:45:19 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
Message-ID: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

bpo-18748 modified io.IOBase finalizer to no longer silence close() exception in develoment and in debug mode.

The commit 472f794a33221ea835a2fbf6c9f12aa2bd66d1b0 fixed a few destructor errors in test_io, but there are still a few:

test_uninitialized (test.test_io.PyBufferedReaderTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 836, in raw
    return self._raw
AttributeError: 'BufferedReader' object has no attribute '_raw'
ok

test_max_buffer_size_removal (test.test_io.PyBufferedWriterTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1299, in close
    with self._write_lock:
AttributeError: 'BufferedWriter' object has no attribute '_write_lock'
ok

test_misbehaved_io (test.test_io.PyBufferedWriterTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1308, in close
    self.flush()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1269, in flush
    self._flush_unlocked()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1285, in _flush_unlocked
    raise OSError("write() returned incorrect number of bytes")
OSError: write() returned incorrect number of bytes
ok

test_uninitialized (test.test_io.PyBufferedWriterTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1299, in close
    with self._write_lock:
AttributeError: 'BufferedWriter' object has no attribute '_write_lock'
ok

test_writer_close_error_on_close (test.test_io.CBufferedRWPairTest) ...
Exception ignored in: <_io.BufferedWriter>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/unittest/case.py", line 611, in _callTestMethod
    method()
ValueError: flush of closed file
ok

test_constructor_max_buffer_size_removal (test.test_io.PyBufferedRWPairTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
AttributeError: 'BufferedRWPair' object has no attribute 'reader'
ok

test_constructor_with_not_readable (test.test_io.PyBufferedRWPairTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
AttributeError: 'BufferedRWPair' object has no attribute 'reader'
ok

test_constructor_with_not_writeable (test.test_io.PyBufferedRWPairTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
AttributeError: 'BufferedRWPair' object has no attribute 'reader'
ok

test_isatty (test.test_io.PyBufferedRWPairTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1300, in close
    if self.raw is None or self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1300, in close
    if self.raw is None or self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1300, in close
    if self.raw is None or self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 814, in close
    if self.raw is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1300, in close
    if self.raw is None or self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'SelectableIsAtty' object has no attribute 'closed'
ok

test_uninitialized (test.test_io.PyBufferedRWPairTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1377, in close
    self.reader.close()
AttributeError: 'BufferedRWPair' object has no attribute 'reader'
ok

test_destructor (test.test_io.CBufferedRandomTest) ...
Exception ignored in: <_io.BufferedRWPair object at 0x7f2f3c5842f0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/support/__init__.py", line 1627, in gc_collect
    gc.collect()
ValueError: flush of closed file

Exception ignored in: <_io.BufferedWriter>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/support/__init__.py", line 1627, in gc_collect
    gc.collect()
ValueError: flush of closed file
ok

test_misbehaved_io (test.test_io.CBufferedRandomTest) ...
Exception ignored in: <_io.BufferedRandom>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_io.py", line 2306, in test_misbehaved_io
    BufferedReaderTest.test_misbehaved_io(self)
OSError: Raw stream returned invalid position -123

Exception ignored in: <_io.BufferedRandom>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_io.py", line 2307, in test_misbehaved_io
    BufferedWriterTest.test_misbehaved_io(self)
OSError: Raw stream returned invalid position -123
ok

test_write_non_blocking (test.test_io.CBufferedRandomTest) ...
Exception ignored in: <_io.BufferedRandom>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/unittest/case.py", line 611, in _callTestMethod
    method()
io.UnsupportedOperation: seek
ok

test_max_buffer_size_removal (test.test_io.PyBufferedRandomTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1299, in close
    with self._write_lock:
AttributeError: 'BufferedRandom' object has no attribute '_write_lock'
ok

test_misbehaved_io (test.test_io.PyBufferedRandomTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1308, in close
    self.flush()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1269, in flush
    self._flush_unlocked()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1285, in _flush_unlocked
    raise OSError("write() returned incorrect number of bytes")
OSError: write() returned incorrect number of bytes
ok

test_uninitialized (test.test_io.PyBufferedRandomTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1299, in close
    with self._write_lock:
AttributeError: 'BufferedRandom' object has no attribute '_write_lock'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 1299, in close
    with self._write_lock:
AttributeError: 'BufferedRandom' object has no attribute '_write_lock'
ok

test_destructor (test.test_io.PyTextIOWrapperTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/test/test_io.py", line 2817, in close
    l.append(self.getvalue())
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 896, in getvalue
    raise ValueError("getvalue on closed file")
ValueError: getvalue on closed file
ok

test_issue22849 (test.test_io.PyTextIOWrapperTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'

Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
AttributeError: 'F' object has no attribute 'closed'
ok

test_repr (test.test_io.PyTextIOWrapperTest) ...
Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 409, in __del__
    self.close()
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2161, in close
    if self.buffer is not None and not self.closed:
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 2169, in closed
    return self.buffer.closed
  File "/home/vstinner/prog/python/master/Lib/_pyio.py", line 840, in closed
    return self.raw.closed
AttributeError: 'NoneType' object has no attribute 'closed'
ok


List of failing tests:

test.test_io.CBufferedRWPairTest.test_writer_close_error_on_close
test.test_io.CBufferedRandomTest.test_destructor
test.test_io.CBufferedRandomTest.test_misbehaved_io
test.test_io.CBufferedRandomTest.test_write_non_blocking
test.test_io.PyBufferedRWPairTest.test_constructor_max_buffer_size_removal
test.test_io.PyBufferedRWPairTest.test_constructor_with_not_readable
test.test_io.PyBufferedRWPairTest.test_constructor_with_not_writeable
test.test_io.PyBufferedRWPairTest.test_isatty
test.test_io.PyBufferedRWPairTest.test_uninitialized
test.test_io.PyBufferedRandomTest.test_max_buffer_size_removal
test.test_io.PyBufferedRandomTest.test_misbehaved_io
test.test_io.PyBufferedRandomTest.test_uninitialized
test.test_io.PyBufferedReaderTest.test_uninitialized
test.test_io.PyBufferedWriterTest.test_max_buffer_size_removal
test.test_io.PyBufferedWriterTest.test_misbehaved_io
test.test_io.PyBufferedWriterTest.test_uninitialized
test.test_io.PyTextIOWrapperTest.test_destructor
test.test_io.PyTextIOWrapperTest.test_issue22849
test.test_io.PyTextIOWrapperTest.test_repr

----------
components: Tests
messages: 345156
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_io logs Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0> warnings
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:45:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:45:40 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560210340.04.0.371690508429.issue18748@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created bpo-37223: test_io logs Exception ignored in: <function IOBase.__del__ at 0x7f2f3c73e4b0> warnings.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:45:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:45:53 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560210353.54.0.00457416345017.issue18748@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -13234

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:46:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:46:34 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560210394.83.0.0681255525867.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-36918 (test_urllib) and bpo-37069 (regrtest: log unraisable exceptions and uncaught thread exceptions).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 19:55:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 10 Jun 2019 23:55:20 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560210920.13.0.35975447711.issue18748@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13821
pull_request: https://github.com/python/cpython/pull/13952

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:18:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:18:18 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560212298.77.0.66592947887.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

PR 13952 fix many errors, but not of all them.

test_io.PyBufferedWriterTest.test_misbehaved_io() logs a warning, whereas test_io.CBufferedWriterTest.test_misbehaved_io() doesn't. It seems like _pyio.BufferedWriter lacks bpo-32228 fix.

Extract of the C implementation:

static PyObject *
_bufferedwriter_flush_unlocked(buffered *self)
{
    ...

    if (!VALID_WRITE_BUFFER(self) || self->write_pos == self->write_end)
        goto end;

    /* First, rewind */
    rewind = RAW_OFFSET(self) + (self->pos - self->write_pos);
    if (rewind != 0) {
        n = _buffered_raw_seek(self, -rewind, 1);
        if (n < 0) {
            goto error;
        }
        self->raw_pos -= rewind;
    }
    ...


end:
    /* This ensures that after return from this function,
       VALID_WRITE_BUFFER(self) returns false.

       This is a required condition because when a tell() is called
       after flushing and if VALID_READ_BUFFER(self) is false, we need
       VALID_WRITE_BUFFER(self) to be false to have
       RAW_OFFSET(self) == 0.

       Issue: https://bugs.python.org/issue32228 */
    _bufferedwriter_reset_buf(self);
    Py_RETURN_NONE;

error:
    return NULL;
}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:49:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:49:17 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560214157.13.0.550807026459.issue18748@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 4f6f7c5a611905fb6b81671547f268c226bc646a by Victor Stinner in branch 'master':
bpo-18748: Fix _pyio.IOBase destructor (closed case) (GH-13952)
https://github.com/python/cpython/commit/4f6f7c5a611905fb6b81671547f268c226bc646a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:49:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:49:51 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560214191.7.0.322054308595.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New changeset 4f6f7c5a611905fb6b81671547f268c226bc646a by Victor Stinner in branch 'master':
bpo-18748: Fix _pyio.IOBase destructor (closed case) (GH-13952)
https://github.com/python/cpython/commit/4f6f7c5a611905fb6b81671547f268c226bc646a

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:54:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:54:19 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560214459.63.0.0417342279116.issue37223@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13822
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13954

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:58:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:58:01 +0000
Subject: [issue37224] test__xxsubinterpreters failed on AMD64 Windows8.1
 Refleaks 3.8
Message-ID: <1560214681.61.0.906498246375.issue37224@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

https://buildbot.python.org/all/#/builders/224/builds/5

0:46:02 load avg: 1.53 [259/423/1] test__xxsubinterpreters failed -- running: test_httplib (1 min 6 sec), test_mmap (16 min 42 sec)
beginning 6 repetitions
123456
..Exception in thread Thread-28:
Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\threading.py", line 923, in _bootstrap_inner
    self.run()
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 51, in run
    interpreters.run_string(interp, dedent(f"""
RuntimeError: unrecognized interpreter ID 182
test test__xxsubinterpreters failed -- Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 492, in test_subinterpreter
    self.assertTrue(interpreters.is_running(interp))
AssertionError: False is not true

(...)

FAIL: test_still_running (test.test__xxsubinterpreters.DestroyTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.8.ware-win81-release.refleak\build\lib\test\test__xxsubinterpreters.py", line 765, in test_still_running
    interpreters.destroy(interp)
AssertionError: RuntimeError not raised

----------
components: Tests
messages: 345162
nosy: eric.snow, vstinner
priority: normal
severity: normal
status: open
title: test__xxsubinterpreters failed on AMD64 Windows8.1 Refleaks 3.8
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37224>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:58:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:58:20 +0000
Subject: [issue37224] test__xxsubinterpreters failed on AMD64 Windows8.1
 Refleaks 3.8
In-Reply-To: <1560214681.61.0.906498246375.issue37224@roundup.psfhosted.org>
Message-ID: <1560214700.11.0.271680299653.issue37224@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See bpo-33356.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37224>
_______________________________________

From report at bugs.python.org  Mon Jun 10 20:59:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 00:59:29 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560214769.52.0.826136120648.issue36918@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -13428

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:05:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 01:05:00 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560215100.85.0.712711249381.issue36918@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13823
pull_request: https://github.com/python/cpython/pull/13955

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:06:28 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 11 Jun 2019 01:06:28 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560215188.64.0.991091284878.issue36402@roundup.psfhosted.org>


Change by Kubilay Kocak <koobs.freebsd at gmail.com>:


----------
nosy: +koobs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:08:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 01:08:50 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560215330.19.0.687681570097.issue36918@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Well, maybe Python GC can be enhanced. In the meanwhile, I would like to make these warnings quiet since they are very annoying when I have to analyze buildbot warnings. Moreover, this issues blocks my bpo-37069.

Maybe open a separated issue to propose to enhance the GC, if you have an idea how to change it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:11:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 01:11:02 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560215462.95.0.658637650487.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset b589cef9c4dada2fb84ce0fae5040ecf16d9d5ef by Victor Stinner in branch 'master':
bpo-37223: test_io: silence destructor errors (GH-13954)
https://github.com/python/cpython/commit/b589cef9c4dada2fb84ce0fae5040ecf16d9d5ef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:11:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 01:11:41 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560215501.7.0.4517333416.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Once bpo-36918 will be fixed, I will backport changes to Python 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:12:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 01:12:13 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560215533.48.0.328711211656.issue36918@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I proposed PR 13955: a fix in 2 lines.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:23:33 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 01:23:33 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560216213.27.0.444528126382.issue37221@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks, Nick for opening this issue. If everyone agrees this is the best path forward I can make a PR. Take into account that doing such rename will break again the projects that have adapted already (primarily only Cython). I would like to give some context around the change itself.

* Last time the function was changed in commit 4f72a78684bbfcdc43ceeabb240ceee54706c4b0 (for adding keyword-only parameters) a wrapper was not created or a new compatibility layer was not created. This happened as well in the past when the function slowly growed from 3 parameters in 1990 to 16 parameters currently. If we decide to provide the wrapper, this would be the first time we do this for changes in this function.

* In the past, backwards incompatible changes that came from syntax changes were reported in the What's New. For example, in Python3.6 we added "async and await names are now reserved keywords. Code using these names as identifiers will now raise a SyntaxError" in the porting session and one could argue that that broke more code than this change. I am not saying this to justify breaking changes, just to give more context of somehow similar situations on how we report changes that we knew that were backwards incompatible due to new features.

* A quick (and I acknowledge that is partial and incomplete) search in GitHub about usages of PyCode_New excluding interpreter files to avoid forks and the like, points mainly at Cython (and Pyrex forks). Cython already adapted to this change, so changing it back will break Cython and all other possible extensions that already adapted after the last alpha.

* In the email thread https://mail.python.org/archives/list/python-dev at python.org/thread/VXDPH2TUAHNPT5K6HBUIV6VASBCKKY2K/, Stefan Behnel (who is also a Cython maintainer) said in relation to adding PyCode_NewEx:

>It's not a commonly used function, and it's easy for C code to adapt. I
>don't think it's worth adding a new function to the C-API here, compared to
>just changing the signature. Very few users would benefit, at the cost of
>added complexity.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:31:37 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 11 Jun 2019 01:31:37 +0000
Subject: [issue37220] test_idle crash on Windows when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560216697.06.0.609107783347.issue37220@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The #37177 patch touched SearchDialogBase.py and test_searchdialogbase.py.  I reproduced a premature stop if the full IDLE suite is run, but don't understand all of the results.

After fresh update and rebuild:
python -m test -ugui test_idle
3.9 runs fine, no noise
2.7 runs fine except for 2 '''can't invoke "event" command:...'''s

python -m test -R3:3 -ugui -m SearchDialogBaseTest test_idle
3.9 runs fine, no noise
2.7 runs fine, no noise (so from other tests)

python -m test -R3:3 -ugui test_idle
3.9 runs fine, but 18 instances of "can't invoke "event" command:..."
# ==> noise from other tests, only with -R
2.7 prints 2 "can'ts" and one "complete a round '.'.  After a pause, presumibly to run round 2, it exits to the Windows prompt.

Commenting out "self.top.transient('')" in close() solves the problem.  There is some interaction between running 2.7 (versus 3.x), tcl/tk 8.5.19 (versus 8.6), testing with -R, running other IDLE test files, and disabling 'transient' (back to default).  (Tal, this sort of thing is part of why I don't backport to 2.7.)

An alternate fix for me is a slight change in the test cleanup.  Preparing PRs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:43:29 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 11 Jun 2019 01:43:29 +0000
Subject: [issue37220] test_idle crash on Windows when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560217409.99.0.399604353822.issue37220@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +13824
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/13957

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:48:04 2019
From: report at bugs.python.org (makdon)
Date: Tue, 11 Jun 2019 01:48:04 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560217684.57.0.00165356779385.issue37216@roundup.psfhosted.org>


makdon <makdon at makdon.me> added the comment:

Thanks xtreak. I am a beginner on python mailing list and now i've learn how to get a link to the email.


And i found a version error on windows installation document on version 3.6.8 that the picture is still using version 3.5:

https://docs.python.org/3.6/using/windows.html#installation-steps

I will check them and create PR for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:48:19 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 01:48:19 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560217699.73.0.491038571097.issue37221@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13825
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13959

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:48:31 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 11 Jun 2019 01:48:31 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560217711.63.0.227784732349.issue33758@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

In particular, test_typing has an unexpected success if you run it after test___all__. It would be nice at least to change the expected fail to a skip, since it's so subtle.

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:48:36 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 11 Jun 2019 01:48:36 +0000
Subject: [issue37220] test_idle crash on Windows when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560217716.34.0.126727928573.issue37220@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
pull_requests: +13826
pull_request: https://github.com/python/cpython/pull/13958

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:49:09 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 01:49:09 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560217749.39.0.537559819183.issue37221@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I have created PR13959 in case we decide to go with the PyCode_NewEx path.

----------
keywords:  -patch
stage: patch review -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:53:32 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Tue, 11 Jun 2019 01:53:32 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1560218012.44.0.118398969054.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

tempfile.TemporaryDirectory() relies upon shutil.rmtree() to do the actual cleanup. Up through 3.7, it simply calls shutil.rmtree(). 3.8 adds some more logic using the onerror callback parameter of shutil.rmtree() to try changing the permissions on otherwise undeletable directory entries. In order to make tempfile.TemporaryDirectory() handle mount points, shutil.rmtree() requires some enhancements so that mount points can be detected before their contents are deleted.

I am working on some generic enhancements to tempfile.TemporaryDirectory() and shutil.rmtree() that add (hopefully) useful functionality that covers mount points as well as other corner cases:

1. Add an "onitem" callback paramter to shutil.rmtree() that, if provided, gets called for each directory entry as it is encountered. This allows the caller to perform any required special handling of individual directory entries (e.g. unmounting a mount point, closing a file, shutting down a named pipe, etc.).

2. Add an "onerror" callback parameter to the tempfile.TemporaryDirectory member functions so that the caller can perform special handling for directory items that it can't automatically delete. The caller created the undeletable directory entries, so it is reasonable to believe the caller may know how to unmake what they made.

3. Add an "onitem" callback parameter to the tempfile.TemporaryDirectory member functions that they pass on to shutil.rmtree().

I debated implementing "ondelete" instead of "onitem". "ondelete" would be called just prior to deleting an item, while "onitem" is called when the item is encountered. The difference in semantics is that a subdirectory entry triggers a call to "onitem" immediately, while "ondelete" would get called after the subdirectory tree had been traversed and all of its items deleted. "onitem" seems more useful because it allows the caller to implement special handling per item.

I will have a pull request ready soon. In the mean time, I am open to any other suggestions for handling non-portable corner cases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:54:27 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 11 Jun 2019 01:54:27 +0000
Subject: [issue35184] Makefile is not correctly generated when compiling
 pyextat with DXML_POOR_ENTROPY=1
In-Reply-To: <1541609240.08.0.788709270274.issue35184@psf.upfronthosting.co.za>
Message-ID: <1560218067.06.0.203658928789.issue35184@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 408a2ef1aceff1f4270c44552fa39ef93d9283e3 by Benjamin Peterson (aaronpaulhurst) in branch 'master':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/408a2ef1aceff1f4270c44552fa39ef93d9283e3


----------
nosy: +benjamin.peterson
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35184>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:54:37 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 01:54:37 +0000
Subject: [issue35184] Makefile is not correctly generated when compiling
 pyextat with DXML_POOR_ENTROPY=1
In-Reply-To: <1541609240.08.0.788709270274.issue35184@psf.upfronthosting.co.za>
Message-ID: <1560218077.63.0.48599562025.issue35184@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13827
pull_request: https://github.com/python/cpython/pull/13960

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35184>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:54:44 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 01:54:44 +0000
Subject: [issue35184] Makefile is not correctly generated when compiling
 pyextat with DXML_POOR_ENTROPY=1
In-Reply-To: <1541609240.08.0.788709270274.issue35184@psf.upfronthosting.co.za>
Message-ID: <1560218084.56.0.331103861816.issue35184@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13828
pull_request: https://github.com/python/cpython/pull/13961

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35184>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:54:51 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 11 Jun 2019 01:54:51 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560218091.58.0.62293184578.issue37220@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords:  -patch
title: test_idle crash on Windows when run with -R: -> test_idle crash on Windows 2.7 when run with -R:
type:  -> crash
versions: +Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Mon Jun 10 21:57:15 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 01:57:15 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560218235.13.0.136387639539.issue37221@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:14:37 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 02:14:37 +0000
Subject: [issue35184] Makefile is not correctly generated when compiling
 pyextat with DXML_POOR_ENTROPY=1
In-Reply-To: <1541609240.08.0.788709270274.issue35184@psf.upfronthosting.co.za>
Message-ID: <1560219277.69.0.437763916722.issue35184@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5b94b857f590db80aab69c31f88dd2a4978f8329 by Miss Islington (bot) in branch '3.8':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/5b94b857f590db80aab69c31f88dd2a4978f8329


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35184>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:15:27 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 02:15:27 +0000
Subject: [issue35184] Makefile is not correctly generated when compiling
 pyextat with DXML_POOR_ENTROPY=1
In-Reply-To: <1541609240.08.0.788709270274.issue35184@psf.upfronthosting.co.za>
Message-ID: <1560219327.55.0.919934799545.issue35184@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 30fd7a476bbd6bb8096c1349698463fa8a3bca18 by Miss Islington (bot) in branch '3.7':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/30fd7a476bbd6bb8096c1349698463fa8a3bca18


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35184>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:30:39 2019
From: report at bugs.python.org (Phillip Middleton)
Date: Tue, 11 Jun 2019 02:30:39 +0000
Subject: [issue34028] Python 3.7.0 wont compile with SSL Support 1.1.0 >
 alledged missing X509_VERIFY_PARAM_set1_host() support
In-Reply-To: <1530609211.5.0.56676864532.issue34028@psf.upfronthosting.co.za>
Message-ID: <1560220239.22.0.705556455612.issue34028@roundup.psfhosted.org>


Phillip Middleton <pmiddlet72 at gmail.com> added the comment:

I have the same issue installing v3.7.3 on RHEL6.8. The standard version came with openssl v1.0.1c, which would not configure. I installed openssl 1.0.2s in /usr/local and created a file /etc/profile.d/openssl.sh adding the following lines: 

# /etc/profile.d/openssl.sh
pathmunge /usr/local/openssl/bin

Exiting and relogging into the shell, the version returns openssl 1.0.2s 28 May 2019. 

As has been mentioned, there is no openssl distro out there that contains the filepath that either configure or make appears to expect. 

To get through configuration, I began with configure, modifying the ssldirs variable to /usr/local/openssl, and also repointing the following to the appropriate subdirs: 

17214     if ! $found; then
17215         OPENSSL_INCLUDES=
17216         for ssldir in $ssldirs; do
17217             { $as_echo "$as_me:${as_lineno-$LINENO}: checking for openssl/ssl.h in $ssldir" >&5
17218 $as_echo_n "checking for openssl/ssl.h in $ssldir... " >&6; }
17219             if test -f "$ssldir/include/openssl/ssl.h"; then
17220                 OPENSSL_INCLUDES="-I$ssldir/include/openssl"
17221                 OPENSSL_LDFLAGS="-L$ssldir/lib"

This apparently wasn't sufficient for configure to recognize this openssl installation. 

Next, I uncommented and modified Modules/Setup.dist to reflect the openssl header and lib paths:
 
211 SSL=/usr/local/openssl
212 _ssl _ssl.c \
213         -DUSE_SSL -I$(SSL)/include -I$(SSL)/include/openssl \
214         -L$(SSL)/lib -lssl -lcrypto

That gets us to here with ./configure:

checking whether compiling and linking against OpenSSL works... yes
checking for X509_VERIFY_PARAM_set1_host in libssl... no
checking for --with-ssl-default-suites... python

However using ./configure -with-openssl=/usr/local/openssl, configure returns:

checking whether compiling and linking against OpenSSL works... yes
checking for X509_VERIFY_PARAM_set1_host in libssl... yes
checking for --with-ssl-default-suites... python

So at least from configure's standpoint, I was able to get configure to pick up the openssl folder and its include/openssl which contains x509_vfy.h. Ok great. 

However make doesn't appear to respect these changes in configure - I get one of the typical variants of: 


*** WARNING: renaming "_hashlib" since importing it failed: libssl.so.1.0.0: cannot open shared object file: No such file or directory

Python build finished successfully!
The necessary bits to build these optional modules were not found:
_lzma                 _tkinter              _uuid
To find the necessary bits, look in setup.py in detect_modules() for the module's name.


The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  atexit                pwd
time


Failed to build these modules:
_ssl


Following modules built successfully but were removed because they could not be imported:
_hashlib


Could not build the ssl module!
Python requires an OpenSSL 1.0.2 or 1.1 compatible libssl with X509_VERIFY_PARAM_set1_host().
LibreSSL 2.6.4 and earlier do not provide the necessary APIs, https://github.com/libressl-portable/portable/issues/381


What I'd like to know is, what is the difference between what configure is looking for and in what cases would make not necessarily respect the confirmations of configure's checks?

Let me know if there are any dumps/logs you'd be interested in. I realize that in my case we're dealing with an older OS, but this issue doesn't seem restricted per se to that alone.

----------
nosy: +Phillip Middleton

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34028>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:40:29 2019
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 11 Jun 2019 02:40:29 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560220829.9.0.562490686436.issue37216@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +13829
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13962

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:46:03 2019
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 11 Jun 2019 02:46:03 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560221163.71.0.391408117756.issue37216@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +13830
pull_request: https://github.com/python/cpython/pull/13963

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 22:50:12 2019
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 11 Jun 2019 02:50:12 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560221412.56.0.291204941876.issue37216@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +13831
pull_request: https://github.com/python/cpython/pull/13964

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Mon Jun 10 23:53:45 2019
From: report at bugs.python.org (Aaron Hurst)
Date: Tue, 11 Jun 2019 03:53:45 +0000
Subject: =?utf-8?q?=5Bissue35586=5D_Open_pyexpat_compilation=2C_Make_shows_error?=
 =?utf-8?b?77yIbWlzc2luZyBzZXBhcmF0b3LvvIk=?=
In-Reply-To: <1545796783.34.0.712150888896.issue35586@roundup.psfhosted.org>
Message-ID: <1560225225.45.0.895791428048.issue35586@roundup.psfhosted.org>


Aaron Hurst <aaronpaulhurst at gmail.com> added the comment:

I believe this bug can be closed now that the following have landed:

New changeset 408a2ef1aceff1f4270c44552fa39ef93d9283e3 by Benjamin Peterson (aaronpaulhurst) in branch 'master':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/408a2ef1aceff1f4270c44552fa39ef93d9283e3

New changeset 5b94b857f590db80aab69c31f88dd2a4978f8329 by Miss Islington (bot) in branch '3.8':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/5b94b857f590db80aab69c31f88dd2a4978f8329

New changeset 30fd7a476bbd6bb8096c1349698463fa8a3bca18 by Miss Islington (bot) in branch '3.7':
closes bpo-35184: Fix XML_POOR_ENTROPY option that breaks makesetup parsing of pyexpat line in Setup. (GH-13064)
https://github.com/python/cpython/commit/30fd7a476bbd6bb8096c1349698463fa8a3bca18

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35586>
_______________________________________

From report at bugs.python.org  Tue Jun 11 00:19:20 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 11 Jun 2019 04:19:20 +0000
Subject: =?utf-8?q?=5Bissue35586=5D_Open_pyexpat_compilation=2C_Make_shows_error?=
 =?utf-8?b?77yIbWlzc2luZyBzZXBhcmF0b3LvvIk=?=
In-Reply-To: <1545796783.34.0.712150888896.issue35586@roundup.psfhosted.org>
Message-ID: <1560226760.69.0.954689258188.issue35586@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> Makefile is not correctly generated when compiling pyextat with DXML_POOR_ENTROPY=1

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35586>
_______________________________________

From report at bugs.python.org  Tue Jun 11 00:55:33 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 11 Jun 2019 04:55:33 +0000
Subject: [issue34886] subprocess.run throws exception when input and stdin are
 passed as kwargs
In-Reply-To: <1538592638.37.0.545547206417.issue34886@psf.upfronthosting.co.za>
Message-ID: <1560228933.83.0.40043685162.issue34886@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

thanks!

----------
assignee:  -> gregory.p.smith
resolution:  -> fixed
stage: patch review -> commit review
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34886>
_______________________________________

From report at bugs.python.org  Tue Jun 11 00:57:58 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 11 Jun 2019 04:57:58 +0000
Subject: [issue19666] Format string for ASCII unicode or bytes-like object as
 readonly buffer
In-Reply-To: <1384971256.72.0.0181602551145.issue19666@psf.upfronthosting.co.za>
Message-ID: <1560229078.03.0.128334727469.issue19666@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

"needs patch" doesn't mean it has been accepted, it's just a common state for issues where nobody has written any code even as a proof of concept.

Christian - is this still desired?

----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19666>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:25:04 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 05:25:04 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560230704.8.0.833813130216.issue37219@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Nice catch.  Thanks.

----------
assignee:  -> rhettinger
priority: normal -> high

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:37:39 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 05:37:39 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560231459.53.0.842153605865.issue37216@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset fe5f8b9ce2e504d4510cc82129d595015d239634 by Ned Deily (Makdon) in branch '3.8':
[3.8] bpo-37216: Fix version and filename in Mac using document (GH-13964)
https://github.com/python/cpython/commit/fe5f8b9ce2e504d4510cc82129d595015d239634


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:38:28 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 05:38:28 +0000
Subject: [issue37216] mac installation document wrong for python 3.7.3
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560231508.95.0.344465691515.issue37216@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset c59b1bbbb37bbfc7eb7a9386bb51c7fea838fc2a by Ned Deily (Makdon) in branch '3.7':
[3.7] bpo-37216: Fix version and filename in Mac using document (GH-13963)
https://github.com/python/cpython/commit/c59b1bbbb37bbfc7eb7a9386bb51c7fea838fc2a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:42:02 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 05:42:02 +0000
Subject: [issue37216] "Using Python on a Macintosh" chapter of "Python Setup
 and Usage" doc is out-of-date
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560231722.24.0.244039568007.issue37216@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
assignee: docs at python -> ned.deily
title: mac installation document wrong for python 3.7.3 -> "Using Python on a Macintosh" chapter of "Python Setup and Usage" doc is out-of-date
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:49:44 2019
From: report at bugs.python.org (Tal Einat)
Date: Tue, 11 Jun 2019 05:49:44 +0000
Subject: [issue37038] Make idlelib/run.py runnable.
In-Reply-To: <1558734979.99.0.70787522165.issue37038@roundup.psfhosted.org>
Message-ID: <1560232184.05.0.486914930459.issue37038@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Terry, I believe this can be closed now that the fix has been merged?

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37038>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:50:18 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 05:50:18 +0000
Subject: [issue28071] Stop set.difference when set is empty
In-Reply-To: <1473546124.61.0.846799872363.issue28071@psf.upfronthosting.co.za>
Message-ID: <1560232218.99.0.672050403855.issue28071@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Behavior change in msg306973 is tracked with issue37219

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28071>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:52:48 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 11 Jun 2019 05:52:48 +0000
Subject: [issue37217] SSL socket segfaults during a connect() using a punycode
 domain containg a umlaut
In-Reply-To: <1560197039.5.0.767955558559.issue37217@roundup.psfhosted.org>
Message-ID: <1560232368.96.0.582187423237.issue37217@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

FWIW, I could reproduce this on early 3.5 versions but it appears to have been fixed between 3.5.3 and 3.5.4.

I'm leaving this open in case anyone can tie it back to a particular change.

----------
components: +Extension Modules -ctypes
nosy: +gregory.p.smith
stage:  -> resolved
type:  -> crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37217>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:52:59 2019
From: report at bugs.python.org (Tal Einat)
Date: Tue, 11 Jun 2019 05:52:59 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560232379.26.0.423000560768.issue37220@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Terry, we can also just revert the fix on the 2.7 branch, it's not crucial.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:54:03 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 11 Jun 2019 05:54:03 +0000
Subject: [issue37038] Make idlelib/run.py runnable.
In-Reply-To: <1558734979.99.0.70787522165.issue37038@roundup.psfhosted.org>
Message-ID: <1560232443.32.0.247840840657.issue37038@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Yes, thank you.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37038>
_______________________________________

From report at bugs.python.org  Tue Jun 11 01:59:56 2019
From: report at bugs.python.org (Tal Einat)
Date: Tue, 11 Jun 2019 05:59:56 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560232796.42.0.234248589433.issue37220@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Now that I've looked at the PR, it should likely be merged for all relevant branches to make the test more robust.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:13:36 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 06:13:36 +0000
Subject: [issue37217] SSL socket segfaults during a connect() using a punycode
 domain containg a umlaut
In-Reply-To: <1560197039.5.0.767955558559.issue37217@roundup.psfhosted.org>
Message-ID: <1560233616.45.0.844292650144.issue37217@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I couldn't get an ssl build with 3.5.4 to verify this but looking at changelog between 3.5.3 and 3.5.4 issue30594 might have fixed it since it reports a similar segfault.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37217>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:25:08 2019
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 11 Jun 2019 06:25:08 +0000
Subject: [issue37217] SSL socket segfaults during a connect() using a punycode
 domain containg a umlaut
In-Reply-To: <1560197039.5.0.767955558559.issue37217@roundup.psfhosted.org>
Message-ID: <1560234308.85.0.291444041621.issue37217@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Yes, this looks like a duplicate of issue30594. kmille, please contact Ubuntu and ask them to apply the fix to 16.04.

By the way, your hostname is not correct. "xn--b" is an invalid punycode. The correct IDNA encoding for the domain looks like this:

>>> "www.buchhandlunggr?nden.de".encode('idna')
b'www.xn--buchhandlunggrnden-z6b.de'

----------
nosy: +christian.heimes
resolution:  -> out of date
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37217>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:25:50 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 11 Jun 2019 06:25:50 +0000
Subject: [issue37217] SSL socket segfaults during a connect() using a punycode
 domain containg a umlaut
In-Reply-To: <1560197039.5.0.767955558559.issue37217@roundup.psfhosted.org>
Message-ID: <1560234350.1.0.129681527303.issue37217@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

oh that is likely it, the stacktrace i got in a pydebug build was a gc time refcount != 0 assertion.

----------
superseder:  -> Refcounting mistake in _ssl.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37217>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:27:59 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 06:27:59 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560234479.01.0.418465220668.issue37219@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
keywords: +patch
pull_requests: +13832
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13965

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:30:02 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Tue, 11 Jun 2019 06:30:02 +0000
Subject: [issue37129] Add os.RWF_APPEND flag for os.pwritev
In-Reply-To: <1559933925.78.0.510794410466.issue37129@roundup.psfhosted.org>
Message-ID: <1560234602.64.0.0483617895738.issue37129@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

This is just adding a missing constant (when defined at CPython compile time) to the os module.  I suggest landing this in 3.8 as well assuming we're still in the beta cycles when the PR is ready.  It isn't a functional change.

----------
nosy: +gregory.p.smith
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37129>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:33:06 2019
From: report at bugs.python.org (alter-bug-tracer)
Date: Tue, 11 Jun 2019 06:33:06 +0000
Subject: [issue36993] zipfile: tuple IndexError on extract
In-Reply-To: <1558441969.28.0.928640082083.issue36993@roundup.psfhosted.org>
Message-ID: <1560234786.35.0.58170186892.issue36993@roundup.psfhosted.org>


alter-bug-tracer <emanuel.vintila at abugtracer.ro> added the comment:

@berker.peksag, first of all sorry for the late reply. 
We are not sure that we know how to do that. Our tests are generated automatically. What we can do is retest the lib with your temporary fixes in place, to see if they fix all the problems our software can detect. Would that help you?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36993>
_______________________________________

From report at bugs.python.org  Tue Jun 11 02:51:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 06:51:24 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560235884.59.0.0885260520962.issue37221@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 03:11:42 2019
From: report at bugs.python.org (Hong Xu)
Date: Tue, 11 Jun 2019 07:11:42 +0000
Subject: [issue37225] Signatures of Exceptions not documented
Message-ID: <1560237102.52.0.133464005619.issue37225@roundup.psfhosted.org>


New submission from Hong Xu <hong at topbug.net>:

The "Builtin Exceptions" page does not document the constructors of the listed exception classes. All it says is

> The tuple of arguments given to the exception constructor. Some built-in exceptions (like OSError) expect a certain number of arguments and assign a special meaning to the elements of this tuple, while others are usually called only with a single string giving an error message.

This is quite vague and does not really guide users for individual exception classes.

----------
assignee: docs at python
components: Documentation
messages: 345195
nosy: Hong Xu, docs at python
priority: normal
severity: normal
status: open
title: Signatures of Exceptions not documented
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37225>
_______________________________________

From report at bugs.python.org  Tue Jun 11 03:17:40 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 11 Jun 2019 07:17:40 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560237460.33.0.264252711995.issue37221@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Seems it was changed last time many years ago and was stable in Python 3.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 03:24:02 2019
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 11 Jun 2019 07:24:02 +0000
Subject: [issue37216] "Using Python on a Macintosh" chapter of "Python Setup
 and Usage" doc is out-of-date
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560237842.43.0.575712017434.issue37216@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +13833
pull_request: https://github.com/python/cpython/pull/13966

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Tue Jun 11 03:31:54 2019
From: report at bugs.python.org (Alex Willmer)
Date: Tue, 11 Jun 2019 07:31:54 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560238314.91.0.848193222462.issue37210@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

I don't think I can do this. My WIP code is in https://github.com/moreati/cpython/pull/new/bpo-37210, and associated make test output is attached.

Principal blockers

-  `_pickle.PickleBuffer.raw()` can return a contiguous buffer from either a c_contiguous, or f_contiguous buffer. memoryview() (and hence pickle._PickleBuffer.raw()) requires a c_contiguous buffer.
- I'm unsure how to allow _PickleBuffer -> bytearray conversion

The most common cause of test failures is `TypeError: cannot pickle 'memoryview' object`. I guess Python is seeing a lack of __reduce__(), and failing back to walking the object attributes. Implementing __reduce__() and or __reduce_ex__() might fix this, but seems moot given the other blockers.

----------
Added file: https://bugs.python.org/file48410/bp0-37201_make_test_20190610.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:07:56 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Tue, 11 Jun 2019 08:07:56 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560240476.97.0.306909532004.issue37210@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Right, it is probably not possible to write a pure Python PickleBuffer. There's a reason it's written in C...

When you said "make PickleBuffer an optional dependency", I thought you intended to have a usable pure Python Pickler, but without support for the PickleBuffer class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:16:06 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 08:16:06 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560240966.06.0.916425773975.issue37219@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 1f11cf9521114447b3e32e2ac88f075ffaa37555 by Raymond Hettinger in branch 'master':
bpo-37219: Remove erroneous optimization for differencing an empty set (GH-13965)
https://github.com/python/cpython/commit/1f11cf9521114447b3e32e2ac88f075ffaa37555


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:19:30 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 08:19:30 +0000
Subject: [issue37222] urllib missing voidresp breaks CacheFTPHandler
In-Reply-To: <1560209901.95.0.0637922149523.issue37222@roundup.psfhosted.org>
Message-ID: <1560241170.98.0.0709812201641.issue37222@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +giampaolo.rodola, orsenthil

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37222>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:24:08 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 08:24:08 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560241448.8.0.835764193975.issue37219@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13834
pull_request: https://github.com/python/cpython/pull/13967

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:40:43 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 08:40:43 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560242443.92.0.236059899065.issue37219@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +13835
pull_request: https://github.com/python/cpython/pull/13968

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:41:30 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 08:41:30 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560242490.84.0.27374909301.issue37219@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 583ff84351e528976aa93d383e5a81aee9f3bac3 by Raymond Hettinger (Miss Islington (bot)) in branch '3.8':
bpo-37219: Remove erroneous optimization for differencing an empty set (GH-13965) (GH-13967)
https://github.com/python/cpython/commit/583ff84351e528976aa93d383e5a81aee9f3bac3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:44:59 2019
From: report at bugs.python.org (Ben Brown)
Date: Tue, 11 Jun 2019 08:44:59 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
Message-ID: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>


New submission from Ben Brown <ben.brown at envisionvirginracing.com>:

I have been getting an intermittent errors when using asyncio with SSL. The error always occurs in the _process_write_backlog method in asyncio's sslproto.py file. I have looked at lots of possibilities as to what the cause is and found that for some reason when in _process_write_backlog's loop the deque seems to be empty, I added some quick terrible hacky code to confirm it fixed the issue and checking at each point it is used wether it is empty fixes the issue, I am unusure as to what causes it to become empty but still run through the loop. The most frequent time it happens is after we have a successful message the client sends a request to join a data stream this request mostly causes the error but sometimes it happens while the client is receiving data. I am currently using python 3.7.1 but have also tested my code on 3.7.3 with the same result. 

NOTE: I am currently working on a minimal sample to show the issue easier.

Fatal error on SSL transport
protocol: <asyncio.sslproto.SSLProtocol object at 0x7f267462e780>
transport: <_SelectorSocketTransport fd=38 read=polling write=<idle, bufsize=0>>
Traceback (most recent call last):
    File "/usr/local/lib/python3.7/asyncio/sslproto.py", line 689, in _process_write_backlog
    del self._write_backlog[0]
IndexError: deque index out of range

Fatal error on SSL transport
protocol: <asyncio.sslproto.SSLProtocol object at 0x7f45f802ec88>
transport: <_SelectorSocketTransport fd=29 read=polling write=<idle, bufsize=0>>
Traceback (most recent call last):
    File "/usr/local/lib/python3.7/asyncio/sslproto.py", line 664, in _process_write_backlog
    data, offset = self._write_backlog[0]
IndexError: deque index out of range

----------
assignee: christian.heimes
components: SSL
messages: 345201
nosy: ben.brown, christian.heimes
priority: normal
severity: normal
status: open
title: Asyncio Fatal Error on SSL Transport - IndexError Deque Index Out Of Range
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:47:56 2019
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 11 Jun 2019 08:47:56 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560242876.2.0.537289091044.issue37226@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

This looks more like an asyncio problem than an SSL problem. Andrew, Yury,  please take a look.

----------
components: +asyncio
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:53:06 2019
From: report at bugs.python.org (chr0139)
Date: Tue, 11 Jun 2019 08:53:06 +0000
Subject: [issue37227] Wrong parse long argument
Message-ID: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>


New submission from chr0139 <marek.chrastina at vsb.cz>:

I have this script

import argparse
parser = argparse.ArgumentParser()
group = parser.add_mutually_exclusive_group()
group.add_argument('-l', '--list', action='store_true', help="show help")
group.add_argument('-u', '--upgrade', action='store_true', help="show help")
parser.parse_args(['--li'])

and this is the unexpected result:

Namespace(list=True, upgrade=False)

----------
components: Library (Lib)
messages: 345203
nosy: chr0139
priority: normal
severity: normal
status: open
title: Wrong parse long argument
type: behavior
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 04:57:39 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 11 Jun 2019 08:57:39 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560243459.93.0.838367573276.issue37227@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

And what is your expected result, and why?

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:01:27 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 09:01:27 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560243687.22.0.0995248748988.issue37219@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 1b615b2f035d207941e44259a92ed0bdcc56ac45 by Raymond Hettinger in branch '3.7':
[3.7] bpo-37219: Remove erroneous optimization for differencing an empty set (GH-13965) (GH-13968)
https://github.com/python/cpython/commit/1b615b2f035d207941e44259a92ed0bdcc56ac45


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:01:44 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 09:01:44 +0000
Subject: [issue37219] empty set difference does not check types of values
In-Reply-To: <1560204096.52.0.24651391919.issue37219@roundup.psfhosted.org>
Message-ID: <1560243704.05.0.221177170529.issue37219@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:08:41 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 09:08:41 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560244121.91.0.259226026533.issue37227@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:16:12 2019
From: report at bugs.python.org (chr0139)
Date: Tue, 11 Jun 2019 09:16:12 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560244572.54.0.617425705437.issue37227@roundup.psfhosted.org>


chr0139 <marek.chrastina at vsb.cz> added the comment:

I think --li is not the same argument as --list

So I expect that

parser.parse_args(['-l']) or parser.parse_args(['--list'])

should be only two options which should leads to the result

Namespace(list=True, upgrade=False)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:18:48 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 09:18:48 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560244728.28.0.124223992293.issue37227@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

argparse allows abbreviations by default so --li matches --list as a prefix match. This is documented at https://docs.python.org/2.7/library/argparse.html#argument-abbreviations-prefix-matching

>From python 3.5 allow_abbrev=False can be passed to ArgumentParser to disable this. See also issue10981 and issue14910 that implemented this. https://docs.python.org/3/library/argparse.html#argument-abbreviations-prefix-matching.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:26:10 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 11 Jun 2019 09:26:10 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560245170.17.0.820326282692.issue37227@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Although note that with allow_abbrev=False, -l will conflict with --long, which I'm not sure is a great design.

I'm closing this as not a bug, since it works as documented and there's a workaround (albeit not in 2.7, which is closed to new features).

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:36:54 2019
From: report at bugs.python.org (=?utf-8?q?Jukka_V=C3=A4is=C3=A4nen?=)
Date: Tue, 11 Jun 2019 09:36:54 +0000
Subject: [issue37228] UDP sockets created by create_datagram_endpoint() allow
 by default multiple processes to bind the same port
Message-ID: <1560245814.37.0.496048869185.issue37228@roundup.psfhosted.org>


New submission from Jukka V?is?nen <vaizki at vaizki.fi>:

When using loop.create_datagram_endpoint(), the default for reuse_address=True, which sets the SO_REUSEADDR sockopt for the UDP socket. 

This is a dangerous and unreasonable default for UDP, because in Linux it allows multiple processes to create listening sockets for the same UDP port and the kernel will randomly give incoming packets to these processes.

I discovered this by accidentally starting two Python asyncio programs with the same UDP port and instead of getting an exception that the address is already in use, everything looked to be working except half my packets went to the wrong process.

The documentation also refers to behavior with TCP sockets:
https://docs.python.org/3/library/asyncio-eventloop.html#asyncio.loop.create_datagram_endpoint

"reuse_address tells the kernel to reuse a local socket in TIME_WAIT state, without waiting for its natural timeout to expire. If not specified will automatically be set to True on Unix."

This is true for TCP but not UDP.

Either the documentation should reflect the current (dangerous) behavior or the behavior should be changed for UDP sockets. 

Workaround is of course to create your own socket without SO_REUSEADDR and pass it to create_datagram_endpoint().

----------
components: asyncio
messages: 345209
nosy: Jukka V?is?nen, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: UDP sockets created by create_datagram_endpoint() allow by default  multiple processes to bind the same port
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37228>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:39:30 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 09:39:30 +0000
Subject: [issue37228] UDP sockets created by create_datagram_endpoint() allow
 by default multiple processes to bind the same port
In-Reply-To: <1560245814.37.0.496048869185.issue37228@roundup.psfhosted.org>
Message-ID: <1560245970.44.0.663582961296.issue37228@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

There is no chance to change the flag for 3.7.
But we can consider it for 3.8

Yuri, what do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37228>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:41:20 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 09:41:20 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560246080.2.0.126901665988.issue37226@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Just to clarify: what OpenSSL version is used?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 05:43:20 2019
From: report at bugs.python.org (Ben Brown)
Date: Tue, 11 Jun 2019 09:43:20 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560246200.94.0.44041858814.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

The OpenSSL version is OpenSSL 1.1.0j  20 Nov 2018

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:00:13 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 10:00:13 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560247213.46.0.638812769825.issue37226@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

That's what I afraid.
asyncio/sslproto.py fails on new OpenSSL at several places :(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:08:56 2019
From: report at bugs.python.org (Ben Brown)
Date: Tue, 11 Jun 2019 10:08:56 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560247736.52.0.501941082072.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

That's a shame, which version should it work on I don't mind downgrading for now to fix the issue as a workaround.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:09:28 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 10:09:28 +0000
Subject: [issue34467] No mechanism to abort created coroutine or suppress
 not-awaited warning
In-Reply-To: <1534975363.12.0.56676864532.issue34467@psf.upfronthosting.co.za>
Message-ID: <1560247768.39.0.678376281976.issue34467@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34467>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:09:56 2019
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 11 Jun 2019 10:09:56 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560247796.97.0.796500029244.issue37226@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Is 1.1.0 also a problem? I have only seen issue with 1.1.1 and TLS 1.3.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:14:31 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 10:14:31 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560248071.96.0.318309186494.issue37213@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13836
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13969

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:36:53 2019
From: report at bugs.python.org (G)
Date: Tue, 11 Jun 2019 10:36:53 +0000
Subject: [issue37229] bisect: Allow a custom compare function
Message-ID: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>


New submission from G <gpery at protonmail.com>:

All of bisect's functions (insort_{left,right}, bisect_{left,right}) can only use comparison of objects via __lt__.
They should support providing a custom comparison function.

----------
components: Library (Lib)
messages: 345216
nosy: gpery
priority: normal
severity: normal
status: open
title: bisect: Allow a custom compare function
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:41:14 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 10:41:14 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560249674.4.0.6627873272.issue37229@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:43:04 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 10:43:04 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560249784.85.0.600481878357.issue37229@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

See also issue1451588. issue4356 for more discussion that also proposes to add key parameter.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:45:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 10:45:39 +0000
Subject: [issue36742] CVE-2019-10160: urlsplit NFKD normalization
 vulnerability in user:password@
In-Reply-To: <1556368216.92.0.317568776121.issue36742@roundup.psfhosted.org>
Message-ID: <1560249939.31.0.73717562971.issue36742@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 2b578479b96aa3deeeb8bac313a02b5cf3cb1aff by Victor Stinner in branch '2.7':
[2.7] bpo-36742: Fix urlparse.urlsplit() error message for Unicode URL (GH-13937)
https://github.com/python/cpython/commit/2b578479b96aa3deeeb8bac313a02b5cf3cb1aff


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36742>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:48:29 2019
From: report at bugs.python.org (G)
Date: Tue, 11 Jun 2019 10:48:29 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560250109.18.0.380687148185.issue37229@roundup.psfhosted.org>


Change by G <gpery at protonmail.com>:


----------
keywords: +patch
pull_requests: +13837
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13970

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:54:31 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 10:54:31 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560250471.99.0.534272163274.issue36607@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +13838
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13971

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:55:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 10:55:23 +0000
Subject: [issue37224] test__xxsubinterpreters failed on AMD64 Windows8.1
 Refleaks 3.8
In-Reply-To: <1560214681.61.0.906498246375.issue37224@roundup.psfhosted.org>
Message-ID: <1560250523.15.0.99661017459.issue37224@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Fail on x86 Gentoo Refleaks 3.x:
https://buildbot.python.org/all/#/builders/1/builds/618

3:15:59 load avg: 6.93 [339/423/1] test__xxsubinterpreters failed -- running: test_multiprocessing_spawn (19 min 36 sec)
beginning 6 repetitions
123456
.Exception in thread Thread-17:
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/threading.py", line 923, in _bootstrap_inner
    self.run()
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test__xxsubinterpreters.py", line 51, in run
    interpreters.run_string(interp, dedent(f"""
RuntimeError: unrecognized interpreter ID 108
test test__xxsubinterpreters failed -- Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test__xxsubinterpreters.py", line 765, in test_still_running
    interpreters.destroy(interp)
AssertionError: RuntimeError not raised

(...)

test_after_destroying (test.test__xxsubinterpreters.ListAllTests) ... ok
test_initial (test.test__xxsubinterpreters.ListAllTests) ... ok
test_SystemExit (test.test__xxsubinterpreters.RunStringTests) ... ok
test_already_running (test.test__xxsubinterpreters.RunStringTests) ... spam
Exception in thread Thread-31:
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/threading.py", line 923, in _bootstrap_inner
    self.run()
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test__xxsubinterpreters.py", line 51, in run
    interpreters.run_string(interp, dedent(f"""
RuntimeError: unrecognized interpreter ID 190
FAIL
test_bad_id (test.test__xxsubinterpreters.RunStringTests) ... ok
test_bad_script (test.test__xxsubinterpreters.RunStringTests) ... ok
test_bytes_for_script (test.test__xxsubinterpreters.RunStringTests) ... ok
test_create_thread (test.test__xxsubinterpreters.RunStringTests) ... ok
test_does_not_exist (test.test__xxsubinterpreters.RunStringTests) ... ok
test_error_id (test.test__xxsubinterpreters.RunStringTests) ... ok
test_execution_namespace_is_main (test.test__xxsubinterpreters.RunStringTests) ... ok
test_failure (test.test__xxsubinterpreters.RunStringTests) ... ok
test_fork (test.test__xxsubinterpreters.RunStringTests) ... ok
test_in_thread (test.test__xxsubinterpreters.RunStringTests) ... ok
test_invalid_syntax (test.test__xxsubinterpreters.RunStringTests) ... ok
test_main_reused (test.test__xxsubinterpreters.RunStringTests) ... ok
test_shared_overwrites (test.test__xxsubinterpreters.RunStringTests) ... ok
test_shared_overwrites_default_vars (test.test__xxsubinterpreters.RunStringTests) ... ok
test_still_running_at_exit (test.test__xxsubinterpreters.RunStringTests) ... skipped 'blocking forever'
test_success (test.test__xxsubinterpreters.RunStringTests) ... ok
test_sys_exit (test.test__xxsubinterpreters.RunStringTests) ... ok
test_with_shared (test.test__xxsubinterpreters.RunStringTests) ... ok
test_bytes (test.test__xxsubinterpreters.ShareableTypeTests) ... ok
test_int (test.test__xxsubinterpreters.ShareableTypeTests) ... ok
test_non_shareable_int (test.test__xxsubinterpreters.ShareableTypeTests) ... ok
test_singletons (test.test__xxsubinterpreters.ShareableTypeTests) ... ok
test_types (test.test__xxsubinterpreters.ShareableTypeTests) ... ok

======================================================================
FAIL: test_already_running (test.test__xxsubinterpreters.RunStringTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.refleak/build/Lib/test/test__xxsubinterpreters.py", line 855, in test_already_running
    interpreters.run_string(self.id, 'print("spam")')
AssertionError: RuntimeError not raised

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37224>
_______________________________________

From report at bugs.python.org  Tue Jun 11 06:56:12 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 10:56:12 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560250572.1.0.67879942521.issue36607@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:02:14 2019
From: report at bugs.python.org (G)
Date: Tue, 11 Jun 2019 11:02:14 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1560250934.0.0.432721759629.issue4356@roundup.psfhosted.org>


G <gpery at protonmail.com> added the comment:

I opened a relevant PR, https://github.com/python/cpython/pull/11781.

I believe a key parameter is inferior to a comparison callback. The former is a specific case of the latter, and in my use case would force me to create another class to serve as a comparator for my objects, at which point I might as well wrap them and add __lt__.

Furthermore, I believe this is more in-line with similar standard functions in other languages such as C++ (std::sort), Java (PriorityQueue) or Rust (slice.sort_by).

----------
nosy: +gpery

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:11:38 2019
From: report at bugs.python.org (David Jones)
Date: Tue, 11 Jun 2019 11:11:38 +0000
Subject: [issue36853] inconsistencies in docs builds (Sphinx 2)
In-Reply-To: <1557331408.26.0.606381835406.issue36853@roundup.psfhosted.org>
Message-ID: <1560251498.23.0.646769341033.issue36853@roundup.psfhosted.org>


David Jones <drj at pobox.com> added the comment:

I believe the issue is only triggered if you actually have some suspicious markup in your documentation (which is why your plain build on Sphinx 2 appears to work).

Remove some lines from Doc/tools/susp-ignored.csv to trigger it.

----------
nosy: +drj

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36853>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:22:44 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 11 Jun 2019 11:22:44 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560252164.04.0.609688473828.issue33758@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

Likely, the unexpected success can be avoided with clearing generic caches in test___all__ (it just imports whatever it can find and likely also test/mod_generics_cache.py), but I am also fine with just skipping it for now. Will you have time to make a PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:22:52 2019
From: report at bugs.python.org (Ben Brown)
Date: Tue, 11 Jun 2019 11:22:52 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560252172.16.0.80644367062.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

I am using the version I mentioned above 1.1.0 and TLS 1.2, I am sorry I can't be of more help.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:25:36 2019
From: report at bugs.python.org (pallavi shete)
Date: Tue, 11 Jun 2019 11:25:36 +0000
Subject: [issue37230] Why Highly Skilled Network Engineers prefer On-Demand
 work?
Message-ID: <1560252336.74.0.292651844665.issue37230@roundup.psfhosted.org>


New submission from pallavi shete <bochemanisha at gmail.com>:

What Is On-Demand Work?
The on-demand workforce describes a shift towards an open talent economy. Rather than working as a traditional employee, skilled workers can take on contracted projects. They could be temporary jobs or ongoing agreements.

While the idea of contracting is nothing new, this is a new(ish) approach. Contractors find their projects on a marketplace, like FieldEngineer, to make landing work easier than ever. This ensures that their work is as secure as traditional employment.
https://www.fieldengineer.com/blogs/network-engineers-prefer-on-demand-work

----------
components: Windows
messages: 345224
nosy: pallavishete, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Why Highly Skilled Network Engineers prefer On-Demand work?
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37230>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:27:16 2019
From: report at bugs.python.org (pallavi shete)
Date: Tue, 11 Jun 2019 11:27:16 +0000
Subject: [issue37230] Why Highly Skilled Network Engineers prefer On-Demand
 work?
In-Reply-To: <1560252336.74.0.292651844665.issue37230@roundup.psfhosted.org>
Message-ID: <1560252436.92.0.112037297405.issue37230@roundup.psfhosted.org>


pallavi shete <bochemanisha at gmail.com> added the comment:

hat Is On-Demand Work?
The on-demand workforce describes a shift towards an open talent economy. Rather than working as a traditional employee, skilled workers can take on contracted projects. They could be temporary jobs or ongoing agreements.

While the idea of contracting is nothing new, this is a new(ish) approach. Contractors find their projects on a marketplace, like FieldEngineer, to make landing work easier than ever. This ensures that their work is as secure as traditional employment.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37230>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:29:15 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 11:29:15 +0000
Subject: [issue37230] spam
In-Reply-To: <1560252336.74.0.292651844665.issue37230@roundup.psfhosted.org>
Message-ID: <1560252555.33.0.843576808461.issue37230@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
title: Why Highly Skilled Network Engineers prefer On-Demand work? -> spam

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37230>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:30:16 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 11 Jun 2019 11:30:16 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560252616.88.0.87893058923.issue28869@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

I think we can proceed with option A, but only if doesn't cause visible slow-down for creating ABCs (which is already slower that normal classes). TBH, I don't want to document A as "official" recipe (maybe however mention the problem in the `pickle` module docs).

Note that other "class factories" in stdlib (like collections.namedtuple) do almost exactly option A.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:54:42 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 11 Jun 2019 11:54:42 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1560254082.52.0.2106302475.issue4356@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> I opened a relevant PR, https://github.com/python/cpython/pull/11781.

Did you mean https://github.com/python/cpython/pull/13970 ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:56:22 2019
From: report at bugs.python.org (G)
Date: Tue, 11 Jun 2019 11:56:22 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1560254182.18.0.546433720334.issue4356@roundup.psfhosted.org>


G <gpery at protonmail.com> added the comment:

I did, thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Jun 11 07:58:07 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 11 Jun 2019 11:58:07 +0000
Subject: [issue13889] str(float) and round(float) issues with FPU precision
In-Reply-To: <1327676303.66.0.487112802864.issue13889@psf.upfronthosting.co.za>
Message-ID: <1560254287.23.0.550529008228.issue13889@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
pull_requests:  -13812

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13889>
_______________________________________

From report at bugs.python.org  Tue Jun 11 08:08:01 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 12:08:01 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560254881.84.0.353477211418.issue37221@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Take into account that doing such rename will break again the projects that have adapted already (primarily only Cython).

+1. You already broke backwards compatibility once in beta1, no need to do it again in beta2.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 08:21:05 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 12:21:05 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560255665.79.0.992766736775.issue37151@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13839
pull_request: https://github.com/python/cpython/pull/13972

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun 11 08:27:50 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 12:27:50 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560256070.05.0.71359740003.issue37221@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> You already broke backwards compatibility once in beta1

There is one other thing to consider, that is projects with pinned dependencies will have to upgrade to the last Cython and update their generated sources if we don't do the renaming. I don't know how often this happens (for example, Python3.7 changed the result of PyUnicode_AsUTF8AndSize() and PyUnicode_AsUTF8() to type const char * rather of char * and that is backward incompatible if you compile with a C++ compiler or with -Werror) but certainly is worth to consider.

Also, take into account that beta period is precisely the moment to fix these kinds of problems (although I apologize for any inconvenience this may have caused).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 08:29:53 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Tue, 11 Jun 2019 12:29:53 +0000
Subject: [issue37215] Build with dtrace is broken on some systems
In-Reply-To: <1560172974.02.0.554258836838.issue37215@roundup.psfhosted.org>
Message-ID: <1560256193.59.0.621058596085.issue37215@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37215>
_______________________________________

From report at bugs.python.org  Tue Jun 11 09:07:40 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 13:07:40 +0000
Subject: [issue37231] Optimize calling special methods
Message-ID: <1560258460.83.0.570346812053.issue37231@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

Change call_method() and related functions in Objects/typeobject.c to allow profiting from the PY_VECTORCALL_ARGUMENTS_OFFSET optimization: instead of passing "self" as separate argument, put it inside the args vector.

----------
components: Interpreter Core
messages: 345231
nosy: jdemeyer
priority: normal
severity: normal
status: open
title: Optimize calling special methods
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37231>
_______________________________________

From report at bugs.python.org  Tue Jun 11 09:10:04 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Tue, 11 Jun 2019 13:10:04 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
Message-ID: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>


New submission from Jakub Kulik <kulikjak at gmail.com>:

When building and installing Python 3.8 on our sparc machine, the build breaks during the compileall stage with [Error 24] Too many open files. The problem is due to the recently enabled parallel compilation (issue36786).

When -j0 is passed to the compileall, executor starts as many threads as there are cpus, which is problem on our sparc machine with 512 CPUs and rather low ulimit on number of opened files. Compilation fails and is not able to recover from that. For the same reason, test_compileall also breaks and never ends.

I am able to fix both of these by patching both Makefile.pre.in and test_compileall.py with -j32 (instead of -j0), but that is not the best solution.

I think that the best solution to this would be to make compileall.py check for this limit and consider that when creating ProcessPoolExecutor (or, maybe even better, to make it recover when this problem occurs).

----------
components: Build
messages: 345232
nosy: kulikjak
priority: normal
severity: normal
status: open
title: Parallel compilation fails because of low ulimit.
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:06:47 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 14:06:47 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
In-Reply-To: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>
Message-ID: <1560262007.61.0.461106111622.issue37232@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:07:54 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Tue, 11 Jun 2019 14:07:54 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
In-Reply-To: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>
Message-ID: <1560262074.14.0.761641330842.issue37232@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Can't you just up the ulimit? What the current ulimit for your user?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:09:36 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 14:09:36 +0000
Subject: [issue37230] spam
In-Reply-To: <1560252436.92.0.112037297405.issue37230@roundup.psfhosted.org>
Message-ID: <1560262176.39.0.940242229905.issue37230@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
Removed message: https://bugs.python.org/msg345224

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37230>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:09:44 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 11 Jun 2019 14:09:44 +0000
Subject: [issue37230] spam
Message-ID: <1560262184.02.0.842703349678.issue37230@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
Removed message: https://bugs.python.org/msg345225

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37230>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:37:15 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 14:37:15 +0000
Subject: [issue37231] Optimize calling special methods
In-Reply-To: <1560258460.83.0.570346812053.issue37231@roundup.psfhosted.org>
Message-ID: <1560263835.84.0.818807731016.issue37231@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13840
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13973

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37231>
_______________________________________

From report at bugs.python.org  Tue Jun 11 10:43:31 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 14:43:31 +0000
Subject: [issue37233] Use _PY_FASTCALL_SMALL_STACK for method_vectorcall
Message-ID: <1560264211.71.0.0575753966343.issue37233@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

The PEP 590 implementation for type "method" caused a minor regression: instead of using _PyObject_Call_Prepend(), method_vectorcall manually allocates and fills a newly allocated vector. This does NOT use the  _PY_FASTCALL_SMALL_STACK optimization, but it should.

----------
components: Interpreter Core
messages: 345234
nosy: jdemeyer
priority: normal
severity: normal
status: open
title: Use _PY_FASTCALL_SMALL_STACK for method_vectorcall
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37233>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:16:43 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 11 Jun 2019 15:16:43 +0000
Subject: [issue37233] Use _PY_FASTCALL_SMALL_STACK for method_vectorcall
In-Reply-To: <1560264211.71.0.0575753966343.issue37233@roundup.psfhosted.org>
Message-ID: <1560266203.33.0.729866138841.issue37233@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13841
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13974

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37233>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:18:44 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 15:18:44 +0000
Subject: [issue4356] Add "key" argument to "bisect" module functions
In-Reply-To: <1227115048.67.0.318831592843.issue4356@psf.upfronthosting.co.za>
Message-ID: <1560266324.9.0.507398922402.issue4356@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4356>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:18:47 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Tue, 11 Jun 2019 15:18:47 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
In-Reply-To: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>
Message-ID: <1560266327.63.0.72171151376.issue37232@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

We have a limit of 256 opened files, which is not much, but I can up it and then it doesn't happen.

Mainly, I wanted to report that this might be happening now. But I guess not many people will face this problem.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:20:23 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Tue, 11 Jun 2019 15:20:23 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
In-Reply-To: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>
Message-ID: <1560266423.26.0.678890823117.issue37232@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

I guess you'd get a similar problem if you were compiling on all cores simultaneously?  256 simultaneous open files is very low.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:21:12 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 15:21:12 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560266472.93.0.207560289624.issue37229@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> rhettinger
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:24:16 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Tue, 11 Jun 2019 15:24:16 +0000
Subject: [issue37232] Parallel compilation fails because of low ulimit.
In-Reply-To: <1560258604.43.0.910483303566.issue37232@roundup.psfhosted.org>
Message-ID: <1560266656.3.0.800405579797.issue37232@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

I am not sure what you are asking now. compileall with -j0 does compile on all cores simultaneously right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37232>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:26:26 2019
From: report at bugs.python.org (Mahdi Jafary)
Date: Tue, 11 Jun 2019 15:26:26 +0000
Subject: [issue37234] error in variable
Message-ID: <1560266786.16.0.932165098203.issue37234@roundup.psfhosted.org>


New submission from Mahdi Jafary <mahdi.ueserpro at gmail.com>:

this code is ok
def test(t):
	n = 0
	def f(t):
		print(t+str(N))
	f(t)	
test('test')
but this code have error

def test(t):
	n = 0
	def f(t):
		n = n+1
		print(t+str(n))
	f(t)	
test('test')	

we can fix this by edit code to:

def test(t):
	n = 0
	def f(t):
		N = n+1
		print(t+str(N))
	f(t)	
test('test')

----------
components: Windows
messages: 345238
nosy: Mahdi Jafary, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: error in variable
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37234>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:27:35 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 15:27:35 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560266855.25.0.870991659477.issue36607@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 65aa64fae89a24491aae84ba0329eb8f3c68c389 by Miss Islington (bot) (Andrew Svetlov) in branch 'master':
bpo-36607: Eliminate RuntimeError raised by asyncio.all_tasks() (GH-13971)
https://github.com/python/cpython/commit/65aa64fae89a24491aae84ba0329eb8f3c68c389


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:27:53 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 15:27:53 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560266873.51.0.918978958738.issue36607@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13842
pull_request: https://github.com/python/cpython/pull/13975

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:28:01 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 15:28:01 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560266881.43.0.253440174453.issue36607@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13843
pull_request: https://github.com/python/cpython/pull/13976

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:33:40 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 15:33:40 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560267220.09.0.190041240353.issue36607@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:35:03 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 11 Jun 2019 15:35:03 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560267303.11.0.450450352504.issue37229@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Sorry, but we've intentionally removed generic compare functions in favor of objects supporting __lt__.  That is now the one-way-to-do-it.  If needed for convenience, you can use functools.cmp_to_key to automatically build a wrapper.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:38:34 2019
From: report at bugs.python.org (Ben Brown)
Date: Tue, 11 Jun 2019 15:38:34 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560267514.21.0.18284502436.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

I tested an older version of OpenSSL 1.0.2g and I get the same error on that

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:40:31 2019
From: report at bugs.python.org (G)
Date: Tue, 11 Jun 2019 15:40:31 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560267631.78.0.189809720047.issue37229@roundup.psfhosted.org>


G <gpery at protonmail.com> added the comment:

What do you propose to do for objects outside your project?
Replace their __lt__ method with a context manager which replaces the original implementation, for lists at a time?

__lt__ is not good enough as a one-way-to-do-it solution.
issue4356 is also a good-enough solution for me, but __lt__ definitely isn't.

----------
resolution: rejected -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:45:18 2019
From: report at bugs.python.org (Matthew Kenigsberg)
Date: Tue, 11 Jun 2019 15:45:18 +0000
Subject: [issue37235] urljoin behavior unclear/not following RFC 3986
Message-ID: <1560267918.98.0.870769323469.issue37235@roundup.psfhosted.org>


New submission from Matthew Kenigsberg <matthewkenigsberg at gmail.com>:

Was trying to figure out the exact behavior of urljoin. As far as I can tell (see https://bugs.python.org/issue22118) it should follow RFC 3986.  According to the algorithm in 5.2.2, I think this is wrong:
>>> urljoin("ftp://netloc", "http://a/b/../c/d")
'http://a/b/../c/d'

And the .. should get removed.

Might be a separate issue, but at the very least, I think the docs should be updated to describe the exact behavior, or at least more directly state that the behavior defined in RFC 3986 is followed.

Would be happy to write a patch if a change is needed.

----------
messages: 345243
nosy: Matthew Kenigsberg
priority: normal
severity: normal
status: open
title: urljoin behavior unclear/not following RFC 3986
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37235>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:47:08 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 15:47:08 +0000
Subject: [issue37234] error in variable
In-Reply-To: <1560266786.16.0.932165098203.issue37234@roundup.psfhosted.org>
Message-ID: <1560268028.41.0.58844456306.issue37234@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This tracker is for issues related to CPython. The examples presented in the report look more like user error with variables where N is not defined in the first examples. Can you please illustrate over the examples over how this is an issue with interpreter and the changes you are proposing?

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37234>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:51:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 15:51:43 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560268303.37.0.122504169473.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I don't see anything in What's New in Python 3.8?:
https://docs.python.org/dev/whatsnew/3.8.html

Would it be possible to document the change somewhere?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:55:10 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 11 Jun 2019 15:55:10 +0000
Subject: [issue37234] error in variable
In-Reply-To: <1560266786.16.0.932165098203.issue37234@roundup.psfhosted.org>
Message-ID: <1560268510.71.0.971514532694.issue37234@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This is intended behavior.

When a variable has an assignment anywhere in a function, it becomes a local. Once a local variable exists, it will shadow the non-local variable.

So by having the "n =", you are marking "n" as a local variable. When the "n + 1" tries to read the local, it has not yet been set, so it fails.

If you want to read and write to "n" in the outer function, you will need the nonlocal statement - https://docs.python.org/3/reference/simple_stmts.html#the-nonlocal-statement

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37234>
_______________________________________

From report at bugs.python.org  Tue Jun 11 11:58:35 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 11 Jun 2019 15:58:35 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560268715.05.0.50196524043.issue33758@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
keywords: +patch
pull_requests: +13844
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13977

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:01:35 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 16:01:35 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560268895.97.0.830846096188.issue36607@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5d1d4e3179ffd4d2d72462d870cf86dcc11450ce by Miss Islington (bot) in branch '3.7':
bpo-36607: Eliminate RuntimeError raised by asyncio.all_tasks() (GH-13971)
https://github.com/python/cpython/commit/5d1d4e3179ffd4d2d72462d870cf86dcc11450ce


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:05:07 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 11 Jun 2019 16:05:07 +0000
Subject: [issue37235] urljoin behavior unclear/not following RFC 3986
In-Reply-To: <1560267918.98.0.870769323469.issue37235@roundup.psfhosted.org>
Message-ID: <1560269107.1.0.325729126021.issue37235@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Library (Lib)
nosy: +orsenthil, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37235>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:06:46 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 11 Jun 2019 16:06:46 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560269206.9.0.573533594271.issue35766@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

> Would it be possible to document the change somewhere?

Most of these things are in the docs for ast module.

But indeed none of static typing related features have been added to What's New. I have an item on mypy todo list to add four typing PEPs plus new AST features (also adding `end_lineno` and `end_col_offset`) also there, but didn't have time last weekend.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:07:54 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Tue, 11 Jun 2019 16:07:54 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560269274.3.0.39994476059.issue35766@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

Typo: "mypy todo list" should be "my todo list" :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:18:36 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Tue, 11 Jun 2019 16:18:36 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560269916.12.0.930086962256.issue33758@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 910b3fcb01c29f18ffd53086e36cd2cb9e5fae55 by Benjamin Peterson in branch 'master':
closes bpo-33758: Skip test_get_type_hints_modules_forwardref. (GH-13977)
https://github.com/python/cpython/commit/910b3fcb01c29f18ffd53086e36cd2cb9e5fae55


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:18:47 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 16:18:47 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560269927.66.0.821447300782.issue33758@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13845
pull_request: https://github.com/python/cpython/pull/13978

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:18:56 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 16:18:56 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560269936.81.0.669158975511.issue33758@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13846
pull_request: https://github.com/python/cpython/pull/13979

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:21:14 2019
From: report at bugs.python.org (Tal Einat)
Date: Tue, 11 Jun 2019 16:21:14 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560270074.92.0.897729726722.issue35922@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

The PR is looking good, I'll likely merge it soon.

I'm quite sure this should go into 3.8, but should it be backported to 3.7?  This is certainly a bugfix, but still a slight change of behavior, so perhaps we should avoid changing this in 3.7?

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:38:12 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 16:38:12 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560271092.1.0.502630353865.issue33758@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 1c31d19e35172c7de1beec5c48a5b632d16385d9 by Miss Islington (bot) in branch '3.8':
closes bpo-33758: Skip test_get_type_hints_modules_forwardref. (GH-13977)
https://github.com/python/cpython/commit/1c31d19e35172c7de1beec5c48a5b632d16385d9


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 12:52:41 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 16:52:41 +0000
Subject: [issue33758] Unexpected success of
 test_get_type_hints_modules_forwardref in test_typing
In-Reply-To: <1528041121.47.0.592728768989.issue33758@psf.upfronthosting.co.za>
Message-ID: <1560271961.9.0.265876983142.issue33758@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset fad89046e14b271b2eeb399f7c7b45131d65e5f2 by Miss Islington (bot) in branch '3.7':
closes bpo-33758: Skip test_get_type_hints_modules_forwardref. (GH-13977)
https://github.com/python/cpython/commit/fad89046e14b271b2eeb399f7c7b45131d65e5f2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33758>
_______________________________________

From report at bugs.python.org  Tue Jun 11 13:19:02 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 17:19:02 +0000
Subject: [issue37236] fix test_complex for Windows arm64
Message-ID: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

There is a compiler optimization error on Windows ARM64 that causes test_truediv (test.test_complex.ComplexTest) to fail with ZeroDivisionError: complex division by zero.

Adding a pragma optimize around the affected function fixes the issue.  I am also submitting a report to the compiler team

----------
components: Windows
messages: 345254
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: fix test_complex for Windows arm64
type: compile error
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Tue Jun 11 13:20:41 2019
From: report at bugs.python.org (Jilguero ostras)
Date: Tue, 11 Jun 2019 17:20:41 +0000
Subject: [issue37237] python 2.16 from source on Ubuntu 18.04
Message-ID: <1560273641.16.0.656737490919.issue37237@roundup.psfhosted.org>


New submission from Jilguero ostras <jilguero888 at gmail.com>:

-Trying to install Python 2.16 from source on Ubuntu 18.04. Latest version is not in repositories.
-Installation completes but I need to install pip from repositories
-modules (e.g. numpy) installed by pip install on /usr/local/lib/python2.7/dist-packages
-installed modules can not be imported on Python
-path /usr/local/lib/python2.7/dist-packages is not listed on sys.path
-when added manually, modules are imported with errors and they don't work
-I am installing modules with -t option of pip, to be installed on /home/user01/.local/lib/python2.7/site-packages, because it is included on sys.path
-modules are imported to Python with errors



In addition to numpy, other modules fail. I think there is a problem with Python/pip after installation from source.

----------
messages: 345255
nosy: Jilguero ostras
priority: normal
severity: normal
status: open
title: python 2.16 from source on Ubuntu 18.04
type: resource usage
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37237>
_______________________________________

From report at bugs.python.org  Tue Jun 11 13:26:41 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 17:26:41 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1560274001.73.0.728797545998.issue37236@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13847
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13983

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Tue Jun 11 13:54:15 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 17:54:15 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560275655.93.0.752752525036.issue35766@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I'll create a PR that updates the What's New docs with news about all of these.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:03:12 2019
From: report at bugs.python.org (Noah)
Date: Tue, 11 Jun 2019 18:03:12 +0000
Subject: [issue37184] suggesting option to raise exception if process exits
 nonzero in `with subprocess.Popen(...):`
In-Reply-To: <1559859389.6.0.41932196936.issue37184@roundup.psfhosted.org>
Message-ID: <1560276192.97.0.522917201113.issue37184@roundup.psfhosted.org>


Noah <nlevitt at archive.org> added the comment:

I subscribed and emailed python-ideas at python.org but it still hasn't passed moderation I guess, hmm

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37184>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:09:20 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 11 Jun 2019 18:09:20 +0000
Subject: [issue37225] Signatures of Exceptions not documented
In-Reply-To: <1560237102.52.0.133464005619.issue37225@roundup.psfhosted.org>
Message-ID: <1560276560.88.0.0836193340253.issue37225@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

OSError does have its constructor documented at https://docs.python.org/3/library/exceptions.html#OSError (farther down the page I think you're reading; you didn't provide the URL you're referring to so I'm somewhat guessing). It is specifically vague because it varies from exception to exception and you need to check the exception you're using to see if it differs from BaseException.

Thanks for letting us know about your concerns, but I'm closing as "not a bug".

----------
nosy: +brett.cannon
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37225>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:15:07 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 18:15:07 +0000
Subject: [issue35293] make doctest (Sphinx) emits a lot of warnings
In-Reply-To: <1542835631.23.0.788709270274.issue35293@psf.upfronthosting.co.za>
Message-ID: <1560276907.65.0.207621022273.issue35293@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

I still get some warnings about docutils itself, e.g.

/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/_html_base.py:1035: SyntaxWarning: invalid escape sequence \(
  'mathjax': ('\(%s\)', '\\begin{%s}\n%s\n\\end{%s}'),
/Users/guido/v38/lib/python3.8/site-packages/docutils/utils/math/math2html.py:4103: SyntaxWarning: invalid escape sequence \{
  """Check for an empty command: look for command disguised as ending.
/Users/guido/v38/lib/python3.8/site-packages/docutils/utils/math/math2html.py:4563: SyntaxWarning: invalid escape sequence \e
  "A \\begin{}...\end command and what it entails (array, cases, aligned)"
/Users/guido/v38/lib/python3.8/site-packages/docutils/utils/math/latex2mathml.py:154: SyntaxWarning: invalid escape sequence \i
  '\in': '\u2209',
/Users/guido/v38/lib/python3.8/site-packages/docutils/utils/math/latex2mathml.py:155: SyntaxWarning: invalid escape sequence \e
  '\equiv': '\u2262'}
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:1197: SyntaxWarning: invalid escape sequence \w
  none ) = re.split('(\w+)(.*)', settings.literal_block_env)
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:1463: SyntaxWarning: invalid escape sequence \ 
  """Return text with 'problematic' characters escaped.
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:1562: SyntaxWarning: invalid escape sequence \p
  """Return list of label definitions for all ids of `node`
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:1922: SyntaxWarning: invalid escape sequence \p
  self.title.insert(0, '\phantomsection%\n  ')
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:2269: SyntaxWarning: invalid escape sequence \d
  match = re.match('(\d*\.?\d*)\s*(\S*)', length_str)
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:2381: SyntaxWarning: invalid escape sequence \i
  self.out.append('\item[] ')
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:2525: SyntaxWarning: invalid escape sequence \(
  wrapper = '\(%s\)'
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:2804: SyntaxWarning: invalid escape sequence \c
  self.out.append('\n\n{\color{red}%s/%s} in \\texttt{%s}%s\n' %
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/latex2e/__init__.py:2892: SyntaxWarning: invalid escape sequence \l
  self.out.append('}] \leavevmode ')
/Users/guido/v38/lib/python3.8/site-packages/docutils/writers/manpage.py:371: SyntaxWarning: invalid escape sequence \-
  "%(title)s \- %(subtitle)s\n")

----------
nosy: +gvanrossum
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35293>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:16:35 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 11 Jun 2019 18:16:35 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1560276995.46.0.912490971894.issue37236@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:33:15 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 11 Jun 2019 18:33:15 +0000
Subject: [issue37237] python 2.16 from source on Ubuntu 18.04
In-Reply-To: <1560273641.16.0.656737490919.issue37237@roundup.psfhosted.org>
Message-ID: <1560277995.82.0.778383386414.issue37237@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

This report is a bit hard to understand. Please could you give more details? Can you tell us:

- *exactly* what you did (what sequence of instructions you executed, where you got the Python source from, etc.)
- what you expected to happen
- what did happen, including any relevant tracebacks, error messages or logs.

I don't understand what "Python 2.16" refers to: the latest version of Python 2 is Python 2.7.

One possible cause of error is using the wrong pip command. Which "pip" command are you using, and where did it come from? In general, you need to use the "pip" for the corresponding Python installation. The safest way to do this is to always use "python -m pip" (with the right target Python) instead of plain "pip".

To get an initial install of "pip", use "python -m ensurepip" (depending on Python version, but this is available for all recent Python 2.7.x and Python 3.x releases).

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37237>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:54:17 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 18:54:17 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560279257.01.0.529276407137.issue35766@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
pull_requests: +13848
pull_request: https://github.com/python/cpython/pull/13984

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 14:59:52 2019
From: report at bugs.python.org (Alex Willmer)
Date: Tue, 11 Jun 2019 18:59:52 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560279592.49.0.197704508501.issue37210@roundup.psfhosted.org>


Alex Willmer <alex at moreati.org.uk> added the comment:

> it is probably not possible to write a pure Python PickleBuffer

Fair enough

> a usable pure Python Pickler, but without support for the PickleBuffer class.

That makes sense. However, for third party packages (e.g. zodbpickle, pikl) wanting a pure Python pickle module to use as a basis, I think it would make more sense to use the CPython 3.7 branch as a basis. Adding a pickle._Pickler variant to the 3.8 stdlib that can't do protocol 5, just for third-parties imposes a maintenance burden on the core devs for zero benefit to anyone.

I propose closing this ticket as WONTFIX.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Tue Jun 11 15:36:39 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Tue, 11 Jun 2019 19:36:39 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560281799.87.0.854437812676.issue37210@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Ok, closing then.

----------
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Tue Jun 11 15:49:05 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Tue, 11 Jun 2019 19:49:05 +0000
Subject: [issue28502] [Patch] Make os.chdir() optional
In-Reply-To: <1477115195.1.0.580287867342.issue28502@psf.upfronthosting.co.za>
Message-ID: <1560282545.98.0.492968220583.issue28502@roundup.psfhosted.org>


Joannah Nanjekye <nanjekyejoannah at gmail.com> added the comment:

@ Ed Schouten, are you still interested in solving this? If so, please convert your patch into a PR.

----------
nosy: +nanjekyejoannah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28502>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:10:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 20:10:30 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560283830.21.0.690247372897.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> ``feature_version=N`` allows specifying the minor version of an earlier Python 3 version.  (For example, ``feature_version=4`` will treat ``async`` and ``await`` as non-reserved words.)

What will happen with Python 4? Why not using "full" Python version like (3, 4) or 0x304?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:15:28 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 20:15:28 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560284128.95.0.623260243624.issue35766@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

> What will happen with Python 4? Why not using "full" Python version like (3, 4) or 0x304?

I don't think Python 4 is just around the corner, so I prefer to kick that problem down the road. I'm sure we can come up with a sufficiently backwards-compatible API.  (I'd prefer not to go the hex route, because printing the value would show as 52, which is pretty meaningless.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:15:54 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 11 Jun 2019 20:15:54 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560284154.42.0.763589193639.issue36607@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution: fixed -> 
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:32:08 2019
From: report at bugs.python.org (Orivej Desh)
Date: Tue, 11 Jun 2019 20:32:08 +0000
Subject: [issue26180] multiprocessing.util._afterfork_registry leak in
 threaded environment
In-Reply-To: <1453476286.88.0.329468896089.issue26180@psf.upfronthosting.co.za>
Message-ID: <1560285128.39.0.0290043522845.issue26180@roundup.psfhosted.org>


Change by Orivej Desh <orivej at gmx.fr>:


----------
keywords: +patch
pull_requests: +13849
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13986

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26180>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:32:28 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 20:32:28 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560285148.44.0.405774387734.issue36607@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 83abd9658b4845299452be06c9ce92cbceee944d by Miss Islington (bot) in branch '3.8':
bpo-36607: Eliminate RuntimeError raised by asyncio.all_tasks() (GH-13971)
https://github.com/python/cpython/commit/83abd9658b4845299452be06c9ce92cbceee944d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:42:47 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 20:42:47 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560285767.38.0.0632575180215.issue35766@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13850
pull_request: https://github.com/python/cpython/pull/13987

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:42:51 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 20:42:51 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560285771.79.0.537867331802.issue35766@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:


New changeset 9b33ce48a7846dbdad32d4f8936b08e6b78a2faf by Guido van Rossum in branch 'master':
bpo-35766: What's new in the ast and typing modules (#13984)
https://github.com/python/cpython/commit/9b33ce48a7846dbdad32d4f8936b08e6b78a2faf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:53:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 20:53:44 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560286424.24.0.218967826713.issue37213@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I removed the memchr(255) to see which tests fail:

test_extended_opargs (test.test_modulefinder.ModuleFinderTest) ... python: Python/peephole.c:469: PyCode_Optimize: Assertion `cum_orig_offset % sizeof(_Py_CODEUNIT) == 0' failed.
Fatal Python error: Aborted

test_extended_arg (test.test_compile.TestSpecifics) ... python: Python/peephole.c:469: PyCode_Optimize: Assertion `cum_orig_offset % sizeof(_Py_CODEUNIT) == 0' failed.
Fatal Python error: Aborted

test_field_named_like_builtin (test.test_dataclasses.TestCase) ... python: Python/peephole.c:469: PyCode_Optimize: Assertion `cum_orig_offset % sizeof(_Py_CODEUNIT) == 0' failed.
Fatal Python error: Aborted

test_field_named_like_builtin_frozen (test.test_dataclasses.TestCase) ... python: Python/peephole.c:469: PyCode_Optimize: Assertion `cum_orig_offset % sizeof(_Py_CODEUNIT) == 0' failed.
Fatal Python error: Aborted

Does test_compile have unit tests test_modulefinder and test_dataclasses cases?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Tue Jun 11 16:54:52 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Tue, 11 Jun 2019 20:54:52 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560286492.43.0.605958012923.issue37213@roundup.psfhosted.org>


Change by Yury Selivanov <yselivanov at gmail.com>:


----------
nosy:  -yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:09:26 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 21:09:26 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
Message-ID: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

What is the normal process for lighting up a new Visual Studio?

----------
components: Build, Windows
messages: 345269
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Enable building for Windows using Visual Studio 2019
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:13:06 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 21:13:06 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
In-Reply-To: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>
Message-ID: <1560287586.38.0.328333499576.issue37238@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13851
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13988

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:13:35 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 21:13:35 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560287615.88.0.980121468556.issue35766@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 785688832de699270530a9418e99c5c4caedbffb by Miss Islington (bot) in branch '3.8':
bpo-35766: What's new in the ast and typing modules (GH-13984)
https://github.com/python/cpython/commit/785688832de699270530a9418e99c5c4caedbffb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:44:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 21:44:00 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560289440.69.0.485124860341.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I would prefer to revert PyCode_New() API (to Python 3.7 and older API), and add a *new* function for positional-only arguments.


> I have created PR13959 in case we decide to go with the PyCode_NewEx path.

I dislike "Ex" suffix. What will be next name? Ex2? NewEx?

I prefer "With" naming.

I suggest: PyCode_NewWithPosArgs(). IMHO it's way more explicit when you opt-in for this new function ;-)

--

PyCode_New() was broken 8 times in the history of Python :-)
https://bugs.python.org/issue37032#msg343377

It seems like more people are unhappy with this backward incompatible change, because Python popularity is still growing. It's a good sign of the health of time :-)

-- 

> +1. You already broke backwards compatibility once in beta1, no need to do it again in beta2.

It's not this easy.

This issue mostly impact projects using Cython. For practical reasons, projects include C files generated by Cython (to avoid Cython dependency to install the project). Cython 0.29.8 is the first version supporting Python 3.8 (new PyCode_New API) was only released two weeks ago.

Right now, I guess that almost all, if not all, tarballs on PyPI on projects using Cython still include C code only compatible with Python 3.7 (old PyCode_New API).

There are 183k projets on PyPI. I would prefer to not have to have to manually regenerate the C code they include to support the new PyCode_New() API.

We are still at beta stage. The role of beta releases is to detect backward incompatible changes like that.

I'm in favor of reverting PyCode_New() API and add a new function for the very few people who care about building manually a code object with positional-only arguments.

It's just a practical move to not break projects on PyPI.

Please, synchronize with Cython to make sure that we can get a Cython release soon after beta2 with will emit code working on all Python version. Maybe the workaround for Python 3.8 alpha1 .. 3.8 beta1 can be simply removed from Cython?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:47:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 21:47:35 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560289655.1.0.557016244472.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It seems like very few pepople are testing Python 3.8 so far. I'm making this assumption because many projects using Cython cannot be installed on Python 3.8 and I didn't see much complain so far.

My Python Maintenance team at Red Hat is working on fixing all the stuff for Python 3.8, and we are the most exposed by such backward incompatible change. FYI we modified a few Fedora packages to explicitly run Cython as part of the build to ensure that C files are always regenerated with Cython. So if PyCode_New() API change again in beta2 but Cython takes that into account, Fedora Rawhide will be unaffected.

Note: we are not sure yet if Fedora 31 will be able to switch to Python 3.8 by default, the build of many package is still failing, for various reasons (sadly, this change is far from being the only reason!).

More info:
https://twitter.com/VictorStinner/status/1138067403341012997

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:49:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 21:49:33 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560289773.61.0.852495315637.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I'm sure we can come up with a sufficiently backwards-compatible API.  (I'd prefer not to go the hex route, because printing the value would show as 52, which is pretty meaningless.)

I propose to replace 4 with (3, 4) to be more future-proof. This version format is already used by sys.version_info for example.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:52:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 21:52:41 +0000
Subject: [issue36896] clarify in types.rst that FunctionTypes & co
 constructors don't have stable signature
In-Reply-To: <1557698610.19.0.556381141599.issue36896@roundup.psfhosted.org>
Message-ID: <1560289961.09.0.01747144436.issue36896@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Would it be the right place to document the new CodeType.replace() method which is designed to help to write "future-proof" code? (not rely on the exact constructor API)

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36896>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:55:57 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 21:55:57 +0000
Subject: [issue37239] Add headless development preset layout
Message-ID: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

Add preset-headless preset which has everything that preset-default has minus tcltk and idle

----------
components: Build, Windows
messages: 345275
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Add headless development preset layout
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Tue Jun 11 17:58:23 2019
From: report at bugs.python.org (Paul Monson)
Date: Tue, 11 Jun 2019 21:58:23 +0000
Subject: [issue37239] Add headless development preset layout
In-Reply-To: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>
Message-ID: <1560290303.17.0.773565058291.issue37239@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13852
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/13989

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:03:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 11 Jun 2019 22:03:20 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
In-Reply-To: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>
Message-ID: <1560290600.77.0.704054788834.issue37238@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 04856c2193eb72d72c46b57fa08095235d732a73 by Steve Dower (Paul Monson) in branch 'master':
bpo-37238: Enable building for Windows using Visual Studio 2019 (GH-13988)
https://github.com/python/cpython/commit/04856c2193eb72d72c46b57fa08095235d732a73


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:03:41 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 22:03:41 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
In-Reply-To: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>
Message-ID: <1560290621.17.0.0286088900698.issue37238@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13853
pull_request: https://github.com/python/cpython/pull/13990

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:04:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 11 Jun 2019 22:04:16 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
In-Reply-To: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>
Message-ID: <1560290656.56.0.0385046352183.issue37238@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Not a whole lot of process, really. It's done now :)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:05:39 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 11 Jun 2019 22:05:39 +0000
Subject: [issue37239] Add headless development preset layout
In-Reply-To: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>
Message-ID: <1560290739.73.0.41602315768.issue37239@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Why is this different from the nuget package? Should we just add more things into that package?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:14:32 2019
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 11 Jun 2019 22:14:32 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560291272.96.0.36078427967.issue29505@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
pull_requests: +13854
pull_request: https://github.com/python/cpython/pull/13991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:21:26 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Tue, 11 Jun 2019 22:21:26 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560291686.69.0.965332581186.issue37221@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

The key problem isn't Cython itself, the problem is that Cython generated libraries can't be rebuilt for 3.8 without regenerating their C files.

I'd be fine with PyCode_NewWithPosArgs (Victor's right that a descriptive naming convention handles future changes better than Ex)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:35:58 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 22:35:58 +0000
Subject: [issue37238] Enable building for Windows using Visual Studio 2019
In-Reply-To: <1560287366.71.0.530978180943.issue37238@roundup.psfhosted.org>
Message-ID: <1560292558.48.0.353540711949.issue37238@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 36926df8341827fb2a5323f559daab8e34d33ed8 by Miss Islington (bot) in branch '3.8':
bpo-37238: Enable building for Windows using Visual Studio 2019 (GH-13988)
https://github.com/python/cpython/commit/36926df8341827fb2a5323f559daab8e34d33ed8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37238>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:38:30 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 11 Jun 2019 22:38:30 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560292710.74.0.616599489689.issue37221@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I updated the PR and Victor reviewed it. Nick, could you review it as well?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:47:11 2019
From: report at bugs.python.org (Agrim Sachdeva)
Date: Tue, 11 Jun 2019 22:47:11 +0000
Subject: [issue37240] Filename http.py breaks calls to urllib
Message-ID: <1560293231.78.0.659598330159.issue37240@roundup.psfhosted.org>


New submission from Agrim Sachdeva <as2936 at njit.edu>:

If a script that uses urllib is named http.py, the following error occurs:

Traceback (most recent call last):
  File ".\http.py", line 1, in <module>
    import urllib.request, urllib.parse, urllib.error
  File "C:\Users\grim\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 88, in <module>
    import http.client
  File "C:\Python\http.py", line 11, in <module>
    html = urllib.request.urlopen(url).read()
AttributeError: module 'urllib' has no attribute 'request'

----------
components: Windows
messages: 345282
nosy: Agrim Sachdeva2, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Filename http.py breaks calls to urllib
type: compile error
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37240>
_______________________________________

From report at bugs.python.org  Tue Jun 11 18:58:42 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Tue, 11 Jun 2019 22:58:42 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560293922.19.0.463517287302.issue37221@roundup.psfhosted.org>


Neil Schemenauer <nas-python at arctrix.com> added the comment:

I suggest we change PyCode_New() back in the next beta, despite that change breaking Cython again.  We could work with them so that they have a new release with a "PY_VERSION_HEX > 0x030800b1" test in it. Try to get that Cython version released before 3.8b2 hits.  The window of a Cython version that doesn't support CPython >= 3.8b1 can be made pretty small.  It would be nice to find these issues in alpha releases but finding them in beta is still early enough to fix it.

Having to regenerate all of the Cython emitted code embedded in different packages is painful.  I experienced having to update numpy so that I could test my software with 3.8b1.  Avoiding that is why we should change PyCode_New back.  Introducing a new API like PyCode_NewWithPosArgs() is going to work better.

If we do have to make a similar incompatible change in the future, we should try hard to make it so there is an overlapping period of compatibility.  It's bad to have an API change from one release to the next without giving time for projects like Cython time to catch up.

----------
nosy: +nascheme

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:08:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 23:08:35 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560294515.27.0.225911788076.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> If we do have to make a similar incompatible change in the future, (...)

IMHO the most important learnt lesson here is that we lack a proper Continuous Integration of the master branch of Python and popular PyPI projects. We should be notified *before* a release.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:09:14 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 23:09:14 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560294554.25.0.970484234154.issue35766@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

But this is the format currently used by typed_ast. I think it would just cause a cascade of annoying failures for tools that switch between typed_ast and the 3.8 version of ast. Such as mypy.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:14:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 11 Jun 2019 23:14:26 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560294866.44.0.272981037502.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> But this is the format currently used by typed_ast. I think it would just cause a cascade of annoying failures for tools that switch between typed_ast and the 3.8 version of ast. Such as mypy.

typed_ast is a 3rd party project. But here we are talking about Python stdlib. If a project moves from typed_ast to stdlib ast, IMHO it should be quite easy to replace 4 with (3, 4), especially if 4 raises an error, no?

IMHO it's a good opportunity to fix it.

I would prefer to not have to batch many backward incompatible changes into Python 4...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:27:16 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 23:27:16 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1560295636.3.0.39316792898.issue36520@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0745cc66db3acbe7951073071cf063db6337dd10 by Miss Islington (bot) (Abhilash Raj) in branch '3.7':
[3.7] bpo-36520: Email header folded incorrectly (GH-13608) (GH-13910)
https://github.com/python/cpython/commit/0745cc66db3acbe7951073071cf063db6337dd10


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:28:18 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 11 Jun 2019 23:28:18 +0000
Subject: [issue36520] Email header folded incorrectly
In-Reply-To: <1554333300.49.0.663084865399.issue36520@roundup.psfhosted.org>
Message-ID: <1560295698.05.0.419118261844.issue36520@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 36eea7af48ca0a1c96b78c82bf95bbd29d2332da by Miss Islington (bot) (Abhilash Raj) in branch '3.8':
[3.8] bpo-36520: Email header folded incorrectly (GH-13608) (GH-13909)
https://github.com/python/cpython/commit/36eea7af48ca0a1c96b78c82bf95bbd29d2332da


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36520>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:40:47 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Tue, 11 Jun 2019 23:40:47 +0000
Subject: [issue37240] Filename http.py breaks calls to urllib
In-Reply-To: <1560293231.78.0.659598330159.issue37240@roundup.psfhosted.org>
Message-ID: <1560296447.53.0.906001504239.issue37240@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Closing as not a bug. This is how python works: you do not want to name a file the same as any standard library module. Use a file name other than http.py.

----------
components: +Library (Lib) -Windows
nosy: +eric.smith -paul.moore, steve.dower, tim.golden, zach.ware
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37240>
_______________________________________

From report at bugs.python.org  Tue Jun 11 19:41:52 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Tue, 11 Jun 2019 23:41:52 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560296512.68.0.0986719328834.issue35766@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
pull_requests: +13855
pull_request: https://github.com/python/cpython/pull/13992

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:13:05 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 00:13:05 +0000
Subject: [issue37241] Item Count Error in Shelf
Message-ID: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>


New submission from Jesse Bacon <jessembacon at me.com>:

I have loaded the National Vulnerability Database from NIST for 2019 and it includes 3989 JSON Documents.  This data I have placed in a shelf.  when I run len(db.keys()) I get 3658.  len(set(cves)) == 3989 : True

When I extract the data from the shelf I have the right amount of records, 3989.  I tested on python 3.7.3 and Python 3.6.5.  I am concerned this is going to ruin a metric in a security report.  For example, A risk exposure report may use the number of keys in a yearly vulnerability db as the baseline for a risk calculation which contrasts the number of patched CVE's.  

nvdcve-1.0-2019.json

----------
components: Library (Lib)
files: KeyCount.png
messages: 345290
nosy: jessembacon
priority: normal
severity: normal
status: open
title: Item Count Error in Shelf
type: behavior
versions: Python 3.6, Python 3.7
Added file: https://bugs.python.org/file48411/KeyCount.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:16:01 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 12 Jun 2019 00:16:01 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560298561.26.0.461067504463.issue37241@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Please do not post images: we can't copy and paste from them, and they're unfriendly to visually impaired users.

Can you create code that reproduces this? A small example, with no external dependencies would be best. Please attach the reproducer as a text file.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:23:17 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 00:23:17 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560298997.91.0.520122999449.issue35766@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 10b55c1643b512b3a2cae8ab89c53683a13ca43e by Miss Islington (bot) (Guido van Rossum) in branch 'master':
bpo-35766: Change format for feature_version to (major, minor) (GH-13992)
https://github.com/python/cpython/commit/10b55c1643b512b3a2cae8ab89c53683a13ca43e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:23:27 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 00:23:27 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560299007.91.0.604133968692.issue35766@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13856
pull_request: https://github.com/python/cpython/pull/13993

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:34:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 00:34:58 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560299698.65.0.461931711274.issue35766@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13857
pull_request: https://github.com/python/cpython/pull/13994

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:52:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 00:52:24 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560300744.23.0.731083952777.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset efdf6ca90f7702824e7aeee1ceca949e7c20288a by Victor Stinner in branch 'master':
bpo-35766: compile(): rename feature_version parameter (GH-13994)
https://github.com/python/cpython/commit/efdf6ca90f7702824e7aeee1ceca949e7c20288a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:52:27 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 00:52:27 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560300747.23.0.758979088128.issue35766@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13858
pull_request: https://github.com/python/cpython/pull/13995

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 20:55:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 00:55:31 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560300931.28.0.16529507434.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 3ba21070c6ecab83c23cea41a92b42fa651c7ea2 by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-35766: Change format for feature_version to (major, minor) (GH-13992) (GH-13993)
https://github.com/python/cpython/commit/3ba21070c6ecab83c23cea41a92b42fa651c7ea2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 21:12:14 2019
From: report at bugs.python.org (Hong Xu)
Date: Wed, 12 Jun 2019 01:12:14 +0000
Subject: [issue37225] Signatures of Exceptions not documented
In-Reply-To: <1560237102.52.0.133464005619.issue37225@roundup.psfhosted.org>
Message-ID: <1560301934.19.0.569993683039.issue37225@roundup.psfhosted.org>


Hong Xu <hong at topbug.net> added the comment:

Thanks for your answer, but I believe this is a real document bug. OSError does have its signature documented, but the majority of other exception classes do not do so, neither does BaseException explains a default behavior clearly (see my quote above).

As an example, ValueError accepts multiple arguments and makes use of all of them when given, but from the document, I can barely guess this out.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37225>
_______________________________________

From report at bugs.python.org  Tue Jun 11 21:36:42 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 01:36:42 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560303402.86.0.467210714962.issue35922@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Yes, this looks like a bugfix. Who wants an AttributeError? :-)

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Tue Jun 11 21:42:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 01:42:10 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560303730.94.0.79328904927.issue36918@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13859
pull_request: https://github.com/python/cpython/pull/13996

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:04:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:04:11 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1560305051.14.0.956940330624.issue26219@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13860
pull_request: https://github.com/python/cpython/pull/13997

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:07:42 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:07:42 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560305262.07.0.704001528764.issue36918@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset eb976e47e261760330c1bed224019b073b05e994 by Victor Stinner in branch 'master':
bpo-36918: Fix "Exception ignored in" in test_urllib (GH-13996)
https://github.com/python/cpython/commit/eb976e47e261760330c1bed224019b073b05e994


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:07:50 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 02:07:50 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560305270.34.0.274813011278.issue36918@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13861
pull_request: https://github.com/python/cpython/pull/13998

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:14:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:14:12 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560305652.52.0.957110268185.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh. There are still 3 errors in 2 tests:

test_writer_close_error_on_close (test.test_io.CBufferedRWPairTest) ... Exception ignored in: <_io.BufferedWriter>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/unittest/case.py", line 611, in _callTestMethod
    method()
ValueError: flush of closed file
ok

test_destructor (test.test_io.CBufferedRandomTest) ... Exception ignored in: <_io.BufferedRWPair object at 0x7fc9d1c230b0>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/support/__init__.py", line 1627, in gc_collect
    gc.collect()
ValueError: flush of closed file
Exception ignored in: <_io.BufferedWriter>
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/support/__init__.py", line 1627, in gc_collect
    gc.collect()
ValueError: flush of closed file
ok

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:26:07 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 02:26:07 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560306367.98.0.774138499793.issue36918@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9d37ae0bee25692572c201378cd0692df22fa2ac by Miss Islington (bot) in branch '3.8':
bpo-36918: Fix "Exception ignored in" in test_urllib (GH-13996)
https://github.com/python/cpython/commit/9d37ae0bee25692572c201378cd0692df22fa2ac


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:39:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:39:57 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560307197.75.0.431519831852.issue37223@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13862
pull_request: https://github.com/python/cpython/pull/13999

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:41:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:41:22 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1560307282.05.0.231837113492.issue26219@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 376ce9852eec4e97745c723f0dd0fe64383c6cd3 by Victor Stinner in branch 'master':
bpo-26219: Fix compiler warning in _PyCode_InitOpcache() (GH-13997)
https://github.com/python/cpython/commit/376ce9852eec4e97745c723f0dd0fe64383c6cd3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:41:31 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 02:41:31 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1560307291.36.0.26473422128.issue26219@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13863
pull_request: https://github.com/python/cpython/pull/14000

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:42:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:42:40 +0000
Subject: [issue36918] ValueError warning in test_urllib due to io.IOBase
 destructor
In-Reply-To: <1557856507.99.0.0146189740679.issue36918@roundup.psfhosted.org>
Message-ID: <1560307360.11.0.797817754088.issue36918@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36918>
_______________________________________

From report at bugs.python.org  Tue Jun 11 22:45:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 02:45:39 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560307539.86.0.731417457983.issue35766@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13864
pull_request: https://github.com/python/cpython/pull/14001

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:42:36 2019
From: report at bugs.python.org (laike9m)
Date: Wed, 12 Jun 2019 03:42:36 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560310956.93.0.882280229237.issue32625@roundup.psfhosted.org>


Change by laike9m <laike9m at gmail.com>:


----------
keywords: +patch
pull_requests: +13865
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/13985

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:46:13 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 12 Jun 2019 03:46:13 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560311173.56.0.0893883348865.issue32625@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 405f648db7c44b07348582b5101d4716e0ce5ac3 by Serhiy Storchaka (Yao Zuo) in branch 'master':
bpo-32625: Updated documentation for EXTENDED_ARG. (GH-13985)
https://github.com/python/cpython/commit/405f648db7c44b07348582b5101d4716e0ce5ac3


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:46:22 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 03:46:22 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560311182.11.0.881948400309.issue32625@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13866
pull_request: https://github.com/python/cpython/pull/14002

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:46:28 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 03:46:28 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560311188.68.0.0497501832621.issue32625@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13867
pull_request: https://github.com/python/cpython/pull/14003

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:51:45 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 03:51:45 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560311505.21.0.54159213034.issue32625@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f0cc1a91f72c7f60adc47ec9a4305d8d85dcb1f2 by Miss Islington (bot) in branch '3.7':
bpo-32625: Updated documentation for EXTENDED_ARG. (GH-13985)
https://github.com/python/cpython/commit/f0cc1a91f72c7f60adc47ec9a4305d8d85dcb1f2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Tue Jun 11 23:54:01 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 03:54:01 +0000
Subject: [issue32625] Update the dis module documentation to reflect switch to
 wordcode
In-Reply-To: <1516642902.05.0.467229070634.issue32625@psf.upfronthosting.co.za>
Message-ID: <1560311641.1.0.871520550031.issue32625@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 811f84d55d156e3d05889806d00a8c028d304089 by Miss Islington (bot) in branch '3.8':
bpo-32625: Updated documentation for EXTENDED_ARG. (GH-13985)
https://github.com/python/cpython/commit/811f84d55d156e3d05889806d00a8c028d304089


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32625>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:30:46 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 04:30:46 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560313846.37.0.330926482195.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13868
pull_request: https://github.com/python/cpython/pull/14005

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:30:53 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 04:30:53 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560313853.57.0.944768845303.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13869
pull_request: https://github.com/python/cpython/pull/14006

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:30:59 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Wed, 12 Jun 2019 04:30:59 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560313859.6.0.284107178289.issue29505@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset a6e190e94b47324f14e22a09200c68b722d55699 by Gregory P. Smith (Ammar Askar) in branch 'master':
bpo-29505: Fuzz json module, enforce size limit on int(x) fuzz (GH-13991)
https://github.com/python/cpython/commit/a6e190e94b47324f14e22a09200c68b722d55699


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:42:27 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Wed, 12 Jun 2019 04:42:27 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560314547.42.0.971623121384.issue37221@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Note that PyCode_New() is not the only change in 3.8 beta1 that breaks Cython generated code. The renaming of "tp_print" to "tp_vectorcall" is equally disruptive, because Cython has (or had) a work-around for CPython (mis-)behaviour that reset the field explicitly to NULL after calling PyType_Ready(), which could set it arbitrarily without good reason.

So, either revert that field renaming, too, or ignore Cython generated modules for the reasoning about the change in this ticket.

I'm fine with keeping things as they are now in beta-1, but we could obviously adapt to whatever beta-2 wants to change again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:47:44 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 04:47:44 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560314864.96.0.798116122401.issue29505@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 534136ac6790a701e24f364a9b7f1e34bf5f3ce7 by Miss Islington (bot) in branch '3.7':
bpo-29505: Fuzz json module, enforce size limit on int(x) fuzz (GH-13991)
https://github.com/python/cpython/commit/534136ac6790a701e24f364a9b7f1e34bf5f3ce7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Wed Jun 12 00:48:20 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 04:48:20 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1560314900.9.0.258905724813.issue29505@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 878227e7217f3363f9c095b7fb8c1dbdde1ec34f by Miss Islington (bot) in branch '3.8':
bpo-29505: Fuzz json module, enforce size limit on int(x) fuzz (GH-13991)
https://github.com/python/cpython/commit/878227e7217f3363f9c095b7fb8c1dbdde1ec34f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Wed Jun 12 01:33:05 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 12 Jun 2019 05:33:05 +0000
Subject: [issue37229] bisect: Allow a custom compare function
In-Reply-To: <1560249413.65.0.773454068732.issue37229@roundup.psfhosted.org>
Message-ID: <1560317585.92.0.888839807306.issue37229@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

> issue4356 is also a good-enough solution for me,

Then please leave this closed and let that issue run its course. 

Also, please don't take an argumentative tone or abuse setting the tracker status.

----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37229>
_______________________________________

From report at bugs.python.org  Wed Jun 12 01:55:28 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 12 Jun 2019 05:55:28 +0000
Subject: [issue36901] Fix leaks in /PC/bdist_wininst/install.c
In-Reply-To: <1557748667.87.0.123726768405.issue36901@roundup.psfhosted.org>
Message-ID: <1560318928.33.0.5363517959.issue36901@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +13870
pull_request: https://github.com/python/cpython/pull/14007

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36901>
_______________________________________

From report at bugs.python.org  Wed Jun 12 02:00:27 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 12 Jun 2019 06:00:27 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560319227.84.0.953387962881.issue37213@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

test_peepholer.diff adds tests which cover various peepholer optimizations not tested before. All of them are failed now and should be passed after merging PR 13969. Pablo, you can include these tests in PR 13969.

----------
Added file: https://bugs.python.org/file48412/test_peepholer.diff

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Wed Jun 12 02:35:29 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 12 Jun 2019 06:35:29 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560321329.86.0.34320242361.issue37111@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
pull_requests: +13871
pull_request: https://github.com/python/cpython/pull/14008

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Wed Jun 12 02:42:01 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 12 Jun 2019 06:42:01 +0000
Subject: [issue36901] Fix leaks in /PC/bdist_wininst/install.c
In-Reply-To: <1557748667.87.0.123726768405.issue36901@roundup.psfhosted.org>
Message-ID: <1560321721.66.0.32996143561.issue36901@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36901>
_______________________________________

From report at bugs.python.org  Wed Jun 12 04:35:31 2019
From: report at bugs.python.org (mrqianjinsi)
Date: Wed, 12 Jun 2019 08:35:31 +0000
Subject: [issue37242] sub-process would be terminated when registered
 finalizer are working
Message-ID: <1560328531.7.0.625749907508.issue37242@roundup.psfhosted.org>


New submission from mrqianjinsi <mrqianjinsi at gmail.com>:

Hi guys.
I'm using multiprocessing module to accelerate my program. and I want to do some cleanup work when sub-process exit. 
but I found that sub-process would be terminated when registered finalizer are working.

Is this behavior designed intentionally?

code example:

import multiprocessing as mp
from multiprocessing.util import Finalize
import os
import time

def finalizer():
    time.sleep(0.2) # some time consuming work
    print('do cleanup work: {}'.format(os.getpid()))

def worker(_):
    print('do some work: {}'.format(os.getpid()))

def initializer():
    # ref: https://github.com/python/cpython/blob/master/Lib/multiprocessing/util.py#L147
    Finalize(None, finalizer, exitpriority=1)

    # atexit module don't work along with multiprocessing module
    # because sub-process exit via os._exit()
    # ref: https://docs.python.org/3/library/atexit.html
    # atexit.register(finalizer)  # don't work

print('main process ID: {}'.format(os.getpid()))
with mp.Pool(4, initializer=initializer) as executor:
    executor.map(worker, range(20))


gist link: https://gist.github.com/MrQianJinSi/2daf5b6a9ef08b00facdfbea5200dd28

----------
components: Library (Lib)
messages: 345310
nosy: mrqianjinsi
priority: normal
severity: normal
status: open
title: sub-process  would be terminated when registered finalizer are working
type: behavior
versions: Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37242>
_______________________________________

From report at bugs.python.org  Wed Jun 12 04:37:15 2019
From: report at bugs.python.org (mrqianjinsi)
Date: Wed, 12 Jun 2019 08:37:15 +0000
Subject: [issue37242] sub-process would be terminated when registered
 finalizers are working
In-Reply-To: <1560328531.7.0.625749907508.issue37242@roundup.psfhosted.org>
Message-ID: <1560328635.51.0.290096437144.issue37242@roundup.psfhosted.org>


Change by mrqianjinsi <mrqianjinsi at gmail.com>:


----------
title: sub-process  would be terminated when registered finalizer are working -> sub-process  would be terminated when registered finalizers are working

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37242>
_______________________________________

From report at bugs.python.org  Wed Jun 12 04:47:41 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 12 Jun 2019 08:47:41 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560329261.06.0.214374558772.issue37221@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Adding Petr, that was involved with the "tp_print" to "tp_vectorcall" renaming.

----------
nosy: +petr.viktorin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 04:58:20 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 12 Jun 2019 08:58:20 +0000
Subject: [issue37087] Adding native id support for openbsd
In-Reply-To: <1559147565.3.0.574292103957.issue37087@roundup.psfhosted.org>
Message-ID: <1560329900.36.0.916466096884.issue37087@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +13872
pull_request: https://github.com/python/cpython/pull/13624

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37087>
_______________________________________

From report at bugs.python.org  Wed Jun 12 05:38:07 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 09:38:07 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560332287.93.0.67701681276.issue37221@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Technically, tp_print was replaced by tp_vectorcall_offset.

But that doesn't answer the question how we should deal with tp_print backwards compatibility. Cython does

FooType.tp_print = 0;

With this in mind, simply replacing tp_print by tp_vectorcall_offset is unsafe as it would break types that actually use vectorcall (there aren't many for now, but who knows how this will change in the future).

It would be safer to replace tp_print by tp_vectorcall since setting that to 0 won't break anything (neither for now, nor when PR 13930 is merged).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 05:48:30 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 09:48:30 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560332910.17.0.0808365522023.issue37221@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13873
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14009

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 05:49:42 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 09:49:42 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560332982.91.0.130718411566.issue37221@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

PR 14009 deals with tp_print

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 06:05:34 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 12 Jun 2019 10:05:34 +0000
Subject: [issue37243] test_sendfile in asyncio crashes when os.sendfile() is
 not supported
Message-ID: <1560333934.74.0.973153336061.issue37243@roundup.psfhosted.org>


New submission from Michael Felt <aixtools at felt.demon.nl>:

issue34655 added sendfile support to asyncio. However, the `test_sendfile` fails when called if there is no os.sendfile support.

This patch will skip the test when 

@unittest.skipUnless(hasattr(os, 'sendfile'), 'test needs os.sendfile()')

----------
messages: 345314
nosy: Michael.Felt
priority: normal
severity: normal
status: open
title: test_sendfile in asyncio crashes when os.sendfile() is not supported

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37243>
_______________________________________

From report at bugs.python.org  Wed Jun 12 06:15:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 10:15:13 +0000
Subject: [issue26219] implement per-opcode cache in ceval
In-Reply-To: <1453918500.26.0.0886095278127.issue26219@psf.upfronthosting.co.za>
Message-ID: <1560334513.02.0.174181957733.issue26219@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 996e52623af3854552d41751e0c2522bc0a7e84f by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-26219: Fix compiler warning in _PyCode_InitOpcache() (GH-13997) (GH-14000)
https://github.com/python/cpython/commit/996e52623af3854552d41751e0c2522bc0a7e84f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26219>
_______________________________________

From report at bugs.python.org  Wed Jun 12 06:21:36 2019
From: report at bugs.python.org (mrqianjinsi)
Date: Wed, 12 Jun 2019 10:21:36 +0000
Subject: [issue37242] sub-process would be terminated when registered
 finalizers are still running
In-Reply-To: <1560328531.7.0.625749907508.issue37242@roundup.psfhosted.org>
Message-ID: <1560334896.05.0.25147064267.issue37242@roundup.psfhosted.org>


Change by mrqianjinsi <mrqianjinsi at gmail.com>:


----------
title: sub-process  would be terminated when registered finalizers are working -> sub-process  would be terminated when registered finalizers are still running

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37242>
_______________________________________

From report at bugs.python.org  Wed Jun 12 06:50:17 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 12 Jun 2019 10:50:17 +0000
Subject: [issue37243] test_sendfile in asyncio crashes when os.sendfile() is
 not supported
In-Reply-To: <1560333934.74.0.973153336061.issue37243@roundup.psfhosted.org>
Message-ID: <1560336617.3.0.222398788291.issue37243@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
keywords: +patch
pull_requests: +13874
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14010

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37243>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:05:45 2019
From: report at bugs.python.org (Ben Brown)
Date: Wed, 12 Jun 2019 11:05:45 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560337545.34.0.554462048035.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

I have created a minimal example if that helps to show the issue https://gist.github.com/bobthemac/031213b8e37960ee805f2ae1e6990b60

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:08:58 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 12 Jun 2019 11:08:58 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1560337738.28.0.138088032907.issue37226@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thank you!
Yuri, you might be interested too

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:17:06 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 12 Jun 2019 11:17:06 +0000
Subject: [issue35545] asyncio.base_events.create_connection doesn't handle
 scoped IPv6 addresses
In-Reply-To: <1545303410.27.0.788709270274.issue35545@psf.upfronthosting.co.za>
Message-ID: <1560338226.88.0.0278931302963.issue35545@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +13875
pull_request: https://github.com/python/cpython/pull/14011

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35545>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:33:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:33:53 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560339233.63.0.593106326118.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Note that PyCode_New() is not the only change in 3.8 beta1 that breaks Cython generated code. The renaming of "tp_print" to "tp_vectorcall" is equally disruptive, because Cython has (or had) a work-around for CPython (mis-)behaviour that reset the field explicitly to NULL after calling PyType_Ready(), which could set it arbitrarily without good reason.

Can someone please open a separated issue to discuss tp_print backward incompatible change? This issue is about PyCode_New().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:34:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:34:47 +0000
Subject: [issue37087] Adding native id support for openbsd
In-Reply-To: <1559147565.3.0.574292103957.issue37087@roundup.psfhosted.org>
Message-ID: <1560339287.07.0.0444121264399.issue37087@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests:  -13872

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37087>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:43:46 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 12 Jun 2019 11:43:46 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560339826.77.0.984641807889.issue37111@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Hmm,, about encoding, I agree that default encoding of open() should be used.
If we change it, encoding of log files are changed unexpectedly after upgrading Python.

On the other hand, couldn't we use different default error handler?
"replace" or "backslashescape" seems better default error handler for the logging.
Is this change affects too many users?

----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:45:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:45:11 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
Message-ID: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

x86 Gentoo Refleaks 3.8:
https://buildbot.python.org/all/#/builders/223/builds/9

3:22:46 load avg: 5.83 [423/423/2] test_multiprocessing_forkserver failed (5 min 10 sec)
beginning 6 repetitions
123456
./buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/test/_test_multiprocessing.py:5002: ResourceWarning: unclosed file <_io.BufferedReader name=10>
  p = subprocess.Popen([sys.executable,
ResourceWarning: Enable tracemalloc to get the object allocation traceback
test test_multiprocessing_forkserver failed -- Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/test/_test_multiprocessing.py", line 5015, in test_resource_tracker
    _resource_unlink(name2, rtype)
AssertionError: OSError not raised

/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/resource_tracker.py:203: UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '
/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: '//psm_dfd85228': [Errno 2] No such file or directory: '//psm_dfd85228'
  warnings.warn('resource_tracker: %r: %s' % (name, e))

---

Test added by:

commit f22cc69b012f52882d434a5c44a004bc3aa5c33c
Author: Pierre Glaser <pierreglaser at msn.com>
Date:   Fri May 10 22:59:08 2019 +0200

    bpo-36867: Make semaphore_tracker track other system resources (GH-13222)
    
    The multiprocessing.resource_tracker replaces the multiprocessing.semaphore_tracker module. Other than semaphores, resource_tracker also tracks shared_memory segment
s. Patch by Pierre Glaser.

----------
components: Tests
messages: 345320
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_multiprocessing_forkserver: test_resource_tracker() failed on  x86 Gentoo Refleaks 3.8
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:45:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:45:55 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1560339955.86.0.776404133965.issue36888@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This new test is not reliable, it failed on x86 Gentoo Refleaks 3.8:
https://buildbot.python.org/all/#/builders/223/builds/9

Please fix the test or revert the change. The CI must remain green ;-)


running: test_multiprocessing_spawn (31 min 51 sec), test_multiprocessing_forkserver (3 min 7 ms)
3:20:42 load avg: 6.89 [415/423/1] test_multiprocessing_spawn failed (31 min 30 sec) -- running: test_multiprocessing_forkserver (3 min 7 sec)
beginning 6 repetitions
123456
....Process Process-1588:1:
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/process.py", line 313, in _bootstrap
    self.run()
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/test/_test_multiprocessing.py", line 326, in _test_report_parent_status
    wconn.send("alive" if parent_process().is_alive() else "not alive")
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/connection.py", line 206, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/connection.py", line 411, in _send_bytes
    self._send(header + buf)
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/connection.py", line 368, in _send
    n = write(self._handle, buf)
BrokenPipeError: [Errno 32] Broken pipe
Warning -- Dangling processes: {<Process name='Process-1588' pid=6665 parent=13022 started>}
Warning -- Dangling processes: {<Process name='Process-1588' pid=6665 parent=13022 started>}
Warning -- multiprocessing.process._dangling was modified by test_multiprocessing_spawn
  Before: set()
  After:  {<weakref at 0xb6d7e840; to 'Process' at 0xb4573878>} 
test test_multiprocessing_spawn failed -- Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/test/_test_multiprocessing.py", line 305, in test_parent_process
    raise AssertionError("Could not communicate with child process")
AssertionError: Could not communicate with child process

/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/resource_tracker.py:203: UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '
/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: '//psm_b32d1a2f': [Errno 2] No such file or directory: '//psm_b32d1a2f'
  warnings.warn('resource_tracker: %r: %s' % (name, e))

(...)

Re-running test_multiprocessing_spawn in verbose mode

======================================================================
FAIL: test_parent_process (test.test_multiprocessing_spawn.WithProcessesTestProcess)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.8.ware-gentoo-x86.refleak/build/Lib/test/_test_multiprocessing.py", line 305, in test_parent_process
    raise AssertionError("Could not communicate with child process")
AssertionError: Could not communicate with child process

----------
nosy: +vstinner
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:47:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:47:36 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1560340056.63.0.90693420407.issue37244@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +pablogsal, pierreglaser, pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:47:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:47:54 +0000
Subject: [issue36867] Make semaphore_tracker track other system resources
In-Reply-To: <1557423361.05.0.0948606859067.issue36867@roundup.psfhosted.org>
Message-ID: <1560340074.67.0.811218515471.issue36867@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The new test is not reliable, see: bpo-37244 "test_multiprocessing_forkserver: test_resource_tracker() failed on  x86 Gentoo Refleaks 3.8".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36867>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:48:23 2019
From: report at bugs.python.org (Erik Bray)
Date: Wed, 12 Jun 2019 11:48:23 +0000
Subject: [issue9665] Buid issues on Cygwin - _curses, _curses_panel, and _io
In-Reply-To: <1282599121.2.0.918330648156.issue9665@psf.upfronthosting.co.za>
Message-ID: <1560340103.84.0.207201887263.issue9665@roundup.psfhosted.org>


Erik Bray <erik.m.bray at gmail.com> added the comment:

I think this issue can probably be closed.  It refers to a very old version of Cygwin as well as old versions of Python.  I don't have any problem building the _curses or _io modules on recent versions of Cygwin (>=2.9) and with current cpython master (3.9.0a0).

----------
nosy: +erik.bray

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9665>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:50:16 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 11:50:16 +0000
Subject: [issue31829] Portability issues with pickle
In-Reply-To: <1508521289.37.0.213398074469.issue31829@psf.upfronthosting.co.za>
Message-ID: <1560340216.83.0.837427453597.issue31829@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d561f848b235f2011a43b705d112055b92fa2366 by Miss Islington (bot) in branch '3.7':
bpo-31829: Make protocol 0 pickles be loadable in text mode in Python 2. (GH-11859)
https://github.com/python/cpython/commit/d561f848b235f2011a43b705d112055b92fa2366


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31829>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:57:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:57:02 +0000
Subject: [issue37245] Azure Pipeline: sick macOS job on Python 3.8?
Message-ID: <1560340622.3.0.842050597369.issue37245@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

I backported a change to 3.8:
https://github.com/python/cpython/pull/14000

The macOS job of Azure Pipelines failed badly:
https://dev.azure.com/Python/cpython/_build/results?buildId=45071&view=results

* test_importlib/test_locks.py: test_deadlock() => TIMEOUT
* test_multiprocessing_spawn: test_thread_safety() => TIMEOUT
* test_concurrent_futures: test_pending_calls_race() => TIMEOUT
* test_functools: test_threaded() => TIMEOUT
* test_multiprocessing_forkserver: test_thread_safety() => TIMEOUT
* test_threading: test_is_alive_after_fork() => TIMEOUT



0:20:21 load avg: 4.55 [155/423/1] test_importlib crashed (Exit code 1) -- running: test_concurrent_futures (16 min 12 sec), test_functools (13 min 30 sec), test_multiprocessing_spawn (18 min 51 sec)
Timeout (0:20:00)!
Thread 0x0000700004627000 (most recent call first):

Thread 0x00007fff96f1a380 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/lock_tests.py", line 49 in __init__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/test_importlib/test_locks.py", line 84 in run_deadlock_avoidance_test
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/test_importlib/test_locks.py", line 89 in test_deadlock
  ...

0:21:30 load avg: 4.76 [160/423/2] test_multiprocessing_spawn crashed (Exit code 1) -- running: test_concurrent_futures (17 min 21 sec), test_functools (14 min 39 sec), test_threading (35 sec 923 ms)
Timeout (0:20:00)!
Thread 0x0000700000ff1000 (most recent call first):

Thread 0x00007fff96f1a380 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 847 in start
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 2299 in start_threads
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/contextlib.py", line 113 in __enter__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/_test_multiprocessing.py", line 4138 in test_thread_safety
  ...

0:24:09 load avg: 4.11 [207/423/3] test_concurrent_futures crashed (Exit code 1) -- running: test_functools (17 min 18 sec), test_timeout (34 sec 14 ms), test_threading (3 min 14 sec)
Timeout (0:20:00)!
Thread 0x0000700006644000 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/thread.py", line 78 in _worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 865 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 923 in _bootstrap_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 885 in _bootstrap

Thread 0x0000700006141000 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/thread.py", line 78 in _worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 865 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 923 in _bootstrap_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 885 in _bootstrap

Thread 0x0000700005c3e000 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/thread.py", line 78 in _worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 865 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 923 in _bootstrap_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 885 in _bootstrap

Thread 0x000070000573b000 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/thread.py", line 78 in _worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 865 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 923 in _bootstrap_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 885 in _bootstrap

Thread 0x0000700005238000 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/thread.py", line 78 in _worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 865 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 923 in _bootstrap_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 885 in _bootstrap

Thread 0x00007fff96f1a380 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/setup.py", line 92 in _test_audit_hook
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/_base.py", line 146 in __init__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/concurrent/futures/_base.py", line 288 in wait
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/test_concurrent_futures.py", line 565 in test_pending_calls_race
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/case.py", line 628 in _callTestMethod
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/case.py", line 671 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/case.py", line 731 in __call__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 122 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 84 in __call__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 122 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 84 in __call__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 122 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/suite.py", line 84 in __call__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/unittest/runner.py", line 176 in run
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 1984 in _run_suite
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 2080 in run_unittest
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/test_concurrent_futures.py", line 1300 in test_main
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 2212 in decorator
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/runtest.py", line 228 in _runtest_inner2
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/runtest.py", line 264 in _runtest_inner
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/runtest.py", line 135 in _runtest
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/runtest.py", line 187 in runtest
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/runtest_mp.py", line 66 in run_tests_worker
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/main.py", line 611 in _main
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/main.py", line 588 in main
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/libregrtest/main.py", line 663 in main
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/regrtest.py", line 46 in _main
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/regrtest.py", line 50 in <module>
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/runpy.py", line 85 in _run_code
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/runpy.py", line 192 in _run_module_as_main

0:26:51 load avg: 5.14 [259/423/4] test_functools crashed (Exit code 1) -- running: test_io (1 min 11 sec), test_threading (5 min 56 sec)
Timeout (0:20:00)!
Thread 0x000070000666f000 (most recent call first):

Thread 0x00007fff96f1a380 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 847 in start
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 2299 in start_threads
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/contextlib.py", line 113 in __enter__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/test_functools.py", line 2464 in test_threaded
...
0:47:26 load avg: 1.71 [423/423/6] test_multiprocessing_forkserver crashed (Exit code 1)
Timeout (0:20:00)!
Thread 0x0000700009471000 (most recent call first):

Thread 0x00007fff96f1a380 (most recent call first):
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 246 in __enter__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 555 in wait
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/threading.py", line 852 in start
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/support/__init__.py", line 2299 in start_threads
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/contextlib.py", line 113 in __enter__
  File "/Users/vsts/agent/2.152.1/work/1/s/Lib/test/_test_multiprocessing.py", line 4138 in test_thread_safety
...

6 tests failed:
    test_concurrent_futures test_functools test_importlib
    test_multiprocessing_forkserver test_multiprocessing_spawn
    test_threading


--

pythoninfo:

2019-06-12T02:45:41.9759180Z Py_DEBUG: Yes (sys.gettotalrefcount() present)
2019-06-12T02:45:41.9784500Z datetime.datetime.now: 2019-06-12 02:45:40.875495
2019-06-12T02:45:41.9806170Z platform.architecture: 64bit
2019-06-12T02:45:41.9797810Z os.environ[MACOSX_DEPLOYMENT_TARGET]: 10.13
2019-06-12T02:45:41.9806990Z platform.platform: macOS-10.13.6-x86_64-i386-64bit
2019-06-12T02:45:41.9801150Z os.login: _spotlight
2019-06-12T02:45:41.9817220Z socket.hostname: Mac-483.local
2019-06-12T02:45:41.9835490Z sys.version: 3.8.0b1+ (remotes/pull/14000/merge:ce71235d6, Jun 12 2019, 02:45:09)  [Clang 10.0.0 (clang-1000.11.45.5)]

----------
components: Tests, macOS
messages: 345325
nosy: ned.deily, ronaldoussoren, vstinner
priority: normal
severity: normal
status: open
title: Azure Pipeline: sick macOS job on Python 3.8?
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37245>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:57:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 11:57:58 +0000
Subject: [issue37245] Azure Pipeline: sick macOS job on Python 3.8?
In-Reply-To: <1560340622.3.0.842050597369.issue37245@roundup.psfhosted.org>
Message-ID: <1560340678.09.0.145895608603.issue37245@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

os.uname: posix.uname_result(sysname='Darwin', nodename='Mac-483.local', release='17.7.0', version='Darwin Kernel Version 17.7.0: Wed Apr 24 21:17:24 PDT 2019; root:xnu-4570.71.45~1/RELEASE_X86_64', machine='x86_64')

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37245>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:59:44 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 11:59:44 +0000
Subject: [issue37246] http.cookiejar.DefaultCookiePolicy should use current
 timestamp instead of last updated timestamp value for checking expiry
Message-ID: <1560340784.82.0.908352351929.issue37246@roundup.psfhosted.org>


New submission from Karthikeyan Singaravelan <tir.karthi at gmail.com>:

In http.cookiejar module's DefaultCookiePolicy checking for cookie expiry uses the last updated value for _now [0] which is in three actions below. So if the cookies are extracted using the policy and the policy is used for expiry check later it could give incorrect values for expiry check. Like in below example I create a cookie with 1 second from now as expiry date. Sleeping for 1 second and using the same policy causing is_expired to work correctly but return_ok uses self._now with the older value returning the cookie. I propose using time.time() and update self._now or to change cookie.is_expired(self._now) to cookie.is_expired() where is_expired uses time.time() internally

I think it's better to use the current time while using return_ok to compare the cookie expiry. One another error is that self._now is set only when one of the methods is called so evaluating a new policy against a cookie with expiry causes AttributeError since self._now is not yet set.

Actions where self._now is updated

* add_cookie_header
* extract_cookies
* set_cookie_if_ok

import time
from http.cookiejar import CookieJar, DefaultCookiePolicy, time2netscape
from test.test_http_cookiejar import FakeResponse
from urllib.request import Request

delay = 1
now = time.time() + delay
future = time2netscape(now)

req = Request("https://example.com")

headers = [f"Set-Cookie: a=b; expires={future};"]
res = FakeResponse(headers, "https://example.com/")

policy = DefaultCookiePolicy()
jar = CookieJar(policy=policy)
jar.extract_cookies(res, req)
cookie = jar.make_cookies(res, req)[0]

print(f"{cookie.expires = }")
print(f"{policy.return_ok(cookie, req) = }")

time.sleep(delay + 1)

# Check for cookie expiry where is_expired() returns true
print(f"Current time : {int(time.time())}")
print(f"{cookie.is_expired() = }") # is_expired uses current timestamp so it returns True
print(f"{policy.return_ok(cookie, req) = }") # Return now uses older timestamp and still returns the cookie as valid cookie

# Output

cookie.expires = 1560339939
policy.return_ok(cookie, req) = True
Current time : 1560339940
cookie.is_expired() = True
policy.return_ok(cookie, req) = True

# Using above cookie variable against a new policy would throw AttributeError since self._now is not yet set

req = Request("https://example.com")
policy1 = DefaultCookiePolicy()
print(policy1.return_ok(cookie, req))

# Output

Traceback (most recent call last):
  File "/tmp/bar.py", line 31, in <module>
    print(policy1.return_ok(cookie, req))
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/http/cookiejar.py", line 1096, in return_ok
    if not fn(cookie, request):
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/http/cookiejar.py", line 1128, in return_ok_expires
    if cookie.is_expired(self._now):
AttributeError: 'DefaultCookiePolicy' object has no attribute '_now'


[0] https://github.com/python/cpython/blob/a6e190e94b47324f14e22a09200c68b722d55699/Lib/http/cookiejar.py#L1128

----------
components: Library (Lib)
messages: 345327
nosy: martin.panter, orsenthil, serhiy.storchaka, xtreak
priority: normal
severity: normal
status: open
title: http.cookiejar.DefaultCookiePolicy should use current timestamp instead of last updated timestamp value for checking expiry
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37246>
_______________________________________

From report at bugs.python.org  Wed Jun 12 07:59:49 2019
From: report at bugs.python.org (Alejandro Gonzalez)
Date: Wed, 12 Jun 2019 11:59:49 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560340789.92.0.241857511785.issue28869@roundup.psfhosted.org>


Alejandro Gonzalez <alejandrojgt at gmail.com> added the comment:

>I think we can proceed with option A, but only if doesn't cause visible slow-down for creating ABCs (which is already slower that normal classes). TBH, I don't want to document A as "official" recipe (maybe however mention the problem in the `pickle` module docs).

I'll try using the same approach used in namedtuple, and see if there is any visible slow-down.

Regarding the documentation, I see your point. Perhaps adding some section like "Notes on pickling dynamically-defined classes" in the `pickle` module would be more appropriate? That section would mention that you have to make sure to set the `__module__` attribute.

>Note that other "class factories" in stdlib (like collections.namedtuple) do almost exactly option A.

Thanks for the tip. Indeed it does. In fact, the API defines a module argument. Its documentation could be improved, though. It should mention why would you want to pass that argument (pickling seems to be the reason that argument was added in the first place).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:01:17 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 12:01:17 +0000
Subject: [issue35545] asyncio.base_events.create_connection doesn't handle
 scoped IPv6 addresses
In-Reply-To: <1545303410.27.0.788709270274.issue35545@psf.upfronthosting.co.za>
Message-ID: <1560340877.81.0.369105801475.issue35545@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 32dda263e4e8c8e0fadc2bb29b9856e2f177dde9 by Miss Islington (bot) (Michael Felt) in branch 'master':
bpo-35545: Skip `test_asyncio.test_create_connection_ipv6_scope` on AIX (GH-14011)
https://github.com/python/cpython/commit/32dda263e4e8c8e0fadc2bb29b9856e2f177dde9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35545>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:01:27 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 12:01:27 +0000
Subject: [issue35545] asyncio.base_events.create_connection doesn't handle
 scoped IPv6 addresses
In-Reply-To: <1545303410.27.0.788709270274.issue35545@psf.upfronthosting.co.za>
Message-ID: <1560340887.68.0.285865401266.issue35545@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13876
pull_request: https://github.com/python/cpython/pull/14012

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35545>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:11:36 2019
From: report at bugs.python.org (Jeroen van den Hout)
Date: Wed, 12 Jun 2019 12:11:36 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
Message-ID: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>


New submission from Jeroen van den Hout <jlvandenhout at gmail.com>:

Currently when building an extension which lists a SWIG interface (.i) file as a source file, SWIG creates the files correctly in the build_ext command. Unfortunately this command is run after the build_py command, so the python files (.py) created in the build_ext command are never copied to the installation.
To fix this, swap build_ext and build_py commands in the sub_commands attribute of the build command.

----------
components: Distutils
messages: 345330
nosy: Jeroen van den Hout, dstufft, eric.araujo
priority: normal
severity: normal
status: open
title: swap distutils build_ext and build_py commands to allow proper SWIG extension installation
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:15:53 2019
From: report at bugs.python.org (Shen Han)
Date: Wed, 12 Jun 2019 12:15:53 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
Message-ID: <1560341753.77.0.566490049047.issue37248@roundup.psfhosted.org>


Change by Shen Han <shawnhan1029 at gmail.com>:


----------
components: 2to3 (2.x to 3.x conversion tool)
nosy: Shen Han
priority: normal
severity: normal
status: open
title: support conversion of `func(**{} if a else b)`
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:18:56 2019
From: report at bugs.python.org (Erik Bray)
Date: Wed, 12 Jun 2019 12:18:56 +0000
Subject: [issue28459] _pyio module broken on Cygwin / setmode not usable
In-Reply-To: <1476701892.4.0.598393414511.issue28459@psf.upfronthosting.co.za>
Message-ID: <1560341936.27.0.356165996129.issue28459@roundup.psfhosted.org>


Change by Erik Bray <erik.m.bray at gmail.com>:


----------
pull_requests: +13877
pull_request: https://github.com/python/cpython/pull/14013

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28459>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:20:16 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 12:20:16 +0000
Subject: [issue35545] asyncio.base_events.create_connection doesn't handle
 scoped IPv6 addresses
In-Reply-To: <1545303410.27.0.788709270274.issue35545@psf.upfronthosting.co.za>
Message-ID: <1560342016.2.0.796960018331.issue35545@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 70a4178ec47154fdcc3ff06c13149e178d014581 by Miss Islington (bot) in branch '3.8':
bpo-35545: Skip `test_asyncio.test_create_connection_ipv6_scope` on AIX (GH-14011)
https://github.com/python/cpython/commit/70a4178ec47154fdcc3ff06c13149e178d014581


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35545>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:20:53 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 12 Jun 2019 12:20:53 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560342053.91.0.488564901994.issue28869@roundup.psfhosted.org>


Ivan Levkivskyi <levkivskyi at gmail.com> added the comment:

> Perhaps adding some section like "Notes on pickling dynamically-defined classes" in the `pickle` module would be more appropriate?

I think just a note with few sentences would be enough.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:20:54 2019
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 12 Jun 2019 12:20:54 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560342054.13.0.978891913489.issue37247@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +13878
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14014

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:36:15 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 12:36:15 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560342975.58.0.620447361379.issue37247@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> SWIG creates the files correctly in the build_ext command

One could argue that running SWIG should be an entirely different step, not part of build_ext.

I'm afraid that your idea of swapping build_ext and build_py will be rejected because it has a high chance of breaking stuff: we have always done build_py before build_ext and packages probably rely on this order.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:37:54 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 12:37:54 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560343074.52.0.155719144624.issue37221@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

I think that the PyCode_New() compatibility problem and tp_print are sufficiently closely related that they can be discussed together.

In any case, I agree that it makes little sense to fix just one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:49:12 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 12:49:12 +0000
Subject: [issue26110] Speedup method calls 1.2x
In-Reply-To: <1452791347.05.0.923215900831.issue26110@psf.upfronthosting.co.za>
Message-ID: <1560343752.57.0.154615087679.issue26110@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Note that this idea has been generalized by PEP 590: any type can support this optimization by setting the Py_TPFLAGS_METHOD_DESCRIPTOR flag.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26110>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:54:43 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 12:54:43 +0000
Subject: [issue37249] Missing declaration of _PyObject_GetMethod
Message-ID: <1560344083.09.0.0843105430865.issue37249@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

The function _PyObject_GetMethod is internal and private, but it should still be declared properly. Currently, it is "manually" declared in two .c files where it's used.

----------
components: Interpreter Core
messages: 345336
nosy: jdemeyer
priority: normal
severity: normal
status: open
title: Missing declaration of _PyObject_GetMethod
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37249>
_______________________________________

From report at bugs.python.org  Wed Jun 12 08:55:40 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 12:55:40 +0000
Subject: [issue37249] Missing declaration of _PyObject_GetMethod
In-Reply-To: <1560344083.09.0.0843105430865.issue37249@roundup.psfhosted.org>
Message-ID: <1560344140.31.0.117848019967.issue37249@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
nosy: +yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37249>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:00:22 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:00:22 +0000
Subject: [issue37249] Missing declaration of _PyObject_GetMethod
In-Reply-To: <1560344083.09.0.0843105430865.issue37249@roundup.psfhosted.org>
Message-ID: <1560344422.86.0.733574961655.issue37249@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13879
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14015

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37249>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:08:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:08:30 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL
Message-ID: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Copy of Stefan Behnel's msg345305 in bpo-37221:
"""
Note that PyCode_New() is not the only change in 3.8 beta1 that breaks Cython generated code. The renaming of "tp_print" to "tp_vectorcall" is equally disruptive, because Cython has (or had) a work-around for CPython (mis-)behaviour that reset the field explicitly to NULL after calling PyType_Ready(), which could set it arbitrarily without good reason.

So, either revert that field renaming, too, or ignore Cython generated modules for the reasoning about the change in this ticket.

I'm fine with keeping things as they are now in beta-1, but we could obviously adapt to whatever beta-2 wants to change again.
"""

There are 2 problems:

* source compatibility
* ABI compatibility

The following change removed PyTypeObject.tp_print and replaced it with PyTypeObject.tp_vectorcall_offset:

commit aacc77fbd77640a8f03638216fa09372cc21673d
Author: Jeroen Demeyer <J.Demeyer at UGent.be>
Date:   Wed May 29 20:31:52 2019 +0200

    bpo-36974: implement PEP 590 (GH-13185)
    
    
    Co-authored-by: Jeroen Demeyer <J.Demeyer at UGent.be>
    Co-authored-by: Mark Shannon <mark at hotpy.org>


== ABI compatibility ==

In term of ABI, it means that C extensions using static type ("static PyTypeObject mytype = { .... };") is broken by this change.

Honestly, I'm not sure if we ever provided any forward compatibility for static types. bpo-32388 removed "cross-version binary compatibility" on purpose in Python 3.8. It's an on-going topic, see also my notes about ABI and PyTypeObject:
https://pythoncapi.readthedocs.io/type_object.html

Maybe we can simply ignore this part of the problem.


== Source compatibility ==

Cython generates C code setting tp_print explicitly to NULL.

To avoid depending on Cython at installation, most (if not all) projects using Cython include C files generated by Cython in files they distribute (like tarballs). Because of that, the commit aacc77fbd77640a8f03638216fa09372cc21673d requires all these projects to regenerate their C files using Cython.

In Fedora, we fixed many Python packages to always re-run Cython to regenerate all C files. But Fedora is just one way to distribute packages, it doesn't solve the problem of files distributed on PyPI, nor other Linux distribution (for example).

Jeroen Demeyer proposed PR 14009 to fix the source compatibility:

   #define tp_print tp_vectorcall

----------
components: Interpreter Core
messages: 345337
nosy: vstinner
priority: normal
severity: normal
status: open
title: C files generated by Cython set tp_print to NULL
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:09:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:09:45 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1560344985.75.0.470308822392.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Jeroen Demeyer:
> I think that the PyCode_New() compatibility problem and tp_print are sufficiently closely related that they can be discussed together.

IMHO these problems are different enough to justify to have a separated issue: I created https://bugs.python.org/issue37250 Please discuss tp_print issue there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:10:01 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:10:01 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345001.15.0.154217933503.issue37250@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13880
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14009

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:11:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:11:22 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345082.54.0.181234391083.issue37250@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: C files generated by Cython set tp_print to NULL -> C files generated by Cython set tp_print to NULL: PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:11:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:11:44 +0000
Subject: [issue32388] Remove cross-version binary compatibility
In-Reply-To: <1513790879.02.0.213398074469.issue32388@psf.upfronthosting.co.za>
Message-ID: <1560345104.26.0.0843423800085.issue32388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

About ABI "foward compatibility", Python 3.8 introduced another backward incompatible change: bpo-37250 "C files generated by Cython set tp_print to NULL: PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32388>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:17:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:17:33 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345453.67.0.201884543438.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

"printfunc tp_print;" has been replaced with "Py_ssize_t tp_vectorcall_offset;": the type was basically a pointer and has been replaced with an integer.

With "#define tp_print tp_vectorcall", "type->tp_print = NULL;" becomes "type->tp_vectorcall = NULL;".

If -Werror is used, "type->tp_vectorcall = NULL;" would fail with a compilation error, since NULL is not exactly an integer, no? I'm not sure that it's an issue, I'm just thinking aloud.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:20:35 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:20:35 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345635.23.0.365900817823.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Actually, Cython generates code setting tp_print to 0 (not NULL).

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:21:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:21:45 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345705.45.0.95611792855.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

inherit_slots() uses:

        /* Inherit tp_vectorcall_offset only if tp_call is not overridden */
        if (!type->tp_call) {
            COPYSLOT(tp_vectorcall_offset);
        }

PyType_Ready() contains the following assertion:

    /* Consistency checks for PEP 590:
     * - Py_TPFLAGS_METHOD_DESCRIPTOR requires tp_descr_get
     * - _Py_TPFLAGS_HAVE_VECTORCALL requires tp_call and
     *   tp_vectorcall_offset > 0
     * To avoid mistakes, we require this before inheriting.
     */
    if (type->tp_flags & Py_TPFLAGS_METHOD_DESCRIPTOR) {
        _PyObject_ASSERT((PyObject *)type, type->tp_descr_get != NULL);
    }
    if (type->tp_flags & _Py_TPFLAGS_HAVE_VECTORCALL) {
        _PyObject_ASSERT((PyObject *)type, type->tp_vectorcall_offset > 0);
        _PyObject_ASSERT((PyObject *)type, type->tp_call != NULL);
    }

I understand that tp_vectorcall_offset=0 is fine and the expected value for a type which doesn't have the flag _Py_TPFLAGS_HAVE_VECTORCALL.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:24:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:24:21 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345861.7.0.756637759891.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

IMHO the simplest and safest option for this issue is to revert tp_print removal and move tp_vectorcall_offset at the end of PyTypeObject.

Is PEP 590 fully public in Python 3.8? It seems like _Py_TPFLAGS_HAVE_VECTORCALL at least is private.

Maybe we can attempt again to remove tp_print from Python 3.9? Once Cython will handle tp_print removal? Or even keep it in Python 3.9?

Python 3 had unused tp_print for 10 years and nobody complained. There are a few PyTypeObject instances in a Python process. A single pointer isn't a giant waste of memory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:24:33 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:24:33 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345873.46.0.411778736938.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If -Werror is used, "type->tp_vectorcall = NULL;" would fail with a compilation error, since NULL is not exactly an integer, no?

No because tp_vectorcall is a function pointer. You're confusing with tp_vectorcall_offset which is an integer.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:26:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:26:27 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560345987.99.0.498971238697.issue37250@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +petr.viktorin, scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:28:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:28:12 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346092.35.0.79273288174.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> No because tp_vectorcall is a function pointer. You're confusing with tp_vectorcall_offset which is an integer.

Oh. I didn't notice that your PR makes tp_print an alias to tp_vectorcall rather than tp_vectorcall_offset. Ok.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:29:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:29:19 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346159.58.0.364100952989.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If we decide to not reintroduce tp_print, tp_print removal must be documented at:
https://docs.python.org/dev/whatsnew/3.8.html#changes-in-the-c-api

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:31:05 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:31:05 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346265.69.0.13493999676.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> I understand that tp_vectorcall_offset=0 is fine and the expected value for a type which doesn't have the flag _Py_TPFLAGS_HAVE_VECTORCALL.

Not necessarily. There are subtleties involved when subclassing: there are cases where tp_vectorcall_offset needs to be non-zero despite _Py_TPFLAGS_HAVE_VECTORCALL not being set. See also PR 13858.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:32:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:32:33 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346353.54.0.678326142177.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Cython issue: https://github.com/cython/cython/issues/2976

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:35:00 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:35:00 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346500.54.0.530328086654.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> IMHO the simplest and safest option for this issue is to revert tp_print removal and move tp_vectorcall_offset at the end of PyTypeObject.

That's a drastic solution to a rather simple problem. PR 14009 would fix Cython just fine.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:36:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:36:43 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346603.05.0.916903315017.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

me:
> I understand that tp_vectorcall_offset=0 is fine and the expected value for a type which doesn't have the flag _Py_TPFLAGS_HAVE_VECTORCALL.

Jeroen Demeyer:
> Not necessarily. There are subtleties involved when subclassing: there are cases where tp_vectorcall_offset needs to be non-zero despite _Py_TPFLAGS_HAVE_VECTORCALL not being set. See also PR 13858.

Cython generates C code which looks like:

if (PyType_Ready(type) < 0) { ... handle error ... }
type->tp_print = 0;

This code can cause subtle and annoying issue if PR 13858 is merged. So that's another argument in favor of reintroducing tp_print in Python 3.8.

--

Cython has already been fixed to no longer set tp_print to 0 on Python 3.8:

https://github.com/cython/cython/commit/f10a0a391edef10bd37095af87f521808cb362f7

But again, this problem is not about correctness, but more about practical backward compatibility issues (see my first message).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:38:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:38:09 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346689.93.0.206524908712.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

https://github.com/cython/cython/commit/f10a0a391edef10bd37095af87f521808cb362f7

Note for myself: this fix is already part of Cython 0.29.10 released at June 2 (10 days ago).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:39:49 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:39:49 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346789.83.0.039104558743.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> This code can cause subtle and annoying issue if PR 13858 is merged.

I don't see how this is related to PR 13858 at all. Please explain.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:40:21 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:40:21 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346821.8.0.873068536505.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If we decide to not reintroduce tp_print, tp_print removal must be documented at:
https://docs.python.org/dev/whatsnew/3.8.html#changes-in-the-c-api

I'll add that to PR 13844.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:40:47 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 12 Jun 2019 13:40:47 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
Message-ID: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

Please, can you add some text with an explanation ?

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:41:43 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:41:43 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560346903.33.0.866737332391.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> This code can cause subtle and annoying issue if PR 13858 is merged.

Or maybe you're confusing tp_vectorcall_offset and tp_vectorcall again?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:47:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 13:47:35 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560347255.02.0.420166742386.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Or maybe you're confusing tp_vectorcall_offset and tp_vectorcall again?

The two are related, no?

Honestly, reintroducing tp_print looks simple and safe enough. I'm in favor of doing that. Is there any drawback? (as I wrote, I don't think that the size of PyTypeObject really matters in practice)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 09:57:36 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 13:57:36 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560347856.83.0.742319874315.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Honestly, reintroducing tp_print looks simple and safe enough. Is there any drawback?

1. The one-time effort to change the code and documentation back.

2. Stefan Behnel wanted to use tp_print for backporting vectorcall in Cython to earlier Python versions.

3. Stable ABI incompatibility (the complaint that you incorrectly added to PR 13858 would become correct).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:00:18 2019
From: report at bugs.python.org (Jeremy Cline)
Date: Wed, 12 Jun 2019 14:00:18 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
Message-ID: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>


New submission from Jeremy Cline <jeremy at jcline.org>:

This is related to the new AsyncMock[0] class in Python 3.8b1. A simple reproducer is:

from unittest import mock

mock_obj = mock.MagicMock()
mock_obj.mock_func = mock.MagicMock(spec=lambda x: x)

with mock.patch.object(mock_obj, "mock_func") as nested:
    print(type(nested))


Instead of a MagicMock (the behavior in Python 3.7) in Python 3.8b1 this results in an AsyncMock.

[0]https://github.com/python/cpython/pull/9296

----------
components: Library (Lib)
messages: 345358
nosy: jcline
priority: normal
severity: normal
status: open
title: Mocking a MagicMock with a function spec results in an AsyncMock
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:00:18 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 12 Jun 2019 14:00:18 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560348018.7.0.675466224445.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> The two are related, no?

Related in the same way that tp_dictoffset and tp_dict are related (i.e. not that much).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:02:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 14:02:18 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560348138.08.0.359770862259.issue37210@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

FYI pyperformance is affected by this issue:

vstinner at apu$ env/bin/python ~/prog/python/pyperformance/pyperformance/benchmarks/bm_pickle.py unpickle --pure-python -v -p3  
Traceback (most recent call last):
  File "/home/vstinner/prog/python/pyperformance/pyperformance/benchmarks/bm_pickle.py", line 287, in <module>
    import pickle
  File "/home/vstinner/prog/python/master/Lib/pickle.py", line 39, in <module>
    from _pickle import PickleBuffer
ModuleNotFoundError: import of _pickle halted; None in sys.modules

It is no longer possible to benchmark the pure Python implement of pickle.

--pure-python uses this code path:

def is_module_accelerated(module):
    return getattr(pickle.Pickler, '__module__', '<jython>') == 'pickle'

(...)

        if six.PY3:
            sys.modules['_pickle'] = None
        import pickle
        if not is_module_accelerated(pickle):
            raise RuntimeError("Unexpected C accelerators for pickle")

Should I remove the benchmark?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:06:24 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 14:06:24 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560348384.5.0.685760543063.issue37251@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +lisroach, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:11:26 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 14:11:26 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560348686.56.0.812341975961.issue37248@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

>From the title is this similar to the PR https://github.com/python/cpython/pull/12703

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:11:44 2019
From: report at bugs.python.org (Mario Corchero)
Date: Wed, 12 Jun 2019 14:11:44 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560348704.02.0.690702241872.issue37251@roundup.psfhosted.org>


Change by Mario Corchero <mariocj89 at gmail.com>:


----------
nosy: +mariocj89

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:12:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 14:12:12 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560348732.65.0.931375779335.issue37210@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13881
pull_request: https://github.com/python/cpython/pull/14016

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:13:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 14:13:04 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560348784.93.0.642363751131.issue37210@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote a simple PR, PR 14016, to fix the pure Python implementation of pickle: simply restrict pickle to protocol 4 if PickleBuffer is missing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:13:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 14:13:10 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560348790.39.0.625572608747.issue37210@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution: wont fix -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:13:23 2019
From: report at bugs.python.org (Cooper Lees)
Date: Wed, 12 Jun 2019 14:13:23 +0000
Subject: [issue34058] Default Python 3.7 install broken on openSUSE Leap 42.3:
 $PYTHONHOME/lib64/python3.7/lib-dynload/ not linked to
 $PYTHONHOME/lib/python3.7/lib-dynload/
In-Reply-To: <1530838420.77.0.56676864532.issue34058@psf.upfronthosting.co.za>
Message-ID: <1560348803.46.0.981476204296.issue34058@roundup.psfhosted.org>


Cooper Lees <me at cooperlees.com> added the comment:

I also have the same problem with _socket that was Fixed on the latest version of CentOS 7 building with gcc 4.8.5.

Adding:
sudo ln -s /usr/local/lib64/python3.7/lib-dynload/ /usr/local/lib/python3.7/lib-dynload

Allowed the .so to be found and the import to work.

----------
nosy: +cooperlees

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34058>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:17:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 14:17:16 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560349036.92.0.670186153308.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset b2fd32b2f041402bb9fc8607f01566c055aafed9 by Victor Stinner in branch '3.8':
bpo-35766: compile(): rename feature_version parameter (GH-13994) (GH-14001)
https://github.com/python/cpython/commit/b2fd32b2f041402bb9fc8607f01566c055aafed9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:20:14 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 12 Jun 2019 14:20:14 +0000
Subject: [issue37252] devpoll test failures on Solaris
Message-ID: <1560349214.7.0.192767880732.issue37252@roundup.psfhosted.org>


New submission from Jakub Kulik <kulikjak at gmail.com>:

test_devpoll currently ends with two failures with Python 3.8 on Solaris.

First one is wrong number of arguments to devpoll.register function (which thrown the same error as expected in 3.7 but now acts differently).

Second one is that register and modify no longer throw OverflowError when negative number is given as second argument, but rather a ValueError. I am not sure whether this is just a small semantics change or some bigger problem (documentation doesn't mention what error should be thrown).

So I fixed it in attached pull request by changing the expected thrown error but there might be other problem as well.

----------
components: Extension Modules
messages: 345365
nosy: kulikjak
priority: normal
severity: normal
status: open
title: devpoll test failures on Solaris
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37252>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:21:52 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 12 Jun 2019 14:21:52 +0000
Subject: [issue37252] devpoll test failures on Solaris
In-Reply-To: <1560349214.7.0.192767880732.issue37252@roundup.psfhosted.org>
Message-ID: <1560349312.95.0.688803081732.issue37252@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
keywords: +patch
pull_requests: +13882
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14017

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37252>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:30:21 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 14:30:21 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1560349036.92.0.670186153308.issue35766@roundup.psfhosted.org>
Message-ID: <CAP7+vJJDVvykp917Pmx4CqPKm4BY6DibfLkrV5+LLdfpN+fp4g@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Thanks for taking care of this!
-- 
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Wed Jun 12 10:35:13 2019
From: report at bugs.python.org (Erik Bray)
Date: Wed, 12 Jun 2019 14:35:13 +0000
Subject: [issue35066] Inconsistency between dangling '%' handling in
 time.strftime() and datetime.strftime()
In-Reply-To: <1540478010.12.0.788709270274.issue35066@psf.upfronthosting.co.za>
Message-ID: <1560350113.85.0.703026867764.issue35066@roundup.psfhosted.org>


Erik Bray <erik.m.bray at gmail.com> added the comment:

FWIW (unsurprisingly) the new test added here is broken on Cygwin, whose libc's (newlib) behavior in this undefined case.  So I get:

>>> from datetime import date
>>> t = date(2005, 1, 1)
>>> t.strftime("%Y")  # ok
'2005'
>>> t.strftime("%%")  # ok
'%'
>>> t.strftime("%")  # undefined behavior
''
>>> t.strftime("%Y %")  # undefined behavior; discards the whole format string
''
>>> t.strftime("%Y%Q")  # undefined format; discards the whole format string
''

This behavior is user-hostile I think; it should raise a ValueError instead of just return an empty string.  I would have suggested the same for the trailing '%' case, though I understand the goal of this issue was consistency.

Also worth noting that both before and after this patch:

>>> import time
>>> time.strftime('%')
''

So the question of consistency between the interfaces, which was the main point of this issue, was already resolved in this case, and the *inconsistency* observed was dependent on system-dependent behavior.

For now I might propose doing away with this test in its current form, and just test

assert t.strftime('%') == time.strftime('%')

or something like that.

I agree with Victor that trying to make the strftime experience consistent across system-dependent quirks is a worthy goal, but that goes deeper than just this trailing '%' case.

----------
nosy: +erik.bray

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35066>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:05:33 2019
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Wed, 12 Jun 2019 15:05:33 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560351933.32.0.611822218751.issue37251@roundup.psfhosted.org>


Change by Miro Hron?ok <miro at hroncok.cz>:


----------
nosy: +hroncok

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:15:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:15:01 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
Message-ID: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The commit dcfcd146f8e6fc5c2fc16a4c192a0c5f5ca8c53c of bpo-35766 added a new cf_feature_version field to PyCompilerFlags. Each PyCompilerFlags variable must properly initialize this new field to PY_MINOR_VERSION. I propose to add a new _PyCompilerFlags_INIT macro to statically initialize such variable. I'm not sure if it should be public or not.

The PyCompilerFlags structure is excluded from the stable ABI (PEP 384), but it's documented in the "The Very High Level Layer" C API documentation:
https://docs.python.org/dev/c-api/veryhigh.html#c.PyCompilerFlags

Structure fields are documented there:

struct PyCompilerFlags {
    int cf_flags;
}

The doc is outdated. I'm not sure if it's on purpose or not.

Moreover, the new PyCompilerFlags.cf_feature_version field is not documented in https://docs.python.org/dev/whatsnew/3.8.html#changes-in-the-c-api whereas C extensions using PyCompilerFlags should initialize cf_feature_version to PY_MINOR_VERSION?

I'm not sure if C extensions really *must* initialize cf_feature_version, since the field is only used if PyCF_ONLY_AST flag is set in the cf_flags field.

Something else, ast.parse() has been modified to use a (major, minor) version tuple rather an integer to specify the Python version in feature_version, but PyCompilerFlags still only uses the minor major. This API will be broken once the Python major version will be increased to 4, no? Would it make sense to use PY_VERSION_HEX format which includes the major version instead?

Or cf_feature_version could be a structure with major and minor fields, but that might be overkill?

----------
components: Interpreter Core
messages: 345368
nosy: vstinner
priority: normal
severity: normal
status: open
title: PyCompilerFlags got a new cf_feature_version field
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:16:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:16:37 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560352597.49.0.327179848378.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13883
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14018

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:18:14 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 15:18:14 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560352694.1.0.536594542137.issue37241@roundup.psfhosted.org>


Jesse Bacon <jessembacon at me.com> added the comment:

I am missing keys, when extracting the data back out with todays NVD pull.
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
~/anaconda3/lib/python3.6/shelve.py in __getitem__(self, key)
    110         try:
--> 111             value = self.cache[key]
    112         except KeyError:

KeyError: 'CVE-2019-1842'

During handling of the above exception, another exception occurred:

KeyError                                  Traceback (most recent call last)
<ipython-input-62-aeb8a14b4774> in <module>
      1 results = []
      2 for x in raw_cves:
----> 3     results.append(db[x])

~/anaconda3/lib/python3.6/shelve.py in __getitem__(self, key)
    111             value = self.cache[key]
    112         except KeyError:
--> 113             f = BytesIO(self.dict[key.encode(self.keyencoding)])
    114             value = Unpickler(f).load()
    115             if self.writeback:

KeyError: b'CVE-2019-1842'

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:24:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:24:09 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560353049.21.0.532711753534.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13884
pull_request: https://github.com/python/cpython/pull/14019

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:24:48 2019
From: report at bugs.python.org (shajianrui)
Date: Wed, 12 Jun 2019 15:24:48 +0000
Subject: [issue37254] POST large file to server (using
 http.server.CGIHTTPRequestHandler), always reset by server.
Message-ID: <1560353088.37.0.536818039185.issue37254@roundup.psfhosted.org>


New submission from shajianrui <shajianrui at 126.com>:

Windows 10, python 3.7 

I met a problem when using the http.server module. I set up a base server with class HTTPServer and CGIHTTPRequestHandler(Not using thread or fork) and tried to POST a large file (>2MB), then I find the server always reset the connection. In some very rare situation the post operation could be finished(Very slow) but the CGI script I'm posting to always show that an incomplete file is received(Called "incomplete file issue").

==========First Try===========

At first I think (Actually a misunderstanding but lead to a passable walkaround) that "self.rfile.read(nbytes) " at LINE 1199 is not blocking, so it finish receiving just before the POST operation finished. Then I modify the line like this below:

1198        if self.command.lower() == "post" and nbytes > 0:
1199            #data = self.rfile.read(nbytes)     ?The original line, I comment out it.?
                databuf = bytearray(nbytes)
                datacount = 0
                while datacount + 1 < nbytes:
                    buf = self.rfile.read(self.request.getsockopt(socket.SOL_SOCKET, socket.SO_RCVBUF)
                    #print("Get " + str(len(buf)) + " bytes.")
                    for i in range(len(buf)):
                        databuf[datacount] = buf[i]
                        datacount += 1
                        if datacount == nbytes:
                            #print("Done.")
                            break
                data = bytes(databuf)       ?Now get the data.?

In this modification I just try to repeatedly read 65536(Default number of socket) bytes from rfile until I get nbytes of bytes. Now it works well(Correct file received), and is much faster then the POSTing process when using the original http.server module(If "incomplete file issue" appear).

==========Second Try==========

However, now I know that there is no problem with "whether it is blocking" because "self.rfile.read()" should be blocked if the file is not POSTed completely. 

I check the tcp stream with wireshark and find that in the middle of the transfer, the recv window of server is always 256, so I think that the problem is at the variable "rbufsize", which is transfered to makefile() when the rfile of the XXXRequestHandler Object is created. At least it is the problem of the low speed. But I dont know whether it lead to the reset operation and the incomplete file issue.

I go back to the original version of the http.server module. Then I make a subclass of socketserver.StreamRequestHandler, override its setup() method(firstly I copy the codes of setup() from StreamRequestHandler, and modify Line770)(770 is the line number in socketserver module, but I create the new subclass in a new file.):

770     #self.rfile = self.connection.makefile('rb', self.rbufsize)
        self.rfile = self.connection.makefile('rb', 65536)

Then the POST process become much faster(Then my first modification)!

But the server print Error:

    File "c:\Users\Administrator\Desktop\cgi-server-test\modified_http_server_bad.py", line 1204, in run_cgi    ?A copy of http.server module?
        while select.select([self.rfile._sock], [], [], 0)[0]:          ?at line 1204?
    AttributeError: '_io.BufferedReader' object has no attribute '_sock'

Because I know it want to get the socket of the current RequestHandler, I just modify http.server module and change "self.rfile._sock" into "self.connection"(I dont know if it would cause problem, it is just a walkaround). 

OK, It now work well again. The CGI script can get the correct file(return the correct SHA1 of the file uploaded), and the POST process is REALLY MUCH FASTER!

========= Question =========

So here is the problem:
1- What cause the server resetting the connection? Seem it is because the default buffer size of the rfile is too small.
2- What cause the cgi script getting the incomplete file? I really have no idea about it. Seems this problem also disappear if I enlarge the buffer.

Other information:
1- The "incomplete file issue" usually appear at the first POST to the server, and almost all of the other POST connections are reset.
2- If the server start resetting connections, another "incomplete file issue" will never appear anymore (Actually it happen, but Chrome only show a RESET page, see 4- below.).
3- If the server start resetting connections, it take a long time to terminate the server with Ctrl+C.
4- When the connection is reset, the response printed by the cgi script is received correctly and it show that cgi script receive an incomplete file, the byte count is much fewer than correct number.(I use Chrome to do the POST, so it just show a reset message and the real response is ignored)

Please help.

----------
components: Library (Lib)
messages: 345370
nosy: shajianrui
priority: normal
severity: normal
status: open
title: POST large file to server (using http.server.CGIHTTPRequestHandler), always reset by server.
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37254>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:25:50 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 15:25:50 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560353150.71.0.375505109206.issue37241@roundup.psfhosted.org>


Change by Jesse Bacon <jessembacon at me.com>:


Added file: https://bugs.python.org/file48413/ShelfKeys.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:32:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:32:16 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560353536.14.0.736516304437.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13885
pull_request: https://github.com/python/cpython/pull/14020

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:34:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:34:00 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560353640.79.0.718084347544.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Something else, ast.parse() has been modified to use a (major, minor) version tuple rather an integer to specify the Python version in feature_version, but PyCompilerFlags still only uses the minor major. This API will be broken once the Python major version will be increased to 4, no? Would it make sense to use PY_VERSION_HEX format which includes the major version instead?

I can work on a PR to change cf_feature_version format, but I would prefer to agree here on what is the best format ;-)

Note: compile() has a private keyword-only _feature_version which is also the Python minor version (int): don't include the major version. If we change cf_feature_version, we may also change compile(_feature_version=N) format.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:34:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:34:26 +0000
Subject: [issue35766] Merge typed_ast back into CPython
In-Reply-To: <1547771581.08.0.389360423635.issue35766@roundup.psfhosted.org>
Message-ID: <1560353666.53.0.811094524813.issue35766@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created bpo-37253: "PyCompilerFlags got a new cf_feature_version field".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35766>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:38:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:38:01 +0000
Subject: [issue37160] thread native id netbsd support
Message-ID: <1560353881.69.0.553442974045.issue37160@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:


New changeset 5287022eeeb3c017d49fc8580b52e18377bf23f3 by Victor Stinner (David Carlier) in branch 'master':
bpo-37160: Thread native ID NetBSD support (GH-13835)
https://github.com/python/cpython/commit/5287022eeeb3c017d49fc8580b52e18377bf23f3


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:38:29 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 15:38:29 +0000
Subject: [issue37160] thread native id netbsd support
In-Reply-To: <1560353881.69.0.553442974045.issue37160@roundup.psfhosted.org>
Message-ID: <1560353909.71.0.424891680535.issue37160@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
pull_requests: +13886
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14021

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun 12 11:39:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 15:39:12 +0000
Subject: [issue37160] thread native id netbsd support
In-Reply-To: <1560353881.69.0.553442974045.issue37160@roundup.psfhosted.org>
Message-ID: <1560353952.7.0.312105811563.issue37160@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Since threading.get_native_id() is a new feature in Python 3.8 and the PR is small enough, IMHO it's fine to backport the change to 3.8.

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:03:28 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 16:03:28 +0000
Subject: [issue37160] thread native id netbsd support
In-Reply-To: <1560353881.69.0.553442974045.issue37160@roundup.psfhosted.org>
Message-ID: <1560355408.18.0.378540234048.issue37160@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c9ca96dd968176580a011e852066c95a48aab7e0 by Miss Islington (bot) in branch '3.8':
bpo-37160: Thread native ID NetBSD support (GH-13835)
https://github.com/python/cpython/commit/c9ca96dd968176580a011e852066c95a48aab7e0


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:12:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 16:12:00 +0000
Subject: [issue37160] thread native id netbsd support
In-Reply-To: <1560353881.69.0.553442974045.issue37160@roundup.psfhosted.org>
Message-ID: <1560355920.28.0.101008746306.issue37160@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks David Carlier! It's now merged into 3.8 and master.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37160>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:14:41 2019
From: report at bugs.python.org (Lisa Roach)
Date: Wed, 12 Jun 2019 16:14:41 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560356081.05.0.876698158261.issue37251@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:

Following up from xtreak's proposal (https://github.com/python/cpython/pull/9296) I think checking if __code__ is actually a CodeType is a good idea. It's simple and doesn't change any other functionality in an unwanted way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:15:33 2019
From: report at bugs.python.org (=?utf-8?q?Carlos_Andr=C3=A9_Dantas_de_Lima?=)
Date: Wed, 12 Jun 2019 16:15:33 +0000
Subject: [issue37176] super() docs don't say what super() does
In-Reply-To: <1559837218.79.0.128349910274.issue37176@roundup.psfhosted.org>
Message-ID: <1560356133.64.0.49098742878.issue37176@roundup.psfhosted.org>


Carlos Andr? Dantas de Lima <eucandre at gmail.com> added the comment:

The method says who you will use some recursion.

----------
nosy: +Carlos Andr? Dantas de Lima

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37176>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:49:14 2019
From: report at bugs.python.org (Andrea Moro)
Date: Wed, 12 Jun 2019 16:49:14 +0000
Subject: [issue37255] Pathlib: Add an expandUserPath method or argument
Message-ID: <1560358154.87.0.642844029976.issue37255@roundup.psfhosted.org>


New submission from Andrea Moro <andrea.moro at rs-components.com>:

Assuming the given path contains a '~' character, it would be nice to have a function to expand the given path so any further calls to an .exists doesn't fail.

A prototype of the function could be

        # Expand the home path in *ix based systems if any
        if '~' in s:
            x = [x for x in Path(s).parts if x not in '~']
            p = Path.home()
            for item in x:
                p = p.joinpath(item)

----------
components: Library (Lib)
messages: 345379
nosy: Andrea Moro
priority: normal
severity: normal
status: open
title: Pathlib: Add an expandUserPath method or argument
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37255>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:54:54 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Wed, 12 Jun 2019 16:54:54 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560358494.97.0.33677329376.issue36607@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:

Note: there's a discussion on GitHub on PR 13971 being a bad solution: https://github.com/python/cpython/pull/13971#issuecomment-500908198

They should be reverted (or fixed forward) for 3.8 and 3.9.  I'm OK with this modifying the AbstractEventLoop API if need be for 3.8.  Just have a PR ready in the next two weeks.

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Wed Jun 12 12:56:44 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 12 Jun 2019 16:56:44 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560358604.64.0.244154444486.issue37241@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

This still isn't an example we can copy and paste to reproduce, so I'm going to be unable to help you. Sorry.

Again: please don't post images, for the reasons I previously stated.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:04:37 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 17:04:37 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560359077.78.0.535383464767.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

"tp_print" has been marked as reserved for all of Python 3. To me, that means deprecated and do not use. (But perhaps that ought to have been properly defined in the docs?)

Cython should not be using this field directly. If all they're doing is setting it to NULL, they can equally easily zero out the entire structure and ignore it without changing behavior on any Python 3.x.

I have no problem changing the names of deprecated/reserved fields in PyTypeObject between releases. Source compatibility guarantees do not extend that far.

----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:06:22 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 17:06:22 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560359182.22.0.651069357769.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Jeroen Demeyer proposed PR 14009 to fix the source compatibility:
>
>   #define tp_print tp_vectorcall

This is a terrible idea, FWIW. Please don't do this.

----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:07:42 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 17:07:42 +0000
Subject: [issue37255] Pathlib: Add an expandUserPath method or argument
In-Reply-To: <1560358154.87.0.642844029976.issue37255@roundup.psfhosted.org>
Message-ID: <1560359262.29.0.910051359616.issue37255@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

There is expanduser :  https://docs.python.org/3/library/pathlib.html#pathlib.Path.expanduser. os.path.expanduser also accepts a path like object. Is this report different from these two functions?

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37255>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:10:51 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Wed, 12 Jun 2019 17:10:51 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560359451.47.0.61157940292.issue37130@roundup.psfhosted.org>


Change by N.P. Khelili <nophke at free.fr>:


----------
keywords: +patch
pull_requests: +13887
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/14022

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:13:29 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Wed, 12 Jun 2019 17:13:29 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560359609.56.0.975633458392.issue37130@roundup.psfhosted.org>


N.P. Khelili <nophke at free.fr> added the comment:

After digging the question,I'd rather go for a minimal change.

- setting .name to '' for '..'
- let it be known in the doc
- special-casing Path('..').stem (to keep the old behaviour)
- update tests

More could be done, but I don't feel like rewriting too much of it.

A global design change should set a special treatment for '..' as well as '.' 

But I'd rather see small steps being accepted than big ones rejected.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:16:46 2019
From: report at bugs.python.org (Andrea Moro)
Date: Wed, 12 Jun 2019 17:16:46 +0000
Subject: [issue37255] Pathlib: Add an expandUserPath method or argument
In-Reply-To: <1560358154.87.0.642844029976.issue37255@roundup.psfhosted.org>
Message-ID: <1560359806.55.0.467767758078.issue37255@roundup.psfhosted.org>


Andrea Moro <andrea.moro at rs-components.com> added the comment:

I have completely missed it. Thanks for flagging it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37255>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:16:54 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 17:16:54 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
In-Reply-To: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>
Message-ID: <1560359814.09.0.775781676118.issue37201@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset daf62627518ad97ce66a48c49496aa0573cf0731 by Steve Dower (Paul Monson) in branch 'master':
bpo-37201: fix test_distutils failures for Windows ARM64 (GH-13902)
https://github.com/python/cpython/commit/daf62627518ad97ce66a48c49496aa0573cf0731


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:17:01 2019
From: report at bugs.python.org (Andrea Moro)
Date: Wed, 12 Jun 2019 17:17:01 +0000
Subject: [issue37255] Pathlib: Add an expandUserPath method or argument
In-Reply-To: <1560358154.87.0.642844029976.issue37255@roundup.psfhosted.org>
Message-ID: <1560359821.32.0.31870149167.issue37255@roundup.psfhosted.org>


Change by Andrea Moro <andrea.moro at rs-components.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37255>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:21:18 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 17:21:18 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
In-Reply-To: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>
Message-ID: <1560360078.34.0.994531044329.issue37201@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13889
pull_request: https://github.com/python/cpython/pull/14023

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:26:52 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 12 Jun 2019 17:26:52 +0000
Subject: [issue36607] asyncio.all_tasks() crashes if asyncio is used in
 multiple threads
In-Reply-To: <1555006368.14.0.78767463153.issue36607@roundup.psfhosted.org>
Message-ID: <1560360412.57.0.19277940869.issue36607@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Lukasz, please don't rush.
Applied PR makes asyncio more stable, not worse.

I see the only way to make it perfect: get rid of weak refs entirely.
Otherwise there is always a chance to catch GC run and set element deletion on iteration over the set. Sorry, that's how weakrefs work.

There is such possibility: call asyncio._unregister_task() explicitly when the task is done (finished with success or failure or cancelled).
By this, we can replace weakset with a regular set.

The only requirement is that task should call this _unregister_task() method.
No public API change is needed.

At the time of work on 3.7, Yuri and I considered this implementation but rejected it because there was a (very low) chance that somebody may implement own task, register custom task factory and don't call _unregister_task().

I never see a code that implements asyncio task from scratch, people always reuse existing asyncio.Task.

So, maybe the idea is not such bad. It can be implemented easily. I'm volunteered to make a PR with the proposal demonstration in a day or two, depending on my free time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36607>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:29:27 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 17:29:27 +0000
Subject: [issue37239] Add headless development preset layout
In-Reply-To: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>
Message-ID: <1560360567.33.0.74762856188.issue37239@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

In fact, any reason you can't use "--preset-nuget --include-..."? to add in whatever else you need? They are designed to compose like this deliberately.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:44:50 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 17:44:50 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
In-Reply-To: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>
Message-ID: <1560361490.77.0.412189372634.issue37201@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bb3e8a68b2554b2bd94cf0cd9a0311f4561c1a25 by Miss Islington (bot) in branch '3.8':
bpo-37201: fix test_distutils failures for Windows ARM64 (GH-13902)
https://github.com/python/cpython/commit/bb3e8a68b2554b2bd94cf0cd9a0311f4561c1a25


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:46:15 2019
From: report at bugs.python.org (Paul Monson)
Date: Wed, 12 Jun 2019 17:46:15 +0000
Subject: [issue37239] Add headless development preset layout
In-Reply-To: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>
Message-ID: <1560361575.04.0.974387665412.issue37239@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

Thanks for the feedback Steve

Looking at the differences between the change I proposed and the nuget package I agree that "--preset-nuget --include-..." is a better approach.

Closing this issue and the pull request.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:47:38 2019
From: report at bugs.python.org (Paul Monson)
Date: Wed, 12 Jun 2019 17:47:38 +0000
Subject: [issue37239] Add headless development preset layout
In-Reply-To: <1560290157.09.0.169248925355.issue37239@roundup.psfhosted.org>
Message-ID: <1560361658.43.0.294254232958.issue37239@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37239>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:56:35 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 12 Jun 2019 17:56:35 +0000
Subject: [issue37225] Document BaseException constructor
In-Reply-To: <1560237102.52.0.133464005619.issue37225@roundup.psfhosted.org>
Message-ID: <1560362195.89.0.474243881682.issue37225@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Fair enough. I've changed the title to point out only BaseException needs its constructor documented as every other extension inherits from it and so its cascades down.

----------
resolution: not a bug -> 
status: closed -> open
title: Signatures of Exceptions not documented -> Document BaseException constructor
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37225>
_______________________________________

From report at bugs.python.org  Wed Jun 12 13:57:26 2019
From: report at bugs.python.org (Paul Monson)
Date: Wed, 12 Jun 2019 17:57:26 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1560362246.29.0.847262697979.issue37140@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

I did some reading about parameter passing and it's still not clear to me whether https://bugs.python.org/issue37140 is a bug in CPython or whether the clang bindings were relying on incorrect parameter passing behavior to work.

The change in https://github.com/python/cpython/pull/13796 restores the previous behavior where Windows and non-Windows builds pass structs differently.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:06:27 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 12 Jun 2019 18:06:27 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560362787.2.0.739941507126.issue37130@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

@Antoine: was there a design reason behind setting 'name' to '' when a Path objects was initialized with '.'? Is it to implicitly represent the current directory?

@N.P.: we will have to think through the implications of this as I don't know if normalizing to 'name' being '' is the best way to resolve this inconsistency.

----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:09:06 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 18:09:06 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1560362946.2.0.914577405062.issue37236@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset ff6bb0aa95259413f359d42410526ff0b4dccfb7 by Steve Dower (Paul Monson) in branch 'master':
bpo-37236: pragma optimize off for _Py_c_quot on Windows arm64 (GH-13983)
https://github.com/python/cpython/commit/ff6bb0aa95259413f359d42410526ff0b4dccfb7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:09:06 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 18:09:06 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1560362946.99.0.00139355887144.issue37236@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13890
pull_request: https://github.com/python/cpython/pull/14024

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:13:27 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 18:13:27 +0000
Subject: [issue25599] asyncio.iscoroutinefunction returns unexpected results
 when presented with unittest.mock.Mock
In-Reply-To: <1447176382.09.0.498269327302.issue25599@psf.upfronthosting.co.za>
Message-ID: <1560363207.45.0.321808195338.issue25599@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I guess the inconsistency in original report is fixed with issue28703 where both inspect.iscoroutinefunction and asyncio.iscoroutinefunction return False for Mock(). The fix is available from 3.5.3 . There is also async support for mock added in 3.8 with issue26467. I am closing this as part of triaging. Feel free to reopen this if I am missing something. Thanks.

# Python 3.5

python3.5
Python 3.5.2 (default, Nov 12 2018, 13:43:14)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import asyncio
>>> from unittest.mock import *
>>> asyncio.iscoroutinefunction(Mock())
<Mock name='mock._is_coroutine' id='140563339256496'>

# Master

./python.exe
Python 3.9.0a0 (heads/master:daf6262751, Jun 12 2019, 23:12:37)
[Clang 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from unittest.mock import Mock
>>> import asyncio, inspect
>>> inspect.iscoroutinefunction(Mock())
False
>>> asyncio.iscoroutinefunction(Mock())
False

----------
nosy: +xtreak
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25599>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:14:43 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 18:14:43 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560363283.74.0.0738348280742.issue37253@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

It's fine to document the current state. I don't think you should spend any time *changing* the API to "future-proof" it.

I am hoping that larger changes to the compiler implementation will happen before Python 4, which will make the whole API moot (including the "parser" module, which should be deprecated ASAP). The compiler is excluded from the ABI for a reason.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:16:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 18:16:29 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560363389.76.0.327416170224.issue37251@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I will wait for a couple of days for suggestions and will raise a PR to check for __code__ to be a CodeType. Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:18:55 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 12 Jun 2019 18:18:55 +0000
Subject: [issue26140] inspect.iscoroutinefunction raises TypeError when checks
 Mock of function or coroutinefunction
In-Reply-To: <1453030972.84.0.0646105171888.issue26140@psf.upfronthosting.co.za>
Message-ID: <1560363535.78.0.916621673223.issue26140@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +lisroach, xtreak
versions: +Python 3.8, Python 3.9 -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26140>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:27:20 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 18:27:20 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1560364040.32.0.00952359529572.issue37236@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f72886a066ba7d3a3aa077cfc3cad2ca0b2cdbf6 by Miss Islington (bot) in branch '3.8':
bpo-37236: pragma optimize off for _Py_c_quot on Windows arm64 (GH-13983)
https://github.com/python/cpython/commit/f72886a066ba7d3a3aa077cfc3cad2ca0b2cdbf6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:38:28 2019
From: report at bugs.python.org (Nathaniel Smith)
Date: Wed, 12 Jun 2019 18:38:28 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1560364708.29.0.91285569918.issue28708@roundup.psfhosted.org>


Nathaniel Smith <njs at pobox.com> added the comment:

Traditionally on Unix, sockets are represented by file descriptors. File descriptors are small integers. (POSIX actually mandates the "small" part: whenever a new fd is created, the OS has to assign it the smallest integer value that's not already being used.)

So when select was designed, they decided to be "clever" and use a bitmask to represent the FD sets. If all your fds have values less than 64, then you can use a single 64-bit integer to represent any arbitrary subset of them, sweet, it's super efficient. It's also extremely weird. No other API cares about the actual integer value of an fd, they're just opaque tokens. Select is almost unique in being O(highest fd value).

Of course this microoptimization stopped making sense decades ago, so poll() was added. The big innovation with poll() is that it takes an array of descriptors like a normal function, instead of this wacky bitmask thing. So its O(number of fds), and it doesn't matter whether you're checking fd #1 or fd #1000.

EXCEPT windows has a totally different history. On Windows, sockets are represented as handles. And handles are just like fds, EXCEPT that handles are allowed to have arbitrary values; they didn't copy POSIX's weird (and expensive) rule about alwaysv using the smallest possible integer.

So when Windows went to implement select(), the bitmask optimization never made any sense at all ? even if you only have 1 socket, its handle might be, like, 0x9f57be3a or something. So you'd need a bitmask with 2**32 entries, which is silly.

So on Windows, select() is secretly poll(). They copied the FD_* macros for compatibility, but fd_set is really just an array of opaque values + an explicit length, and you can pass in as many or as few as you want.

I know this is mostly rehashing conclusions that are in the thread already but I thought it might make more sense to have it laid out all together.

----------
nosy: +njs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Wed Jun 12 14:48:39 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Wed, 12 Jun 2019 18:48:39 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560365319.08.0.305075838795.issue37250@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

> they can equally easily zero out the entire structure and ignore it without changing behavior on any Python 3.x.

Any solution that we apply in Cython will require users to regenerate their .c sources with a new Cython version in order to make it compile in Py3.8. The main decision point in this ticket is: should they need to or not? Everything else is just minor technicalities. (I didn't bring up this topic, but the question is up on the table now.)


> I have no problem changing the names of deprecated/reserved fields in PyTypeObject between releases. Source compatibility guarantees do not extend that far.

Fair enough, and I'm ok with letting CPython move forward cleanly and break things that are easily fixed on user side.

My point is that it makes no sense to justify bpo-37221 with the goal of not breaking Cython modules, when at the same time another change (the one discussed here) has already broken them. Either we find a striking justification for bpo-37221 that *excludes* Cython generated modules, or we take back *both* changes and restore full source code compatibility. Everything in between is just causing useless code churn and annoyance on all sides.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 15:12:35 2019
From: report at bugs.python.org (Alan De Smet)
Date: Wed, 12 Jun 2019 19:12:35 +0000
Subject: [issue37256] urllib.request.Request documentation erroneously refers
 to the "final two"
Message-ID: <1560366755.97.0.221740241329.issue37256@roundup.psfhosted.org>


New submission from Alan De Smet <aadesmet at wisc.edu>:

In Doc/library/urllib.request.rst, in the documentation for the class `Request`, it says

```
   The final two arguments are only of interest for correct handling
   of third-party HTTP cookies:
```

However, three arguments follow, not two, and the last is not necessarily related to third-party cookie handling.

I believe replacing "final" with "next" will correct the sentence:

```
   The next two arguments are only of interest for correct handling
   of third-party HTTP cookies:
```

Verified present in the source releases for CPython 3.5.7, 3.6.8, 3.7.3, 3.8.0b1. It is _not_ present in 2.7.16 (as the third parameter didn't yet exist, so the existing phrasing is correct.)

----------
assignee: docs at python
components: Documentation
messages: 345403
nosy: Alan De Smet, docs at python
priority: normal
severity: normal
status: open
title: urllib.request.Request documentation erroneously refers to the "final two"
type: enhancement
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37256>
_______________________________________

From report at bugs.python.org  Wed Jun 12 15:13:32 2019
From: report at bugs.python.org (Alan De Smet)
Date: Wed, 12 Jun 2019 19:13:32 +0000
Subject: [issue37256] urllib.request.Request documentation erroneously refers
 to the "final two"
In-Reply-To: <1560366755.97.0.221740241329.issue37256@roundup.psfhosted.org>
Message-ID: <1560366812.83.0.854845056602.issue37256@roundup.psfhosted.org>


Alan De Smet <aadesmet at wisc.edu> added the comment:

Oops, used to GitHub/GitLab, where Markdown is fair game. Sorry about that. :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37256>
_______________________________________

From report at bugs.python.org  Wed Jun 12 15:32:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 19:32:10 +0000
Subject: [issue26140] inspect.iscoroutinefunction raises TypeError when checks
 Mock of function or coroutinefunction
In-Reply-To: <1453030972.84.0.0646105171888.issue26140@psf.upfronthosting.co.za>
Message-ID: <1560367930.11.0.365584194528.issue26140@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26140>
_______________________________________

From report at bugs.python.org  Wed Jun 12 16:26:04 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Wed, 12 Jun 2019 20:26:04 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560371164.72.0.864279153342.issue37250@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

(I forgot to state the obvious third option, which is: don't do anything and leave everything as it is now in beta-1.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 16:52:09 2019
From: report at bugs.python.org (N.P. Khelili)
Date: Wed, 12 Jun 2019 20:52:09 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560372729.0.0.430659764505.issue37130@roundup.psfhosted.org>


N.P. Khelili <nophke at free.fr> added the comment:

@Brett: Honestly.... I don't think it is the best way. But fact is:

nono at ACER ~ % cd /

nono at ACER / % python
Python 3.7.3 (default, Mar 26 2019, 21:43:19) 
[GCC 8.2.1 20181127] on linux
Type "help", "copyright", "credits" or "license" for more information.

>>> from pathlib import Path
>>> Path('.') == Path('/')
False

In my humble and *very personal* opinion, this result could be understood in the case of
a PurePath (or some kind of system call free) object. But that is not what people expect
in the case of a 'normal' path...

I also think that one day we may see the rise of a new Os that wouldn't use . and  ..
The first Unix used 'd' for directory and 'dd' for directory's directory !
Those were hand-made links in a file system that otherwise had no concept of hierarchy...

I think each flavour should have a special_dirs variable (fact that linux and MsWin share
the same being an accident). And that the concept of a system-call free path implementation,
is fragile.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun 12 16:55:31 2019
From: report at bugs.python.org (Tim Peters)
Date: Wed, 12 Jun 2019 20:55:31 +0000
Subject: [issue37257] obmalloc:  stop simple arena thrashing
Message-ID: <1560372931.23.0.979771460507.issue37257@roundup.psfhosted.org>


New submission from Tim Peters <tim at python.org>:

Scenario:  all arenas are fully used.  A program then runs a loop like:

while whatever:
    p = malloc(n)
    ...
    free(p)
    
At the top, a new arena has to be created, and a single object is taken out of a single pool.  At the bottom, that object is freed, so the arena is empty again, and so is returned to the system.  Which cycle continues so long as the loop runs.  Very expensive.

This is "something like" what happens in practice, and has been reported anecdotally for years, but I've never been clear on _exactly_ what programs were doing in such cases.  Neil S pointed out this recent report here:

https://mail.python.org/pipermail/python-dev/2019-February/156529.html

Which may or may not be relevant.  Inada?

The "fix" proposed there:

-    if (nf == ao->ntotalpools) {
+    if (nf == ao->ntotalpools && ao != usable_arenas) {

doesn't appeal to me, because it can lead to states where obmalloc never returns empty arenas, no matter how many pile up.  For example, picture a thousand arenas each with just one used pool.  The head of the arena list becomes free, so is left alone, but moves to the end of the list (which is sorted by number of free pools).  Then the new head of the list becomes free, and ditto.  On & on.  We're left with a list containing a thousand wholly unused arenas.

So I suggest instead:

+    if (nf == ao->ntotalpools && ao->nextarena != NULL) {

That is, instead of exempting the head of the list, exempt the tail of the list.  In the example above, the first 999 arenas are returned to the system, but the last one remains in the list for reuse.  In general, the change would allow for at most one empty arena in the list.

We can't in general predict the future, but this would be enough to stop the thrashing in the specific scenario given at the top, with no apparent serious failure modes (potentially "wasting" one arena is minor).

----------
assignee: tim.peters
components: Interpreter Core
messages: 345407
nosy: inada.naoki, nascheme, tim.peters
priority: normal
severity: normal
stage: test needed
status: open
title: obmalloc:  stop simple arena thrashing
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37257>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:09:19 2019
From: report at bugs.python.org (Jeroen van den Hout)
Date: Wed, 12 Jun 2019 21:09:19 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560373759.98.0.479227614943.issue37247@roundup.psfhosted.org>


Jeroen van den Hout <jlvandenhout at gmail.com> added the comment:

Well, if I look at the source code build_ext explicitly calls for SWIG to handle interface files. Also, in case of commands like 'pip install <package>', the build sequence is predefined anyways, unless you explicitly define your own sequence in a custom command, in which case you are already tempering with default behavior.

That's why I argue that building and copying SWIG generated files correctly should be the default behavior.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:09:47 2019
From: report at bugs.python.org (hodai goldman)
Date: Wed, 12 Jun 2019 21:09:47 +0000
Subject: [issue37198] _parse_localename fail to parse 'en_IL'
In-Reply-To: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>
Message-ID: <1560373787.99.0.714955280035.issue37198@roundup.psfhosted.org>


Change by hodai goldman <hodaig at gmail.com>:


----------
keywords: +patch
pull_requests: +13891
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14027

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:18:33 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 12 Jun 2019 21:18:33 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560374313.31.0.0925443852651.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Any solution that we apply in Cython will require users to regenerate their .c sources with a new Cython version in order to make it compile in Py3.8. The main decision point in this ticket is: should they need to or not?

Considering Cython had a bug when it generated those sources (directly using a reserved field), then yes, users should have to regenerate with a fixed version.

> My point is that it makes no sense to justify bpo-37221 with the goal of not breaking Cython modules, when at the same time another change (the one discussed here) has already broken them.

I agree. Here's my distinction:

bpo-37221 breaks any user who correctly followed the documentation: https://docs.python.org/3.7/c-api/code.html#c.PyCode_New

This issue breaks users who did not follow the documentation: https://docs.python.org/3.7/c-api/typeobj.html#c.PyTypeObject.tp_print

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:19:24 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 21:19:24 +0000
Subject: [issue36689] docs: os.path.commonpath raises ValueError for different
 drives
In-Reply-To: <1555837758.83.0.507858438764.issue36689@roundup.psfhosted.org>
Message-ID: <1560374364.13.0.0882900203528.issue36689@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

Flagging as Windows issue.

----------
components: +Windows
nosy: +gvanrossum, paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36689>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:24:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 21:24:02 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560374642.66.0.887834761139.issue37223@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13892
pull_request: https://github.com/python/cpython/pull/14028

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:26:54 2019
From: report at bugs.python.org (Tim Peters)
Date: Wed, 12 Jun 2019 21:26:54 +0000
Subject: [issue37257] obmalloc:  stop simple arena thrashing
In-Reply-To: <1560372931.23.0.979771460507.issue37257@roundup.psfhosted.org>
Message-ID: <1560374814.21.0.437218741403.issue37257@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
type:  -> performance

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37257>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:32:45 2019
From: report at bugs.python.org (sushma)
Date: Wed, 12 Jun 2019 21:32:45 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1560375165.99.0.766754212659.issue30754@roundup.psfhosted.org>


sushma <sushma.y at gmail.com> added the comment:

I'm going to try and contribute this documentation fix.

----------
nosy: +syadlapalli

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:33:58 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 21:33:58 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560375238.4.0.0113442911841.issue37241@roundup.psfhosted.org>


Change by Jesse Bacon <jessembacon at me.com>:


Added file: https://bugs.python.org/file48414/Python Proof.ipynb

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:34:45 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 21:34:45 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560375285.97.0.303572261146.issue37241@roundup.psfhosted.org>


Change by Jesse Bacon <jessembacon at me.com>:


Added file: https://bugs.python.org/file48415/pbr37241_Jesse_Bacon.py.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:39:46 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Wed, 12 Jun 2019 21:39:46 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560375586.4.0.0310001433503.issue37241@roundup.psfhosted.org>


Jesse Bacon <jessembacon at me.com> added the comment:

Eric,

The interpreter said something about passing a negative value when I converted the db.keys to a list.  I have attached a script in txt format and a Jupyter notebook for further analysis.  I apologize for posting images,  I just saw your note.  I'll go ahead and look at the shelve source while you determine if this information is sufficient. Thank you for your time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:40:18 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 12 Jun 2019 21:40:18 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560375618.07.0.641980423674.issue37111@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> On the other hand, couldn't we use different default error handler?
"replace" or "backslashescape" seems better default error handler for the logging.

I've left it as is using the same rationale as I guess open() has at the moment - "Errors should never pass silently. Unless explicitly silenced".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:40:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 21:40:34 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560375634.03.0.168006754651.issue37223@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13893
pull_request: https://github.com/python/cpython/pull/14029

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:48:28 2019
From: report at bugs.python.org (David Wang)
Date: Wed, 12 Jun 2019 21:48:28 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
Message-ID: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>


New submission from David Wang <dwang at roblox.com>:

If you call setLevel() on a subclass of logging.Logger, it does not reset the cache for that logger. This mean that if you make some logging calls, then call setLevel(), the logger still acts like it still has its old level. See the attached python file for a reference.

Currently, the user has to call logger._cache.clear() to manually clear the cache after calling setLevel(). To fix this in Python, we would have to change Logger.setLevel() in /logging/__init__.py to have the following code
```
self.level = _checkLevel(level)
self.manager._clear_cache()
self._cache.clear()
```

Note the following:
- I made sure the subclass has a handler attached so setLevel() should work
- This bug does not occur if you use logging.getLogger(). This is because logging.getLogger() returns the root logger, and the cache clear specifically targets the root logger's cache to be cleared. It occurs when the logger is specifically subclassed from logging.getLoggerClass()
- The cache was added in Python 3.7, so this bug is specific to this version of python.

----------
components: Library (Lib)
files: test.py
messages: 345414
nosy: David Wang
priority: normal
severity: normal
status: open
title: Logging cache not cleared properly when setting level
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48416/test.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:52:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 21:52:44 +0000
Subject: [issue37224] test__xxsubinterpreters failed on AMD64 Windows8.1
 Refleaks 3.8
In-Reply-To: <1560214681.61.0.906498246375.issue37224@roundup.psfhosted.org>
Message-ID: <1560376364.8.0.630949543453.issue37224@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Failure on AppVeyor on my PR 14029 (which is unrelated):

test_subinterpreter (test.test__xxsubinterpreters.IsRunningTests) ... Exception in thread Thread-8:
Traceback (most recent call last):
  File "C:\projects\cpython\lib\threading.py", line 923, in _bootstrap_inner
    self.run()
  File "C:\projects\cpython\lib\threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "C:\projects\cpython\lib\test\test__xxsubinterpreters.py", line 51, in run
    interpreters.run_string(interp, dedent(f"""
RuntimeError: unrecognized interpreter ID 46
FAIL


FAIL: test_subinterpreter (test.test__xxsubinterpreters.IsRunningTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\projects\cpython\lib\test\test__xxsubinterpreters.py", line 492, in test_subinterpreter
    self.assertTrue(interpreters.is_running(interp))
AssertionError: False is not true


test__xxsubinterpreters passed when run again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37224>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:57:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 21:57:16 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560376636.31.0.513566304983.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 913fa1c8245d1cde6edb4254f4fb965cc91786ef by Victor Stinner in branch 'master':
bpo-37223, test_io: silence last 'Exception ignored in:' (GH-14029)
https://github.com/python/cpython/commit/913fa1c8245d1cde6edb4254f4fb965cc91786ef


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:58:06 2019
From: report at bugs.python.org (Tal Einat)
Date: Wed, 12 Jun 2019 21:58:06 +0000
Subject: [issue17535] IDLE: Add an option to show line numbers along the left
 side of the editor window, and have it enabled by default.
In-Reply-To: <1364102013.73.0.373085073641.issue17535@psf.upfronthosting.co.za>
Message-ID: <1560376686.41.0.633432823206.issue17535@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
pull_requests: +13894
stage: commit review -> patch review
pull_request: https://github.com/python/cpython/pull/14030

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17535>
_______________________________________

From report at bugs.python.org  Wed Jun 12 17:59:30 2019
From: report at bugs.python.org (Tal Einat)
Date: Wed, 12 Jun 2019 21:59:30 +0000
Subject: [issue17535] IDLE: Add an option to show line numbers along the left
 side of the editor window, and have it enabled by default.
In-Reply-To: <1364102013.73.0.373085073641.issue17535@psf.upfronthosting.co.za>
Message-ID: <1560376770.44.0.0421473348309.issue17535@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Please see updated PR, GH-14030.

It's not 100% ready yet. At this point the goal is to have some people try it and give feedback. So please, give it a go and let me know what you think!

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17535>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:04:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 22:04:22 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560377062.44.0.949777157023.issue37223@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13895
pull_request: https://github.com/python/cpython/pull/14031

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:05:08 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 22:05:08 +0000
Subject: [issue36689] docs: os.path.commonpath raises ValueError for different
 drives
In-Reply-To: <1555837758.83.0.507858438764.issue36689@roundup.psfhosted.org>
Message-ID: <1560377108.28.0.157919258621.issue36689@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36689>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:05:19 2019
From: report at bugs.python.org (Tal Einat)
Date: Wed, 12 Jun 2019 22:05:19 +0000
Subject: [issue17535] IDLE: Add an option to show line numbers along the left
 side of the editor window, and have it enabled by default.
In-Reply-To: <1364102013.73.0.373085073641.issue17535@psf.upfronthosting.co.za>
Message-ID: <1560377119.4.0.656018488886.issue17535@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

In reference to previous discussion here about the effect of toggling line numbers on future opened windows: IMO toggling shouldn't affect future windows; those should behave according to the configured default state. The default state should be changed only by editing the config (whether via the config dialog or by editing the config files.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17535>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:05:32 2019
From: report at bugs.python.org (Tal Einat)
Date: Wed, 12 Jun 2019 22:05:32 +0000
Subject: [issue17535] IDLE: Add an option to show line numbers along the left
 side of the editor window, and have it enabled by default.
In-Reply-To: <1364102013.73.0.373085073641.issue17535@psf.upfronthosting.co.za>
Message-ID: <1560377132.92.0.504329617391.issue17535@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17535>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:05:40 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Wed, 12 Jun 2019 22:05:40 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1560377140.31.0.958110252704.issue30754@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:06:49 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 12 Jun 2019 22:06:49 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560377209.33.0.857556656469.issue37241@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

After fixing a missing import (import urllib.request), this is what I get:

$ /usr/local/bin/python3.6 pbr37241_Jesse_Bacon.py 
Fetching nvdcve-1.0-2019.json.gz
Storing Gzipped File
Loading JSON Content
4275 records
4275 unique records
Creating Shelve: cve_2019.shelf
Assembling Big Dictionary of 2019 Data in shelve
shelve reports 4275 unique records
Extracting data by keys from shelve
4275 extracted records
Number of missing records 0
data match

Are you seeing failures?

This is on a python3.6 that I compiled from source on an old Fedora box.

What OS are you using?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:15:06 2019
From: report at bugs.python.org (Julian Berman)
Date: Wed, 12 Jun 2019 22:15:06 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1560377140.33.0.913882022989.issue30754@roundup.psfhosted.org>
Message-ID: <CABJQSknT_z6Z9B1o8VtUgo4zCGH4fZj-4pTZv_v2D=4hBihWtA@mail.gmail.com>


Julian Berman <Julian+Python.org at GrayVines.com> added the comment:

I still disagree :) but docs are better than nothing.

On Wed, Jun 12, 2019, 18:05 Guido van Rossum <report at bugs.python.org> wrote:

>
> Change by Guido van Rossum <guido at python.org>:
>
>
> ----------
> nosy: +gvanrossum
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue30754>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:23:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 22:23:55 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560378235.1.0.524208137442.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c15a682603a47f5aef5025f6a2e3babb699273d6 by Victor Stinner in branch '3.8':
bpo-37223: test_io: silence destructor errors (GH-14031)
https://github.com/python/cpython/commit/c15a682603a47f5aef5025f6a2e3babb699273d6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:23:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 22:23:55 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560378235.13.0.292986083152.issue18748@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c15a682603a47f5aef5025f6a2e3babb699273d6 by Victor Stinner in branch '3.8':
bpo-37223: test_io: silence destructor errors (GH-14031)
https://github.com/python/cpython/commit/c15a682603a47f5aef5025f6a2e3babb699273d6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:24:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 22:24:34 +0000
Subject: [issue37223] test_io logs Exception ignored in: <function
 IOBase.__del__ at 0x7f2f3c73e4b0> warnings
In-Reply-To: <1560210319.85.0.887484202288.issue37223@roundup.psfhosted.org>
Message-ID: <1560378274.11.0.703741583072.issue37223@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, all errors have been fixed in 3.8 and master. I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37223>
_______________________________________

From report at bugs.python.org  Wed Jun 12 18:33:27 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Wed, 12 Jun 2019 22:33:27 +0000
Subject: [issue37130] pathlib does not handle '..' directory
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560378807.04.0.412410762103.issue37130@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

I'm sorry, but I don't understand the issue here.

Instead of posting isolated snippets, could you explain what are you trying to do?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:09:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 23:09:07 +0000
Subject: [issue37069] regrtest: log unraisable exceptions and uncaught thread
 exceptions
In-Reply-To: <1558997484.87.0.618934402283.issue37069@roundup.psfhosted.org>
Message-ID: <1560380947.42.0.250916629179.issue37069@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 95f61c8b1619e736bd5e29a0da0183234634b6e8 by Victor Stinner in branch 'master':
bpo-37069: regrtest uses sys.unraisablehook (GH-13759)
https://github.com/python/cpython/commit/95f61c8b1619e736bd5e29a0da0183234634b6e8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37069>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:13:30 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 23:13:30 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560381210.76.0.106335662119.issue36779@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b4c7defe58695a6670a8fdeaef67a638bbb47e42 by Miss Islington (bot) (Paul Monson) in branch 'master':
bpo-36779: time.tzname returns empty string on Windows if default cod? (GH-13073)
https://github.com/python/cpython/commit/b4c7defe58695a6670a8fdeaef67a638bbb47e42


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:13:53 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 23:13:53 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560381233.01.0.797202358063.issue36779@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13896
pull_request: https://github.com/python/cpython/pull/14032

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:14:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 23:14:43 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560381283.18.0.15324838557.issue18748@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9 -Python 3.2, Python 3.3, Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:19:19 2019
From: report at bugs.python.org (Jeroen van den Hout)
Date: Wed, 12 Jun 2019 23:19:19 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560381559.51.0.291235565337.issue37247@roundup.psfhosted.org>


Jeroen van den Hout <jlvandenhout at gmail.com> added the comment:

I'm sorry, I read your comment completely wrong, so please disregard my previous comment.

I would argue the sequence doesn't really matter that much for non SWIG packages, since those will install correctly no matter if the extensions are built and copied first or not. In the non-SWIG case they are truly independent commands. It is only in the SWIG packages that they become dependent on each other.

On top of that I see more and more questions on stack exchange and other forums asking why their SWIG builds fail to install correctly, implying that more and more developers are using this awesome feature and start to rely on it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:23:48 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Wed, 12 Jun 2019 23:23:48 +0000
Subject: [issue29982] tempfile.TemporaryDirectory fails to delete itself
In-Reply-To: <1491330378.49.0.274398190766.issue29982@psf.upfronthosting.co.za>
Message-ID: <1560381828.24.0.259337761958.issue29982@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29982>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:24:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 23:24:52 +0000
Subject: [issue18748] io.IOBase destructor silence I/O error on close() by
 default
In-Reply-To: <1376572242.37.0.931026549367.issue18748@psf.upfronthosting.co.za>
Message-ID: <1560381892.13.0.161109226096.issue18748@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I closed the issue. I consider that the initial issue has been fixed and all related issues have been fixed as well:

* Python 3.8 now logs close() exception in file finalizer in development mode (-X dev) and debug mode (./configure --with-pydebug)
* I added sys.unraisablehook to Python 3.8 which allows to decide how these unraisable exceptions are handled
* Tests no longer log any "unraisable exception" in file finalizers (test_io and test_urllib have been fixed)
* regrtest now marks a test as ENV_CHANGED if it logs an unraisable exception (like the close() exception)

--

For Python 3.7, there is no known workaround.

It seems like Python 2.7 in debug mode logs an error:

$ python2.7-dbg bug.py 
close failed in file object destructor:
IOError: [Errno 9] Bad file descriptor

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18748>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:30:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 23:30:20 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560382220.24.0.0501649294907.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 468e5fec8a2f534f1685d59da3ca4fad425c38dd by Victor Stinner in branch 'master':
bpo-36402: Fix threading._shutdown() race condition (GH-13948)
https://github.com/python/cpython/commit/468e5fec8a2f534f1685d59da3ca4fad425c38dd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:30:28 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 23:30:28 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560382228.7.0.983438281495.issue36402@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13897
pull_request: https://github.com/python/cpython/pull/14033

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:30:37 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 12 Jun 2019 23:30:37 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560382237.17.0.128237937577.issue36402@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13898
pull_request: https://github.com/python/cpython/pull/14034

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:31:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 12 Jun 2019 23:31:59 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560382319.68.0.264408600771.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
versions: +Python 3.7, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:52:58 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 12 Jun 2019 23:52:58 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560383578.37.0.964437769921.issue37111@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> I've left it as is using the same rationale as I guess open() has at the moment - "Errors should never pass silently. Unless explicitly silenced".

But open() is general purpose, and logging is for logging.

Note that stderr uses 'backslashreplace', even when PYTHONIOENCODING=ascii:strict is used.

And if we don't log something due to encoding error, doesn't it mean "errors may ignored completely silently by default"?
What logging does when UnicodeEncodeError is happened?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Wed Jun 12 19:54:23 2019
From: report at bugs.python.org (Paul Monson)
Date: Wed, 12 Jun 2019 23:54:23 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560383663.77.0.208950266672.issue36779@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:01:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:01:32 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560384092.46.0.285837354182.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 2c9b498759f4fc74da82a0a96d059d666fa73f16 by Victor Stinner in branch 'master':
bpo-37253: Document PyCompilerFlags.cf_feature_version (GH-14019)
https://github.com/python/cpython/commit/2c9b498759f4fc74da82a0a96d059d666fa73f16


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:01:40 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 00:01:40 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560384100.1.0.719809009846.issue37253@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13899
pull_request: https://github.com/python/cpython/pull/14035

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:02:53 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 13 Jun 2019 00:02:53 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1560384173.29.0.268319770199.issue36422@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +giampaolo.rodola, tarek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:10:25 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 13 Jun 2019 00:10:25 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560384625.29.0.702302599764.issue37111@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> What logging does when UnicodeEncodeError is happened?

Hm, it seems logging does best job, show enough information to stderr.

But sometime, Python is embedded in web servers and there is no stderr.  pythonw.exe may not have stderr too....

I still feel backslashreplace is better default error handler.  But it's not strong opinion and it shouldn't block this issue.  Go ahead.


$ cat x.py
import logging

logging.basicConfig(filename="mylog.txt")
msg = "hello, ???"
logging.error(msg)

$ LC_ALL=en_US.US-ASCII python3 x.py
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/logging/__init__.py", line 1037, in emit
    stream.write(msg + self.terminator)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 18-20: ordinal not in range(128)
Call stack:
  File "x.py", line 5, in <module>
    logging.error(msg)
Message: 'hello, \u306f\u308d\u30fc'
Arguments: ()

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:11:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:11:33 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560384693.79.0.818998552598.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13900
pull_request: https://github.com/python/cpython/pull/14036

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:14:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:14:31 +0000
Subject: [issue37259] Missing Doc/whatsnew/3.9.rst file
Message-ID: <1560384871.35.0.2265684667.issue37259@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

There is no Doc/whatsnew/3.9.rst file yet. How should new features of Python 3.9 be documented?

Does someone know how to create a template for this file?

----------
assignee: docs at python
components: Documentation
messages: 345433
nosy: docs at python, lukasz.langa, ned.deily, vstinner
priority: normal
severity: normal
status: open
title: Missing Doc/whatsnew/3.9.rst file
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37259>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:16:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:16:44 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560385004.46.0.239015036869.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 37d66d7d4bc7dbac9809d69966a774ebb32563be by Victor Stinner in branch 'master':
bpo-37253: Add _PyCompilerFlags_INIT macro (GH-14018)
https://github.com/python/cpython/commit/37d66d7d4bc7dbac9809d69966a774ebb32563be


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:16:59 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 00:16:59 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560385019.49.0.63482307292.issue37253@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13901
pull_request: https://github.com/python/cpython/pull/14037

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:17:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:17:17 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560385037.07.0.37091403413.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset a04ea4f92ccbe20ffdbb5fa9b6bb93ee8da50f5d by Victor Stinner in branch 'master':
bpo-37253: Fix typo in PyCompilerFlags doc (GH-14036)
https://github.com/python/cpython/commit/a04ea4f92ccbe20ffdbb5fa9b6bb93ee8da50f5d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:19:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:19:40 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560385180.96.0.687518526861.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13902
pull_request: https://github.com/python/cpython/pull/14038

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:21:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:21:04 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560385264.11.0.00375887533021.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Many PyRun_xxx() functions of the public C API accept a "PyCompilerFlags* flags" parameter. So yeah, I documented the new cf_feature_version. PyCompilerFlags structure is kind of public ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:23:05 2019
From: report at bugs.python.org (Shen Han)
Date: Thu, 13 Jun 2019 00:23:05 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560385385.94.0.818931024946.issue37248@roundup.psfhosted.org>


Shen Han <shawnhan1029 at gmail.com> added the comment:

The 2to3 tool cannot convert the following code:
 1. `func(**{} if a else b)`
 2. `func(*[] if a else b)`

I think that problem is rooted the outdated Grammar.txt.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:24:25 2019
From: report at bugs.python.org (Shen Han)
Date: Thu, 13 Jun 2019 00:24:25 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560385465.19.0.459102106732.issue37248@roundup.psfhosted.org>


Shen Han <shawnhan1029 at gmail.com> added the comment:

This PR https://github.com/python/cpython/pull/12703 solves this problem. But haven't been merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:33:50 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 00:33:50 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560386030.71.0.316408895602.issue37258@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:36:05 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 00:36:05 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560386165.95.0.430696987151.issue37253@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 92e836c7dcaf74f7b8617250414224d24d1eb1f2 by Miss Islington (bot) in branch '3.8':
bpo-37253: Add _PyCompilerFlags_INIT macro (GH-14018)
https://github.com/python/cpython/commit/92e836c7dcaf74f7b8617250414224d24d1eb1f2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:40:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:40:44 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560386444.99.0.672996676052.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset f9445a391e6a91103fbe88bff4d3adc07f526c73 by Victor Stinner in branch '3.8':
[3.8] bpo-37253: Document PyCompilerFlags.cf_feature_version (GH-14019) (GH-14038)
https://github.com/python/cpython/commit/f9445a391e6a91103fbe88bff4d3adc07f526c73


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Wed Jun 12 20:57:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 00:57:52 +0000
Subject: [issue37154] test_utf8_mode: test_env_var() fails on AMD64 Fedora
 Rawhide Clang Installed 3.7
In-Reply-To: <1559667302.55.0.345195224781.issue37154@roundup.psfhosted.org>
Message-ID: <1560387472.7.0.959555915008.issue37154@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It seems like test_utf8_mode has a bug, but sadly I'm no longer able to reproduce it and so I cannot test my fix:

diff --git a/Lib/test/test_utf8_mode.py b/Lib/test/test_utf8_mode.py
index bdb93457cf..c22b95d54d 100644
--- a/Lib/test/test_utf8_mode.py
+++ b/Lib/test/test_utf8_mode.py
@@ -22,6 +22,16 @@ class UTF8ModeTests(unittest.TestCase):
     }
 
     def posix_locale(self):
+        try:
+            import _testinternalcapi
+        except ImportError:
+            pass
+        else:
+            pre_config = _testinternalcapi.get_configs()["pre_config"]
+            if pre_config["coerce_c_locale"] > 0:
+                # C locale has been coerced
+                return True
+
         loc = locale.setlocale(locale.LC_CTYPE, None)
         return (loc in POSIX_LOCALES)
 

I close the issue. Reopen it if you are able to reproduce the bug.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37154>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:05:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:05:17 +0000
Subject: [issue37191] Python.h contains intermingled declarations
In-Reply-To: <1559898837.19.0.323720820169.issue37191@roundup.psfhosted.org>
Message-ID: <1560387917.73.0.56052338554.issue37191@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Petr Viktorin fixed the issue, thanks ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37191>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:09:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:09:26 +0000
Subject: [issue36631] test_urllib2net: test_ftp_no_timeout() killed after a
 timeout of 15 min
In-Reply-To: <1555324751.9.0.575658866792.issue36631@roundup.psfhosted.org>
Message-ID: <1560388166.68.0.792293408929.issue36631@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I only saw this issue once, two months ago, so I close it.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36631>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:09:48 2019
From: report at bugs.python.org (Nathaniel Smith)
Date: Thu, 13 Jun 2019 01:09:48 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1560388188.7.0.499295417746.issue37136@roundup.psfhosted.org>


Nathaniel Smith <njs at pobox.com> added the comment:

One of Guido's mentees (I don't know her bpo account name) also ran into this:

https://python.zulipchat.com/#narrow/stream/116742-core.2Fhelp/topic/Weird.20sphinx.20error

Some analysis shows that we do have a bug in the docs ? the sphinx '.. module::' directive is only supposed to be used once per module, because it means "this is the canonical documentation for this module, that should be linked to whenever anyone mentions this module".

But we have two documents that use '.. module:: email.message':
  Doc/library/email.message.rst
  Doc/library/email.compat32-message.rst

I don't know enough about the email module to know what the right fix is, so I'll CC the email-interest-area folks too... maybe email.compat32-message.rst should be using '.. currentmodule:: email.message' instead of '.. module::'?

It's not clear why this error is appearing and disappearing for different people. The sphinx 2.1 release did make some changes in this area:

  https://github.com/sphinx-doc/sphinx/commit/259be8716ad4b2332aa4d7693d73400eb06fa7d7

but that doesn't explain why it appears and disappears randomly.

Probably not worth tracking down though, given that we can just fix the underlying problem.

----------
nosy: +barry, gvanrossum, maxking, njs, r.david.murray
resolution: not a bug -> 
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:10:41 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 13 Jun 2019 01:10:41 +0000
Subject: [issue37260] shutil.rmtree() FileNotFoundError race condition
Message-ID: <1560388241.37.0.285109327745.issue37260@roundup.psfhosted.org>


New submission from Jeffrey Kintscher <websurfer at surf2c.net>:

shutil.rmtree() is susceptible to a race condition that can needlessly raise OSError:

1. os.scandir() returns the list of entries in a directory
2. while iterating over the list, another thread or process deletes one or more of the entries not yet iterated
3. os.unlink() or stat() raises OSError for the already deleted entry

It should check for and ignore, at a minimum, FileNotFoundError because we were going to delete the entry anyways.  For comparison, the 'rm -r' shell command handles this race condition by ignoring entries deleted from under it.

I will submit a PR when I work out some test cases to include.

----------
components: Library (Lib)
messages: 345445
nosy: Jeffrey.Kintscher, giampaolo.rodola, tarek
priority: normal
severity: normal
status: open
title: shutil.rmtree() FileNotFoundError race condition
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37260>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:11:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:11:31 +0000
Subject: [issue35425] test_eintr fails randomly on AMD64 FreeBSD 10-STABLE
 Non-Debug 3.7: TypeError: 'int' object is not callable
In-Reply-To: <1544099308.26.0.788709270274.issue35425@psf.upfronthosting.co.za>
Message-ID: <1560388291.34.0.911990939252.issue35425@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I didn't see this issue recently, so I close it.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35425>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:13:56 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:13:56 +0000
Subject: [issue35385] time module: why not using tzname from the glibc?
In-Reply-To: <1543834589.7.0.788709270274.issue35385@psf.upfronthosting.co.za>
Message-ID: <1560388436.07.0.719261817466.issue35385@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This issue isn't really a bug. The current code just works. I close the issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35385>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:14:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:14:37 +0000
Subject: [issue35462] test_imaplib.test_enable_UTF8_True_append() failed on
 AMD64 FreeBSD 10-STABLE Non-Debug 3.7
In-Reply-To: <1544536562.99.0.788709270274.issue35462@psf.upfronthosting.co.za>
Message-ID: <1560388477.12.0.15310900951.issue35462@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I only saw the issue once, 6 months ago. I close the issue.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35462>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:43:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:43:10 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
Message-ID: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

test_io leaks references on AMD64 Fedora Rawhide Refleaks 3.8:
https://buildbot.python.org/all/#/builders/229/builds/10

test_io leaked [23208, 23204, 23208] references, sum=69620
test_io leaked [7657, 7655, 7657] memory blocks, sum=22969


The issue has been introduced by my change:

commit c15a682603a47f5aef5025f6a2e3babb699273d6
Author: Victor Stinner <vstinner at redhat.com>
Date:   Thu Jun 13 00:23:49 2019 +0200

    bpo-37223: test_io: silence destructor errors (GH-14031)
    
    * bpo-18748: Fix _pyio.IOBase destructor (closed case) (GH-13952)
    
    _pyio.IOBase destructor now does nothing if getting the closed
    attribute fails to better mimick _io.IOBase finalizer.
    
    (cherry picked from commit 4f6f7c5a611905fb6b81671547f268c226bc646a)
    
    * bpo-37223: test_io: silence destructor errors (GH-13954)
    
    Implement also MockNonBlockWriterIO.seek() method.
    
    (cherry picked from commit b589cef9c4dada2fb84ce0fae5040ecf16d9d5ef)
    
    * bpo-37223, test_io: silence last 'Exception ignored in:' (GH-14029)
    
    Use catch_unraisable_exception() to ignore 'Exception ignored in:'
    error when the internal BufferedWriter of the BufferedRWPair is
    destroyed. The C implementation doesn't give access to the
    internal BufferedWriter, so just ignore the warning instead.
    
    (cherry picked from commit 913fa1c8245d1cde6edb4254f4fb965cc91786ef)


It seems like the root issue is the usage of catch_unraisable_exception() in test_io.

class catch_unraisable_exception:
    def __init__(self):
        self.unraisable = None
        self._old_hook = None

    def _hook(self, unraisable):
        self.unraisable = unraisable

    def __enter__(self):
        self._old_hook = sys.unraisablehook
        sys.unraisablehook = self._hook
        return self

    def __exit__(self, *exc_info):
        # Clear the unraisable exception to explicitly break a reference cycle
        del self.unraisable
        sys.unraisablehook = self._old_hook

*Sometimes* "del self.unraisable" of __exit__() triggers a new unraisable exception which calls again the _hook() method which sets again the unraisable attribute.

catch_unraisable_exception resurects _io.BufferedWriter objects, and then "del self.unraisable" calls again their finalizer: iobase_finalize() is called again, and iobase_finalize() calls PyErr_WriteUnraisable() on close() failure.

----------
messages: 345449
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_io leaks references on AMD64 Fedora Rawhide Refleaks 3.8
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Wed Jun 12 21:46:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 01:46:43 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560390403.97.0.828117958695.issue37261@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

gdb traceback on "del self.unraisable":

(gdb) where
#0  _PyErr_WriteUnraisableDefaultHook (
    args=(<type at remote 0x7a9fa0>, ValueError('flush of closed file',), <traceback at remote 0x7fffe9cfb5f0>, None, <_io.BufferedWriter at remote 0x7fffe9bcb890>)) at Python/errors.c:1294
#1  0x00000000005726ec in sys_unraisablehook (module=<module at remote 0x7fffeac10710>, 
    unraisable=(<type at remote 0x7a9fa0>, ValueError('flush of closed file',), <traceback at remote 0x7fffe9cfb5f0>, None, <_io.BufferedWriter at remote 0x7fffe9bcb890>)) at ./Python/sysmodule.c:702
#2  0x0000000000435741 in _PyMethodDef_RawFastCallKeywords (method=0x7bb2e0 <sys_methods+1216>, self=<module at remote 0x7fffeac10710>, args=0x7ffffffd1d00, 
    nargs=1, kwnames=0x0) at Objects/call.c:650
#3  0x00000000004359f4 in _PyCFunction_Vectorcall (func=<built-in method unraisablehook of module object at remote 0x7fffeac10710>, args=0x7ffffffd1d00, 
    nargsf=1, kwnames=0x0) at Objects/call.c:737
#4  0x0000000000534666 in _PyObject_Vectorcall (callable=<built-in method unraisablehook of module object at remote 0x7fffeac10710>, args=0x7ffffffd1d00, 
    nargsf=1, kwnames=0x0) at ./Include/cpython/abstract.h:127
#5  0x00000000005346b1 in _PyObject_FastCall (func=<built-in method unraisablehook of module object at remote 0x7fffeac10710>, args=0x7ffffffd1d00, nargs=1)
    at ./Include/cpython/abstract.h:147
#6  0x0000000000536da4 in _PyErr_WriteUnraisableMsg (err_msg_str=0x0, obj=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at Python/errors.c:1379
#7  0x0000000000536ee6 in PyErr_WriteUnraisable (obj=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at Python/errors.c:1425


#8  0x00000000005eb97d in iobase_finalize (self=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at ./Modules/_io/iobase.c:299
#9  0x0000000000479fd2 in PyObject_CallFinalizer (self=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at Objects/object.c:307
#10 0x000000000047a044 in PyObject_CallFinalizerFromDealloc (self=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at Objects/object.c:325
#11 0x00000000005eb9e0 in _PyIOBase_finalize (self=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at ./Modules/_io/iobase.c:320


#12 0x00000000005f27d3 in buffered_dealloc (self=0x7fffe9bcb890) at ./Modules/_io/bufferedio.c:387
#13 0x000000000047ebff in _Py_Dealloc (op=<_io.BufferedWriter at remote 0x7fffe9bcb890>) at Objects/object.c:2213
#14 0x00000000005f210a in _Py_DECREF (filename=0x71eef3 "./Modules/_io/bufferedio.c", lineno=2138, op=<_io.BufferedWriter at remote 0x7fffe9bcb890>)
    at ./Include/object.h:478
#15 0x00000000005f716a in bufferedrwpair_dealloc (self=0x7fffe9a90d70) at ./Modules/_io/bufferedio.c:2138


#16 0x000000000047ebff in _Py_Dealloc (op=<_io.BufferedRWPair at remote 0x7fffe9a90d70>) at Objects/object.c:2213
#17 0x000000000048d1b6 in _Py_DECREF (filename=0x69fe40 "./Include/object.h", lineno=541, op=<_io.BufferedRWPair at remote 0x7fffe9a90d70>)
    at ./Include/object.h:478
#18 0x000000000048d1e2 in _Py_XDECREF (op=<_io.BufferedRWPair at remote 0x7fffe9a90d70>) at ./Include/object.h:541

# del UnraisableHookArgs

#19 0x000000000048d569 in structseq_dealloc (obj=0x7fffe9ad1360) at Objects/structseq.c:85
#20 0x000000000047ebff in _Py_Dealloc (
    op=(<type at remote 0x7a9fa0>, ValueError('flush of closed file',), <unknown at remote 0x7fffe9a8ad70>, None, <_io.BufferedRWPair at remote 0x7fffe9a90d70>))
    at Objects/object.c:2213
#21 0x0000000000463be6 in _Py_DECREF (filename=0x696dc9 "Objects/dictobject.c", lineno=1585, 
    op=(<type at remote 0x7a9fa0>, ValueError('flush of closed file',), <unknown at remote 0x7fffe9a8ad70>, None, <_io.BufferedRWPair at remote 0x7fffe9a90d70>))
    at ./Include/object.h:478
#22 0x0000000000468428 in delitem_common (mp=0x7fffe9b17950, hash=-822296730167156087, ix=0, 
    old_value=(<type at remote 0x7a9fa0>, ValueError('flush of closed file',), <unknown at remote 0x7fffe9a8ad70>, None, <_io.BufferedRWPair at remote 0x7fffe9a90d70>)) at Objects/dictobject.c:1585
#23 0x0000000000468663 in _PyDict_DelItem_KnownHash (op={'_old_hook': <built-in method unraisablehook of module object at remote 0x7fffeac10710>}, 
    key='unraisable', hash=-822296730167156087) at Objects/dictobject.c:1637
#24 0x00000000004684e5 in PyDict_DelItem (op={'_old_hook': <built-in method unraisablehook of module object at remote 0x7fffeac10710>}, key='unraisable')
    at Objects/dictobject.c:1603

# del self.unraisable

#25 0x000000000046ef21 in _PyObjectDict_SetItem (tp=0xa58830, dictptr=0x7fffe9a8ad30, key='unraisable', value=0x0) at Objects/dictobject.c:4614

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Wed Jun 12 22:16:51 2019
From: report at bugs.python.org (Tim Peters)
Date: Thu, 13 Jun 2019 02:16:51 +0000
Subject: [issue37257] obmalloc:  stop simple arena thrashing
In-Reply-To: <1560372931.23.0.979771460507.issue37257@roundup.psfhosted.org>
Message-ID: <1560392211.21.0.627605539194.issue37257@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
keywords: +patch
pull_requests: +13903
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/14039

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37257>
_______________________________________

From report at bugs.python.org  Wed Jun 12 23:35:34 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 03:35:34 +0000
Subject: [issue37259] Missing Doc/whatsnew/3.9.rst file
In-Reply-To: <1560384871.35.0.2265684667.issue37259@roundup.psfhosted.org>
Message-ID: <1560396934.21.0.425660499701.issue37259@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the report.  Fixed in PR 14040 (3a2883c313be3aff34c61a42e586f8507ba5945f) in master.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37259>
_______________________________________

From report at bugs.python.org  Wed Jun 12 23:36:35 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 03:36:35 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560396995.18.0.720045189749.issue37248@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

https://bugs.python.org/issue36541 already tracks it. So can this be closed as a duplicate?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Wed Jun 12 23:41:19 2019
From: report at bugs.python.org (Tim Peters)
Date: Thu, 13 Jun 2019 03:41:19 +0000
Subject: [issue37257] obmalloc:  stop simple arena thrashing
In-Reply-To: <1560372931.23.0.979771460507.issue37257@roundup.psfhosted.org>
Message-ID: <1560397279.07.0.580409279975.issue37257@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:


New changeset d1c85a27ea9fe70163cad3443d5e534d94f08284 by Tim Peters in branch 'master':
bpo-37257:  obmalloc:  stop simple arena thrashing (#14039)
https://github.com/python/cpython/commit/d1c85a27ea9fe70163cad3443d5e534d94f08284


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37257>
_______________________________________

From report at bugs.python.org  Wed Jun 12 23:46:02 2019
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 13 Jun 2019 03:46:02 +0000
Subject: [issue37198] _parse_localename fail to parse 'en_IL'
In-Reply-To: <1559925201.97.0.400746291459.issue37198@roundup.psfhosted.org>
Message-ID: <1560397562.8.0.376189634106.issue37198@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

Windows prefers locale names based on RFC 4646 language tags, which use a hyphen instead of an underscore (e.g. "en-UK"). This name format doesn't include an encoding. The C runtime (not the Windows API) makes one exception to support ".utf8" and ".utf-8" (e.g. "en-UK.utf8"). If UTF-8 is not specified, setlocale implicitly uses the ANSI codepage of the given locale (which is not to be confused with the ANSI codepage of the system locale).

As noted in this issue, _parse_localename currently fails if there's no encoding. hodai's PR 14027 addresses this case by looking for underscore in the name. In Windows, it should also look for hyphen. Also, instead of using None for the encoding in this case, in Windows we can look it up via ___lc_codepage_func [1]. This could be added as _locale._lc_codepage_func.

[1] https://docs.microsoft.com/en-us/cpp/c-runtime-library/lc-codepage-func?view=vs-2019

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37198>
_______________________________________

From report at bugs.python.org  Wed Jun 12 23:46:07 2019
From: report at bugs.python.org (Tim Peters)
Date: Thu, 13 Jun 2019 03:46:07 +0000
Subject: [issue37257] obmalloc:  stop simple arena thrashing
In-Reply-To: <1560372931.23.0.979771460507.issue37257@roundup.psfhosted.org>
Message-ID: <1560397567.79.0.188398840787.issue37257@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37257>
_______________________________________

From report at bugs.python.org  Thu Jun 13 00:07:11 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 04:07:11 +0000
Subject: [issue37136] Travis CI: Documentation tests fails with Sphinx 2.1
In-Reply-To: <1559524162.91.0.6239630561.issue37136@roundup.psfhosted.org>
Message-ID: <1560398831.68.0.557825703503.issue37136@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

The problem with the duplicate `.. module:: email.message` was fixed about 10 days ago with PR 13742 and backports; the fix adds a :noindex: to the duplicate entry.  I'm guessing that people seeing this problem had upgraded to Sphinx 2.1 but had not recently done a rebase of their feature branch to pick up that fix.

----------
nosy: +ned.deily
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37136>
_______________________________________

From report at bugs.python.org  Thu Jun 13 01:04:19 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 05:04:19 +0000
Subject: [issue37216] "Using Python on a Macintosh" chapter of "Python Setup
 and Usage" doc is out-of-date
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560402259.86.0.357277970922.issue37216@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 905e19a9bf9afd6439ea44fc6a4f3c8631750d6d by Ned Deily (Makdon) in branch 'master':
bpo-37216: update version to 3.9 in mac using document (GH-13966)
https://github.com/python/cpython/commit/905e19a9bf9afd6439ea44fc6a4f3c8631750d6d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Thu Jun 13 01:07:14 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 05:07:14 +0000
Subject: [issue37216] "Using Python on a Macintosh" chapter of "Python Setup
 and Usage" doc is out-of-date
In-Reply-To: <1560181222.28.0.0831029476518.issue37216@roundup.psfhosted.org>
Message-ID: <1560402434.59.0.869625179644.issue37216@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for contributing the PRs!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37216>
_______________________________________

From report at bugs.python.org  Thu Jun 13 01:11:18 2019
From: report at bugs.python.org (paul j3)
Date: Thu, 13 Jun 2019 05:11:18 +0000
Subject: [issue37227] Wrong parse long argument
In-Reply-To: <1560243186.93.0.426375916497.issue37227@roundup.psfhosted.org>
Message-ID: <1560402678.97.0.844180987838.issue37227@roundup.psfhosted.org>


Change by paul j3 <ajipanca at gmail.com>:


----------
nosy: +paul.j3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37227>
_______________________________________

From report at bugs.python.org  Thu Jun 13 02:21:29 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 06:21:29 +0000
Subject: [issue37245] Azure Pipeline 3.8 CI: multiple tests hung and timed out
 on macOS 10.13
In-Reply-To: <1560340622.3.0.842050597369.issue37245@roundup.psfhosted.org>
Message-ID: <1560406889.5.0.920605925337.issue37245@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

FWIW, I tried reproducing with 3.8 at 996e52623af3854552d41751e0c2522bc0a7e84f (the PR 14000 checkin) on both a current 10.14.5 Mojave system and on a 10.13.6 High Sierra system (the version used in the failed Azure test) and did not see any unusual failures.  I don't recall seeing a timeout like in test_concurrent_futures, at least recently!, but, if it is due to some race condition, there might be a more significant difference, like number of CPUs available, that might precipitate the failure.  I'll leave it up to you, Victor, on whether or how long to leave this issue open but I don't see that there is anything practical to do until it can be reproduced.

----------
title: Azure Pipeline: sick macOS job on Python 3.8? -> Azure Pipeline 3.8 CI: multiple tests hung and timed out on macOS 10.13

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37245>
_______________________________________

From report at bugs.python.org  Thu Jun 13 02:46:14 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 13 Jun 2019 06:46:14 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560408374.66.0.1380788203.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> This is a terrible idea, FWIW. Please don't do this.

Why not? It's a simple pragmatic solution that fixes an actual problem at essentially no cost to CPython.

You're right of course that Cython shouldn't set tp_print to 0 on Python 3. But I don't think that's a relevant argument.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:01:26 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 13 Jun 2019 07:01:26 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560409286.87.0.749612056391.issue37247@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> I would argue the sequence doesn't really matter that much for non SWIG packages

I don't think that this is correct. Or at least, it's not obvious to me that this is correct. It's not uncommon for projects to extend distutils in various ways and the proposed change may break those packages.

Adding a separate build step for SWIG (then the order would be build_swig, build_py, build_ext) would be safer and IMHO also more logical.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:01:35 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 07:01:35 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560409295.53.0.574769716981.issue35070@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 8725c83ed5ca8959195ad8326db99d564a921749 by Ned Deily (Jeffrey Kintscher) in branch 'master':
bpo-35070: test_getgrouplist may fail on macOS if too many groups (GH-13071)
https://github.com/python/cpython/commit/8725c83ed5ca8959195ad8326db99d564a921749


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:01:40 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:01:40 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560409300.14.0.721242951596.issue35070@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13904
pull_request: https://github.com/python/cpython/pull/14042

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:01:57 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:01:57 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560409317.17.0.949926803213.issue35070@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13905
pull_request: https://github.com/python/cpython/pull/14043

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:11:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 07:11:37 +0000
Subject: [issue37259] Missing Doc/whatsnew/3.9.rst file
In-Reply-To: <1560396934.21.0.425660499701.issue37259@roundup.psfhosted.org>
Message-ID: <CA+3bQGE5r7CwY83VbHZ5iYaoVi2A7gRX+SjtEky92tZ1OuL3zA@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Ned!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37259>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:15:04 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Thu, 13 Jun 2019 07:15:04 +0000
Subject: [issue37262] Make unittest assertions staticmethods/classmethods
Message-ID: <1560410104.79.0.196722798693.issue37262@roundup.psfhosted.org>


New submission from Pascal Chambon <chambon.pascal at gmail.com>:

Is there any reasons why assertXXX methods in TestCase are instance methods and not staticmethods/classmethods?

Since they (to my knowledge) don't need to access an instance dict, they could be turned into instance-less methods, and thus be usable from other testing frameworks (like pytest, for those who want to use all the power of fixtures and yet benefit from advanced assertions, like Django's TestCase's assertXXX).

Am I missing something here?

----------
components: Tests
messages: 345463
nosy: pakal
priority: normal
severity: normal
status: open
title: Make unittest assertions staticmethods/classmethods
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37262>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:18:29 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:18:29 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560410309.41.0.323608613645.issue35070@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b4c8ef7c67712c6639ee896bf7cb8ca1c204946d by Miss Islington (bot) in branch '3.7':
bpo-35070: test_getgrouplist may fail on macOS if too many groups (GH-13071)
https://github.com/python/cpython/commit/b4c8ef7c67712c6639ee896bf7cb8ca1c204946d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:18:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 07:18:48 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560410328.33.0.125121147992.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 022ac0a497b668d8b15e34e582a6396ead1a35e1 by Victor Stinner in branch 'master':
bpo-37253: Remove PyAST_obj2mod_ex() function (GH-14020)
https://github.com/python/cpython/commit/022ac0a497b668d8b15e34e582a6396ead1a35e1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:18:56 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:18:56 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560410336.45.0.0838832961889.issue37253@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13906
pull_request: https://github.com/python/cpython/pull/14044

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:27:27 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:27:27 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560410847.52.0.314085920514.issue35070@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c80183e6ca8c0ce834fc6444a71c7f31a3eb05b7 by Miss Islington (bot) in branch '3.8':
bpo-35070: test_getgrouplist may fail on macOS if too many groups (GH-13071)
https://github.com/python/cpython/commit/c80183e6ca8c0ce834fc6444a71c7f31a3eb05b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:29:59 2019
From: report at bugs.python.org (Roundup Robot)
Date: Thu, 13 Jun 2019 07:29:59 +0000
Subject: [issue6689] subprocess doesn't pass arguments correctly on Linux
 when	shell=True
In-Reply-To: <1250066038.48.0.373766477997.issue6689@psf.upfronthosting.co.za>
Message-ID: <1560410999.3.0.266077717943.issue6689@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +13907
pull_request: https://github.com/python/cpython/pull/14045

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6689>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:30:06 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 07:30:06 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560411006.0.0.729556281148.issue35070@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Merged for release in 3.8.0b2 and 3.7.4.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:30:13 2019
From: report at bugs.python.org (makdon)
Date: Thu, 13 Jun 2019 07:30:13 +0000
Subject: [issue36689] docs: os.path.commonpath raises ValueError for different
 drives
In-Reply-To: <1555837758.83.0.507858438764.issue36689@roundup.psfhosted.org>
Message-ID: <1560411013.65.0.154320032488.issue36689@roundup.psfhosted.org>


makdon <makdon at makdon.me> added the comment:

I create a PR according Windson Yang's suggestion.

----------
keywords: +patch
message_count: 4.0 -> 5.0
nosy: +makdon
nosy_count: 8.0 -> 9.0
pull_requests: +13908
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14045

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36689>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:46:15 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 07:46:15 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560411975.21.0.345528870185.issue37253@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 032bf30643fff49b5595b53f9c1ce5b2cd2df504 by Miss Islington (bot) in branch '3.8':
bpo-37253: Remove PyAST_obj2mod_ex() function (GH-14020)
https://github.com/python/cpython/commit/032bf30643fff49b5595b53f9c1ce5b2cd2df504


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:47:57 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 07:47:57 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560412077.21.0.0178042391204.issue35070@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

This issue has roamed quite a bit so it is a little bit difficult to tell what problem(s) have been seen here.  But, clearly Jeffrey's PR fixes a real and now reproducible problem so I'm declaring victory and have closed this issue now.  Thanks everyonw!  I am going to leave Issue33223 open (thanks xtreak!) for further investigation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:49:03 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 07:49:03 +0000
Subject: [issue33223] test_posix fails ERRNO 0
In-Reply-To: <1522851219.93.0.682650639539.issue33223@psf.upfronthosting.co.za>
Message-ID: <1560412143.63.0.530043562587.issue33223@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

See also the discussion and fix merged in Issue35070.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33223>
_______________________________________

From report at bugs.python.org  Thu Jun 13 03:58:27 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 13 Jun 2019 07:58:27 +0000
Subject: [issue37263] spawn asyncio subprocesses in a thread pool
Message-ID: <1560412707.67.0.811242566129.issue37263@roundup.psfhosted.org>


New submission from Andrew Svetlov <andrew.svetlov at gmail.com>:

Subprocess starting can be a long blocking operation, see https://github.com/python-trio/trio/issues/1109 for discussion

----------
messages: 345472
nosy: asvetlov
priority: normal
severity: normal
status: open
title: spawn asyncio subprocesses in a thread pool

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37263>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:20:11 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 13 Jun 2019 08:20:11 +0000
Subject: [issue26180] multiprocessing.util._afterfork_registry leak in
 threaded environment
In-Reply-To: <1453476286.88.0.329468896089.issue26180@psf.upfronthosting.co.za>
Message-ID: <1560414011.32.0.0928445728746.issue26180@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Why is it that __init__ is called multiple times? I'm just wondering if we could somehow ensure that __init__ is called only once.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26180>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:21:40 2019
From: report at bugs.python.org (Massimo Fidanza)
Date: Thu, 13 Jun 2019 08:21:40 +0000
Subject: [issue37264] Python 3.7.3 win 64bit - unresolved external symbol
 PyOS_AfterFork_Child
Message-ID: <1560414100.26.0.196764764517.issue37264@roundup.psfhosted.org>


New submission from Massimo Fidanza <malix0 at gmail.com>:

I need to build mod_wsgi under Windows 10 64bit, but I get a linking error
    mod_wsgi.obj : error LNK2001: unresolved external symbol PyOS_AfterFork_Child
    build\lib.win-amd64-3.7\mod_wsgi\server\mod_wsgi.cp37-win_amd64.pyd : fatal error LNK1120: 1 unresolved externals
    error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\x86_amd64\\link.exe' failed with exit status 1120

I checked my installation and found that inside include\intrcheck.h, PyOS_AfterFork_Child is declared, but if I run dumpbin /exports on libs\* (libpython37.a, python3.lib and python37.lib) there is only PyOS_AfterFork exported, and not PyOS_AfterFork_Child, PyOS_AfterFork_Parent and PyOS_BeforeFork. I have installed Python3.7.3 using "Windows x86-64 executable installer" (python-3.7.3-amd64.exe) downloaded from python.org

----------
components: Library (Lib)
messages: 345474
nosy: Massimo Fidanza
priority: normal
severity: normal
status: open
title: Python 3.7.3 win 64bit - unresolved external symbol PyOS_AfterFork_Child
type: compile error
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37264>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:24:46 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 08:24:46 +0000
Subject: [issue37264] Python 3.7.3 win 64bit - unresolved external symbol
 PyOS_AfterFork_Child
In-Reply-To: <1560414100.26.0.196764764517.issue37264@roundup.psfhosted.org>
Message-ID: <1560414286.64.0.060239946459.issue37264@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37264>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:43:56 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 08:43:56 +0000
Subject: [issue37262] Make unittest assertions staticmethods/classmethods
In-Reply-To: <1560410104.79.0.196722798693.issue37262@roundup.psfhosted.org>
Message-ID: <1560415436.3.0.493409195822.issue37262@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

See also issue19645 which seems to be a slightly related discussion

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37262>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:44:34 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 08:44:34 +0000
Subject: [issue37262] Make unittest assertions staticmethods/classmethods
In-Reply-To: <1560410104.79.0.196722798693.issue37262@roundup.psfhosted.org>
Message-ID: <1560415474.21.0.740882581984.issue37262@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Library (Lib) -Tests
nosy: +ezio.melotti, michael.foord, rbcollins
versions:  -Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37262>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:48:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 08:48:58 +0000
Subject: [issue37265] Memory leaks regression caused by: Fix
 threading._shutdown() race condition
Message-ID: <1560415738.53.0.302497815956.issue37265@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

https://buildbot.python.org/all/#/builders/189/builds/60

Examples:

test_ssl leaked [3, 3, 3] references, sum=9
test_ssl leaked [3, 3, 3] memory blocks, sum=9
test_decimal leaked [4, 4, 4] references, sum=12
test_decimal leaked [4, 4, 4] memory blocks, sum=12
test_httplib leaked [1, 1, 1] references, sum=3
test_httplib leaked [1, 1, 1] memory blocks, sum=3
test_multiprocessing_fork leaked [27, 27, 27] references, sum=81
test_multiprocessing_fork leaked [27, 27, 27] memory blocks, sum=81
test_multiprocessing_forkserver leaked [27, 27, 27] references, sum=81
test_multiprocessing_forkserver leaked [27, 27, 27] memory blocks, sum=81
test_socketserver leaked [15, 15, 15] references, sum=45
test_socketserver leaked [15, 15, 15] memory blocks, sum=45
test_capi leaked [17, 17, 17] references, sum=51
test_capi leaked [17, 17, 17] memory blocks, sum=51
test_smtplib leaked [47, 47, 47] references, sum=141
test_smtplib leaked [47, 47, 47] memory blocks, sum=141
test_io leaked [23254, 23250, 23254] references, sum=69758
test_io leaked [7703, 7701, 7703] memory blocks, sum=23107
test_pickle leaked [6, 6, 6] references, sum=18
test_pickle leaked [6, 6, 6] memory blocks, sum=18
test_httpservers leaked [43, 43, 43] references, sum=129
test_httpservers leaked [43, 43, 43] memory blocks, sum=129
test_nntplib leaked [1, 1, 1] references, sum=3
test_nntplib leaked [1, 1, 1] memory blocks, sum=3
test_os leaked [5, 5, 5] references, sum=15
test_os leaked [5, 5, 5] memory blocks, sum=15
test_subprocess leaked [4, 4, 4] references, sum=12
test_subprocess leaked [4, 4, 4] memory blocks, sum=12
test_socket leaked [7, 7, 7] references, sum=21
test_socket leaked [7, 7, 7] memory blocks, sum=21
test_multiprocessing_spawn leaked [27, 27, 27] references, sum=81
test_multiprocessing_spawn leaked [27, 27, 27] memory blocks, sum=81
test_concurrent_futures leaked [3, 3, 3] references, sum=9
test_concurrent_futures leaked [3, 3, 3] memory blocks, sum=9
test_asyncio leaked [62, 62, 62] references, sum=186
test_asyncio leaked [62, 62, 62] memory blocks, sum=186


I used git bisect and I found... my own change :-)

commit 468e5fec8a2f534f1685d59da3ca4fad425c38dd
Author: Victor Stinner <vstinner at redhat.com>
Date:   Thu Jun 13 01:30:17 2019 +0200

    bpo-36402: Fix threading._shutdown() race condition (GH-13948)
    
    Fix a race condition at Python shutdown when waiting for threads.
    Wait until the Python thread state of all non-daemon threads get
    deleted (join all non-daemon threads), rather than just wait until
    Python threads complete.
    
    * Add threading._shutdown_locks: set of Thread._tstate_lock locks
      of non-daemon threads used by _shutdown() to wait until all Python
      thread states get deleted. See Thread._set_tstate_lock().
    * Add also threading._shutdown_locks_lock to protect access to
      threading._shutdown_locks.
    * Add test_finalization_shutdown() test.

----------
components: Library (Lib)
messages: 345476
nosy: vstinner
priority: normal
severity: normal
status: open
title: Memory leaks regression caused by: Fix threading._shutdown() race condition
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37265>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:58:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 08:58:13 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560416292.98.0.981289705483.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13909
pull_request: https://github.com/python/cpython/pull/14047

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 04:59:39 2019
From: report at bugs.python.org (Robert Collins)
Date: Thu, 13 Jun 2019 08:59:39 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560416379.4.0.196907326158.issue19645@roundup.psfhosted.org>


Robert Collins <robertc at robertcollins.net> added the comment:

Sorry for the slow reply here;

There are API breaks involved in any decoupling that involves the exception raising because of the failureException attribute. Something with signalling that can be adapted by other test suites etc might have merit, but I think we are lacking a clear use case for doing this to the existing exceptions. Setting up a way for new things to be more easily used by users of other test frameworks is quite attractive; perhaps just writing them as separate functions with an adapter to failureException would be sufficient.

----------
versions: +Python 3.9 -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:00:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 09:00:09 +0000
Subject: [issue37265] Memory leaks regression caused by: Fix
 threading._shutdown() race condition
In-Reply-To: <1560415738.53.0.302497815956.issue37265@roundup.psfhosted.org>
Message-ID: <1560416409.04.0.587862586668.issue37265@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh. It's a stupid bug: will be fixed by PR 14047.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37265>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:02:03 2019
From: report at bugs.python.org (Robert Collins)
Date: Thu, 13 Jun 2019 09:02:03 +0000
Subject: [issue37262] Make unittest assertions staticmethods/classmethods
In-Reply-To: <1560410104.79.0.196722798693.issue37262@roundup.psfhosted.org>
Message-ID: <1560416523.46.0.674455051522.issue37262@roundup.psfhosted.org>


Robert Collins <robertc at robertcollins.net> added the comment:

I think this is strictly redundant with that other ticket and I'm going to close it. That said, they need access to self.failureException. https://docs.python.org/3/library/unittest.html#unittest.TestCase.failureException

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37262>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:15:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 09:15:11 +0000
Subject: [issue35070] test_getgrouplist may fail on macOS if user in too many
 groups
In-Reply-To: <1540497129.89.0.788709270274.issue35070@psf.upfronthosting.co.za>
Message-ID: <1560417311.74.0.766768348133.issue35070@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> clearly Jeffrey's PR fixes a real and now reproducible problem so I'm declaring victory and have closed this issue now.  Thanks everyone!

Well done Jeffrey Kintscher! The test was failing randomly for years, I recall many bugs and many people complaining, but nobody succeeded to come up with a fix.

Note: this off-by-one looks magic to me, but I'm happy that it works :-)

    /*
     * NGROUPS_MAX is defined by POSIX.1 as the maximum
     * number of supplimental groups a users can belong to.
     * We have to increment it by one because
     * getgrouplist() returns both the supplemental groups
     * and the primary group, i.e. all of the groups the
     * user belongs to.
     */
    ngroups = 1 + MAX_GROUPS;

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35070>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:20:50 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Thu, 13 Jun 2019 09:20:50 +0000
Subject: [issue37262] Make unittest assertions staticmethods/classmethods
In-Reply-To: <1560410104.79.0.196722798693.issue37262@roundup.psfhosted.org>
Message-ID: <1560417650.5.0.94696731713.issue37262@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

Indeed I missed this ticket, thanks

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37262>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:26:50 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 13 Jun 2019 09:26:50 +0000
Subject: [issue37231] Optimize calling special methods
In-Reply-To: <1560258460.83.0.570346812053.issue37231@roundup.psfhosted.org>
Message-ID: <1560418010.56.0.0872040328771.issue37231@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset b4b814b3988abf69f07f8492d82e855c51b2a75d by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37231: optimize calls of special methods (GH-13973)
https://github.com/python/cpython/commit/b4b814b3988abf69f07f8492d82e855c51b2a75d


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37231>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:28:55 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Thu, 13 Jun 2019 09:28:55 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560418135.51.0.216239411499.issue19645@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

(Redirected here from https://bugs.python.org/issue37262)

I haven't dug the assertThat() idea, but why not make, as a first step, turn assertion methods in TestCase to staticmethods/classmethods, instead of instance methods?

Since they (to my knowledge) don't need to access an instance dict, they could be turned into such instance-less methods, and thus be usable from other testing frameworks (like pytest, for those who want to use pytest fixtures and yet benefit from advanced assertions like Django's TestCase's assertions).

"failureException" and others are meant to be (sub)class attributes, so no backwards incompatible change should occur (unless someone did really weird things with manually instantiated TestCases).

----------
nosy: +pakal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:30:53 2019
From: report at bugs.python.org (Michael Foord)
Date: Thu, 13 Jun 2019 09:30:53 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560418253.98.0.0270044389225.issue19645@roundup.psfhosted.org>


Michael Foord <michael at voidspace.org.uk> added the comment:

Has anyone seen any real world use cases for failureException? It's a real hindrance to a whole bunch of changes sounds decoupling. 

On the other hand something like assertThat could catch a custom exception from the matchers (subclass of AssertionError) and raise failureException

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:36:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 09:36:05 +0000
Subject: [issue37266] Daemon threads must be forbidden in subinterpreters
Message-ID: <1560418565.72.0.288239825756.issue37266@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Py_EndInterpreter() calls threading._shutdown() which waits for non-daemon threads spawned in the subinterpreters. Problem: daemon threads continue to run after threading._shutdown(), but they rely on an interpreter which is being finalized and then deleted.

Attached example shows the problem:

$ ./python subinterp_daemon_thread.py 
hello from daemon thread
Fatal Python error: Py_EndInterpreter: not the last thread

Current thread 0x00007f13e5926740 (most recent call first):
  File "subinterp_daemon_thread.py", line 23 in <module>
Aborted (core dumped)

Catching the bug in Py_EndInterpreter() is too late. IMHO we must simply deny daemon threads by design in subinterpreters for safety.

In the main interpreter, we provide best effort to prevent crash at exit, but IMHO the implementation is ugly :-( ceval.c uses exit_thread_if_finalizing(): it immediately exit the current daemon thread if the threads attempts to acquire or release the GIL, whereas the interpreter is gone. Problem: we cannot release/clear some data structure at Python exit because of that. So Py_Finalize() may leak some memory by design, because of daemon threads.

IMHO we can be way stricter in subinterpreters.

I suggest to only modify Python 3.9.

----------
components: Interpreter Core
files: subinterp_daemon_thread.py
messages: 345485
nosy: vstinner
priority: normal
severity: normal
status: open
title: Daemon threads must be forbidden in subinterpreters
versions: Python 3.9
Added file: https://bugs.python.org/file48417/subinterp_daemon_thread.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37266>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:39:16 2019
From: report at bugs.python.org (Michael Felt)
Date: Thu, 13 Jun 2019 09:39:16 +0000
Subject: [issue28009] core logic of uuid.getnode() is broken for netstat
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560418756.79.0.480626600733.issue28009@roundup.psfhosted.org>


Michael Felt <aixtools at felt.demon.nl> added the comment:

I have modified -

_NODE_GETTERS_WIN32 = [_windll_getnode, _netbios_getnode, _ipconfig_getnode]

_NODE_GETTERS_UNIX = [_unix_getnode, _ifconfig_getnode, _ip_getnode,
                      _arp_getnode, _lanscan_getnode, _netstat_getnode]

to:

  +683  # _OS_GETTERS, when known, are targetted for a specific OS or platform.
  +684  # The order is by 'common practice' on the specified platform.
  +685  # Note: 'posix' and 'windows' _OS_GETTERS are prefixed by a dll/dlload() method
  +686  # which, when successful, means none of these "external" methods are called.
  +687  # _GETTERS is (also) used by test_uuid.py to SkipUnless(), e.g.,
  +688  #     @unittest.skipUnless(_uuid._ifconfig_getnode in _uuid._GETTERS, ...)
  +689  if _LINUX:
  +690      _OS_GETTERS = [_ip_getnode, _ifconfig_getnode]
  +691  elif _DARWIN:
  +692      _OS_GETTERS = [_ifconfig_getnode, _arp_getnode, _netstat_getnode]
  +693  elif _WINDOWS:
  +694      _OS_GETTERS = [_netbios_getnode, _ipconfig_getnode]
  +695  elif _AIX:
  +696      _OS_GETTERS = [_netstat_getnode]
  +697  else:
  +698      _OS_GETTERS = [_ifconfig_getnode, _ip_getnode, _arp_getnode,
  +699                     _netstat_getnode, _lanscan_getnode]
  +700  if os.name == 'posix':
  +701      _GETTERS = [_unix_getnode] + _OS_GETTERS
  +702  elif os.name == 'nt':
  +703      _GETTERS = [_windll_getnode] + _OS_GETTERS
  +704  else:
  +705      _GETTERS = _OS_GETTERS

The shortened list, and in particular the move of _ip_getnode before _ifconfig_getnode is my experience that the "old" programs such as ifconfig, arp, and netstat are (occasionally) not available - with "ip" being the replacement for all.

Further, re: linux, on the two distros I could test (centos and debian) neither arp nor netstat return a (useable) MACADDR aka "node" value.

Requesting verification from people with other platforms.

Also, would like to know specifics for other platforms (e.g., OpenBSD, HPUX, Solaris). 

More generally speaking - if os.name is "posix" or "windows" - this  lists are almost irrelevant because the "DLL" _uuid module should provide the needed value.

The "plus" is that on systems that audit such things, there are fewer calls to non-existent programs and/or negative side-effects from calling programs that can/do not provide any useful data.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:39:29 2019
From: report at bugs.python.org (Michael Felt)
Date: Thu, 13 Jun 2019 09:39:29 +0000
Subject: [issue28009] core logic of uuid.getnode() is broken for netstat
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560418769.89.0.211731817112.issue28009@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:42:35 2019
From: report at bugs.python.org (Ma Lin)
Date: Thu, 13 Jun 2019 09:42:35 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1560418955.16.0.219793610642.issue21872@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
pull_requests: +13910
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14048

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:50:01 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Thu, 13 Jun 2019 09:50:01 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560419401.29.0.138239180994.issue19645@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

I don't get it, why would failureException block anything ? The unittest.TestCase API must remain the same anyway, but it could become just a wrapper towards external assertions.

For example :

class TestCase:

   assertEqual = wrap(assertions.assert_equal)

Where "wrap" for example is some kind of functools.partial() injecting into external assertions a parameter "failure_exception_class". Having all these external assertions take such a parameter (defaulting to AssertionError) would be a great plus for adaptability anyway.

----------
versions: +Python 3.5 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:51:04 2019
From: report at bugs.python.org (Michael Felt)
Date: Thu, 13 Jun 2019 09:51:04 +0000
Subject: [issue28009] core logic of uuid.getnode() needs refresh
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560419464.11.0.406750152627.issue28009@roundup.psfhosted.org>


Michael Felt <aixtools at felt.demon.nl> added the comment:

p.s. - changed the title: way back when I first started on this I was mainly concerned that the _netstat_getnode() routine was broken for AIX. During the research and follow-up discussions it has become clear that it is more than just an AIX issue. There are multiple aspects that need attention.

Footnote: For most platforms, most of the data accessed via Lib/uuid is actually retrieved via Modules/_uuid. The majority of issues with Lib/uuid occur during testing: ./python -m test test_uuid

At least two PR (8672 - fix bug for AIX), (12777 - make "_getters" lists platform specific when possible). FYI: the first PR (5183) was when I was trying to patch multiple issues.

----------
title: core logic of uuid.getnode() is broken for netstat -> core logic of uuid.getnode() needs refresh

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Thu Jun 13 05:51:07 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 13 Jun 2019 09:51:07 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1560419467.27.0.874722256313.issue18299@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

spawn_python in script_helper is good enough, so this bug looks like cloud be closed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:01:27 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 10:01:27 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560420087.63.0.880956683612.issue37258@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

A unittest patch for this issue. This occurs in master and 3.8 too.

diff --git a/Lib/test/test_logging.py b/Lib/test/test_logging.py
index 50148dc2f2..30fd9ee37a 100644
--- a/Lib/test/test_logging.py
+++ b/Lib/test/test_logging.py
@@ -4172,6 +4172,27 @@ class ModuleLevelMiscTest(BaseTest):
         logging.setLoggerClass(logging.Logger)
         self.assertEqual(logging.getLoggerClass(), logging.Logger)

+    def test_subclass_logger_cache(self):
+
+        class MyLogger(logging.getLoggerClass()):
+            pass
+
+        logger = MyLogger('test')
+        stream = io.StringIO()
+        h = logging.StreamHandler(stream)
+        logger.addHandler(h)
+
+        logger.setLevel(logging.DEBUG)
+        logger.debug("hello")
+        self.assertEqual(stream.getvalue().strip(), "hello")
+
+        stream.truncate(0)
+        stream.seek(0)
+
+        logger.setLevel(logging.INFO)
+        logger.debug("hello")
+        self.assertEqual(stream.getvalue(), "")
+
     @support.requires_type_collecting
     def test_logging_at_shutdown(self):
         # Issue #20037

----------
nosy: +xtreak
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:03:43 2019
From: report at bugs.python.org (Ma Lin)
Date: Thu, 13 Jun 2019 10:03:43 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1560420223.16.0.41686442479.issue21872@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

I wrote a review guide in PR 14048.

----------
versions: +Python 3.8, Python 3.9 -Python 2.7, Python 3.4, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:05:26 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 13 Jun 2019 10:05:26 +0000
Subject: [issue37266] Daemon threads must be forbidden in subinterpreters
In-Reply-To: <1560418565.72.0.288239825756.issue37266@roundup.psfhosted.org>
Message-ID: <1560420326.7.0.377381766197.issue37266@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +eric.snow

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37266>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:06:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 10:06:30 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560420390.1.0.631202603584.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 6f75c873752a16a7ad8f35855b1e29f59d048e84 by Victor Stinner in branch 'master':
tbpo-36402: Fix threading.Thread._stop() (GH-14047)
https://github.com/python/cpython/commit/6f75c873752a16a7ad8f35855b1e29f59d048e84


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:07:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 10:07:07 +0000
Subject: [issue37266] Daemon threads must be forbidden in subinterpreters
In-Reply-To: <1560418565.72.0.288239825756.issue37266@roundup.psfhosted.org>
Message-ID: <1560420427.6.0.166491853025.issue37266@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13911
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14049

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37266>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:07:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 10:07:45 +0000
Subject: [issue37265] Memory leaks regression caused by: Fix
 threading._shutdown() race condition
In-Reply-To: <1560415738.53.0.302497815956.issue37265@roundup.psfhosted.org>
Message-ID: <1560420465.87.0.44066070748.issue37265@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

commit 6f75c873752a16a7ad8f35855b1e29f59d048e84 (HEAD -> master, upstream/master)
Author: Victor Stinner <vstinner at redhat.com>
Date:   Thu Jun 13 12:06:24 2019 +0200

    tbpo-36402: Fix threading.Thread._stop() (GH-14047)
    
    Remove the _tstate_lock from _shutdown_locks, don't remove None.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37265>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:11:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 10:11:05 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560420665.59.0.171151081615.issue36402@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13912
pull_request: https://github.com/python/cpython/pull/14050

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:12:30 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 13 Jun 2019 10:12:30 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
Message-ID: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

In PR 13739, Eryk Sun mentioned that the Windows implementation of os.dup() returns an inheritable fd when handling a character file. A comment in _Py_dup() makes it seem as though this is due to a belief that handles for character files cannot be made non-inheritable (which is wrong).

----------
components: Extension Modules, Windows
messages: 345494
nosy: ZackerySpytz, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: os.dup() creates an inheritable fd when handling a character file on Windows
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:19:15 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 13 Jun 2019 10:19:15 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560421155.25.0.0503182869529.issue37267@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13913
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14051

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:20:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 10:20:32 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560421232.34.0.972488822833.issue37261@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13914
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14052

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 06:33:38 2019
From: report at bugs.python.org (Jeroen van den Hout)
Date: Thu, 13 Jun 2019 10:33:38 +0000
Subject: [issue37247] swap distutils build_ext and build_py commands to allow
 proper SWIG extension installation
In-Reply-To: <1560341496.09.0.819646109086.issue37247@roundup.psfhosted.org>
Message-ID: <1560422018.69.0.718114959504.issue37247@roundup.psfhosted.org>


Jeroen van den Hout <jlvandenhout at gmail.com> added the comment:

> Adding a separate build step for SWIG (then the order would be build_swig, build_py, build_ext) would be safer and IMHO also more logical.

I like this suggestion and contemplated it. However SWIG interface files are defined in Extension instances, which are inherently tight to the build_ext command. Breaking this link would require introspection of extensions before deciding on which command to invoke, or a completely separate SWIG Extension class, both of which require a change in usage.

> It's not uncommon for projects to extend distutils in various ways and the proposed change may break those packages.

I argue that those packages are already tempering with default behavior of distutils, while the change I am proposing is fixing a flaw in basic functionality and might I say 'implied behavior' of distutils (as the docs say distutils understands SWIG, while it isn't currently even capable of installing correctly when SWIG files are used).

The build_ext and build_py commands are truly separate commands, except when SWIG interface files are used:

- build_py is responsible for copying pure python files to their correct directories, potentially compiling them to .pyc files.

- build_ext is responsible for compiling and linking C/C++ files and copying resultant files to their correct directories. It is only when SWIG files are supplied that a .py file is produced, which quite neatly would be picked up by build_py, given the chance.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37247>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:02:27 2019
From: report at bugs.python.org (Michael Foord)
Date: Thu, 13 Jun 2019 11:02:27 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560423747.68.0.91538609739.issue19645@roundup.psfhosted.org>


Michael Foord <michael at voidspace.org.uk> added the comment:

Suppose failureException is set to TypeError on that TestCase class, how would your assertEquals signal failure to the test runner?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:03:45 2019
From: report at bugs.python.org (Michael Foord)
Date: Thu, 13 Jun 2019 11:03:45 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560423825.77.0.58179833746.issue19645@roundup.psfhosted.org>


Michael Foord <michael at voidspace.org.uk> added the comment:

Hmm, it could be done by __init_subclass__ potentially.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:04:53 2019
From: report at bugs.python.org (Michael Foord)
Date: Thu, 13 Jun 2019 11:04:53 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560423893.01.0.446544879003.issue19645@roundup.psfhosted.org>


Michael Foord <michael at voidspace.org.uk> added the comment:

Or even making the assert methods into custom descriptors.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:11:20 2019
From: report at bugs.python.org (Robert Collins)
Date: Thu, 13 Jun 2019 11:11:20 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560424280.02.0.662536833273.issue19645@roundup.psfhosted.org>


Robert Collins <robertc at robertcollins.net> added the comment:

Right now that attribute could be set by each test separately, or even varied within a test.

TBH I'm not sure that the attribute really should be supported; perhaps thinking about breaking the API is worth doing.

But - what are we solving for here. The OP here seems interested in using the assertion like things entirely outside of a test context.

What would a nice clean API for that be? (Yes I like matchers, but put that aside - if the APIs aren't close enough, lets make sure we do a good job for each audience rather than a compromise..)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:42:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 11:42:55 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1560426175.51.0.898647655662.issue20443@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13915
pull_request: https://github.com/python/cpython/pull/14053

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:43:48 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Thu, 13 Jun 2019 11:43:48 +0000
Subject: [issue19645] decouple unittest assertions from the TestCase class
In-Reply-To: <1384785494.56.0.149196031493.issue19645@psf.upfronthosting.co.za>
Message-ID: <1560426228.2.0.645981972677.issue19645@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

"Suppose failureException is set to TypeError on that TestCase class, how would your assertEquals signal failure to the test runner?"

failureException is an artefact from unittest.TestCase. It's only supposed to be used in a TestCase context, with an unittest-compatible runner. If people corrupt it, I guess it's their problem?

The point of decoupling is imho that other test runner might use the separate set of assertions. These assertions should raise a sensible default (i.e AssertionError) when encountering troubles, and accepting an alternate class as parameter will allow each test framework to customize the way these assertions behave for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19645>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:43:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 11:43:55 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1560426235.08.0.159408269828.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

PR 14053 is a different approach than PR 13527: compute the absolute path to the script filename in PyConfig_Read() just after parsing the command line.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:44:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 11:44:29 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560426269.88.0.436014383262.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset e40a97a721d46307dfdc2b0322028ccded6eb571 by Victor Stinner in branch '3.8':
[3.8] bpo-36402: Fix threading._shutdown() race condition (GH-13948) (GH-14050)
https://github.com/python/cpython/commit/e40a97a721d46307dfdc2b0322028ccded6eb571


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:45:00 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 11:45:00 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560426300.54.0.753715134564.issue36402@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13916
pull_request: https://github.com/python/cpython/pull/14054

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:59:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 11:59:02 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560427142.51.0.707898128062.issue37210@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 63ab4ba07b492448844940c347787ba30735b7f2 by Victor Stinner in branch 'master':
bpo-37210: Fix pure Python pickle when _pickle is unavailable (GH-14016)
https://github.com/python/cpython/commit/63ab4ba07b492448844940c347787ba30735b7f2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Thu Jun 13 07:59:03 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 11:59:03 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560427143.7.0.21329595835.issue37210@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
pull_requests: +13917
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14055

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:09:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:09:00 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1560427740.1.0.488013793637.issue18299@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:11:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:11:39 +0000
Subject: [issue37268] Deprecate the parser module
Message-ID: <1560427899.74.0.436857498848.issue37268@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The parser module should be deprecated as soon as possible according to Pablo Galindo Salgo and Guido van Rossum:
* https://mail.python.org/pipermail/python-dev/2019-May/157464.html
* https://bugs.python.org/issue37253#msg345398

I propose to deprecate it in Python 3.8: add a note in the documentation and emit a DeprecationWarning on "import parser".

----------
components: Library (Lib)
messages: 345504
nosy: vstinner
priority: normal
severity: normal
status: open
title: Deprecate the parser module
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37268>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:12:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:12:39 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560427959.38.0.0983683322874.issue37253@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> It's fine to document the current state. I don't think you should spend any time *changing* the API to "future-proof" it.

Ok.

> I am hoping that larger changes to the compiler implementation will happen before Python 4, which will make the whole API moot (including the "parser" module, which should be deprecated ASAP). The compiler is excluded from the ABI for a reason.

Aha, that sounds exciting :-)

I created bpo-37268 to propose to deprecate the parser module in Python 3.8.

--

PyCompilerFlags changes are now documented. I made the small code changes that I wanted to do in 3.8 and master. I close the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:16:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:16:34 +0000
Subject: [issue37268] Deprecate the parser module
In-Reply-To: <1560427899.74.0.436857498848.issue37268@roundup.psfhosted.org>
Message-ID: <1560428194.03.0.440115959227.issue37268@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I searched for "import parser" in GitHub code search, but I failed to find any project using the Python stdlib parser module. I only found copies of the CPython code source which has on "import parser" in Lib/test/test_parser.py.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37268>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:16:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:16:50 +0000
Subject: [issue37268] Deprecate the parser module
In-Reply-To: <1560427899.74.0.436857498848.issue37268@roundup.psfhosted.org>
Message-ID: <1560428210.53.0.334324186724.issue37268@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Pablo: Are you interested to implement this change?

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37268>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:17:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:17:00 +0000
Subject: [issue37253] PyCompilerFlags got a new cf_feature_version field
In-Reply-To: <1560352501.33.0.419965733273.issue37253@roundup.psfhosted.org>
Message-ID: <1560428220.29.0.144356905157.issue37253@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37253>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:22:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:22:25 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560428545.34.0.599329867053.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 6eb2878e42152e9c45d7ee5e6f889532d753e67c by Victor Stinner (Miss Islington (bot)) in branch '3.7':
bpo-36402: Fix threading._shutdown() race condition (GH-13948) (GH-14050) (GH-14054)
https://github.com/python/cpython/commit/6eb2878e42152e9c45d7ee5e6f889532d753e67c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:27:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:27:13 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560428833.2.0.627452789806.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The bpo-18808 "Thread.join returns before PyThreadState is destroyed" was not fixed in Python 2.7: threading.Thread has no _tstate_lock attribute. I'm not comfortable to backport bpo-18808 "feature" or "bugfix" to Python 2.7, not to backport this change.

Python 2.7 works as it is, and it's going to reach its end of life at the end of the year. I guess that people learnt how to work around Python 2.7 limitation like bpo-18808.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:28:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:28:09 +0000
Subject: [issue36402] threading._shutdown() race condition: test_threading
 test_threads_join_2() fails randomly
In-Reply-To: <1553296704.08.0.921014854557.issue36402@roundup.psfhosted.org>
Message-ID: <1560428889.93.0.539702145544.issue36402@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, the root issue (threading._shutdown() race condition) has been fixed in Python 3.7, 3.8 and master branches. I close the issue. Thanks for the reviews!

----------
components: +Library (Lib) -Tests
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36402>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:28:21 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 12:28:21 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560428901.36.0.263791166876.issue37210@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset cbda40db7b604b377acfd3f04e19407ca33748a7 by Miss Islington (bot) in branch '3.8':
bpo-37210: Fix pure Python pickle when _pickle is unavailable (GH-14016)
https://github.com/python/cpython/commit/cbda40db7b604b377acfd3f04e19407ca33748a7


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:28:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:28:44 +0000
Subject: [issue37210] Pure Python pickle module should not depend on
 _pickle.PickleBuffer
In-Reply-To: <1560111812.29.0.301182333638.issue37210@roundup.psfhosted.org>
Message-ID: <1560428924.15.0.693681727437.issue37210@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I pushed my change to 3.8 and master branches. I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37210>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:44:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:44:39 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560429879.0.0.757663486993.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If you care of inherited handles on Windows, please have a look at:

* https://github.com/python/cpython/pull/7827 from https://bugs.python.org/issue18174
* https://github.com/python/cpython/pull/7966 from https://bugs.python.org/issue33966

ref: https://pythondev.readthedocs.io/unstable_tests.html#windows-handles

I decided to give up because of multiprocessing race conditions. I failed to fix them.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:45:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 12:45:00 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560429900.83.0.967942988667.issue37261@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 6d22cc8e90ccb1e1965b1a4bc79456e2cc1e5a3e by Victor Stinner in branch 'master':
bpo-37261: Fix support.catch_unraisable_exception() (GH-14052)
https://github.com/python/cpython/commit/6d22cc8e90ccb1e1965b1a4bc79456e2cc1e5a3e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 08:45:28 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 12:45:28 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560429928.68.0.248608373937.issue37261@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13918
pull_request: https://github.com/python/cpython/pull/14056

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 09:22:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 13:22:57 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560432177.32.0.278476917927.issue36779@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0a9baec16c17d261377fb8a31a57d8c397e25af6 by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-36779: time.tzname returns empty string on Windows if default cod? (GH-13073) (GH-14032)
https://github.com/python/cpython/commit/0a9baec16c17d261377fb8a31a57d8c397e25af6


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Thu Jun 13 09:23:33 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 13:23:33 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560432213.88.0.443285835441.issue36779@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13919
pull_request: https://github.com/python/cpython/pull/14057

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Thu Jun 13 09:26:04 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 13:26:04 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560432364.37.0.962798875515.issue37261@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b4f5b212535e75503fc33513676837089037bb48 by Miss Islington (bot) in branch '3.8':
bpo-37261: Fix support.catch_unraisable_exception() (GH-14052)
https://github.com/python/cpython/commit/b4f5b212535e75503fc33513676837089037bb48


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 09:42:55 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 13:42:55 +0000
Subject: [issue36779] time.tzname returns empty string on Windows if default
 codepage is a Unicode codepage
In-Reply-To: <1556844322.34.0.979846087129.issue36779@roundup.psfhosted.org>
Message-ID: <1560433375.57.0.644989604342.issue36779@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6a433f5ae63de72a85d20b05ff826c6f72d529b7 by Miss Islington (bot) in branch '3.7':
bpo-36779: time.tzname returns empty string on Windows if default cod? (GH-13073)
https://github.com/python/cpython/commit/6a433f5ae63de72a85d20b05ff826c6f72d529b7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36779>
_______________________________________

From report at bugs.python.org  Thu Jun 13 09:45:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 13:45:26 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560433526.17.0.434908143248.issue37261@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I tested manually "./python -m test test_io -m CBufferedRWPairTest -R 3:3": it failed before the fix, it now pass on 3.8 and master with the fix. I close the issue.

Enjoy resurrected objects...

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:00:18 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 14:00:18 +0000
Subject: [issue6689] subprocess doesn't pass arguments correctly on Linux
 when	shell=True
In-Reply-To: <1250066038.48.0.373766477997.issue6689@psf.upfronthosting.co.za>
Message-ID: <1560434418.41.0.562597945385.issue6689@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 95492032c48fef20b9c7076a23fe7e46927a4688 by Miss Islington (bot) (Makdon) in branch 'master':
bpo-6689: os.path.commonpath raises ValueError for different drives isn't documented (GH-14045)
https://github.com/python/cpython/commit/95492032c48fef20b9c7076a23fe7e46927a4688


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6689>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:00:37 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 14:00:37 +0000
Subject: [issue6689] subprocess doesn't pass arguments correctly on Linux
 when	shell=True
In-Reply-To: <1250066038.48.0.373766477997.issue6689@psf.upfronthosting.co.za>
Message-ID: <1560434437.15.0.580561398909.issue6689@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13920
pull_request: https://github.com/python/cpython/pull/14058

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6689>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:13:15 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 14:13:15 +0000
Subject: [issue6689] subprocess doesn't pass arguments correctly on Linux
 when	shell=True
In-Reply-To: <1250066038.48.0.373766477997.issue6689@psf.upfronthosting.co.za>
Message-ID: <1560435195.76.0.549107375227.issue6689@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ec3839a215a68cf35ff1f90cb6823f67a5abdce3 by Miss Islington (bot) in branch '3.8':
bpo-6689: os.path.commonpath raises ValueError for different drives isn't documented (GH-14045)
https://github.com/python/cpython/commit/ec3839a215a68cf35ff1f90cb6823f67a5abdce3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6689>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:23:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 14:23:58 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560435838.94.0.557736593246.issue37261@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13921
pull_request: https://github.com/python/cpython/pull/14059

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:30:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 14:30:46 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1560436246.0.0.117652152917.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

One of the side effect of my PR 14053 is that tracebacks are more verbose: the filename is now absolute rather than relative.

Currently:

$ python3 x.py 
Traceback (most recent call last):
  File "x.py", line 4, in <module>
    func()
  File "x.py", line 2, in func
    bug
NameError: name 'bug' is not defined

With my PR:

$ ./python x.py 
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/x.py", line 4, in <module>
    func()
  File "/home/vstinner/prog/python/master/x.py", line 2, in func
    bug
NameError: name 'bug' is not defined

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:34:32 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 13 Jun 2019 14:34:32 +0000
Subject: [issue37268] Deprecate the parser module
In-Reply-To: <1560427899.74.0.436857498848.issue37268@roundup.psfhosted.org>
Message-ID: <1560436472.93.0.644758840378.issue37268@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Yep, will make a PR soon.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37268>
_______________________________________

From report at bugs.python.org  Thu Jun 13 10:51:41 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 13 Jun 2019 14:51:41 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560437501.5.0.837256035659.issue37111@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I think Vinay gets to make the call, but I also agree that some sort of error handling by default makes sense for logging. Especially now that it's (about to be) easier to override the default.

FWIW, I'd leave the default arguments as None and just coerce it as late as possible, before TextIOWrapper does it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Thu Jun 13 11:47:23 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 13 Jun 2019 15:47:23 +0000
Subject: [issue26180] multiprocessing.util._afterfork_registry leak in
 threaded environment
In-Reply-To: <1453476286.88.0.329468896089.issue26180@psf.upfronthosting.co.za>
Message-ID: <1560440843.61.0.280701194635.issue26180@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

With master and Windows 10, the output looks like
(0, 61333912, <function ForkAwareThreadLock._reset at 0x03A783F0>): <multiprocessing.util.ForkAwareThreadLock object at 0x03A7E198>
(1, 63524512, <function ForkAwareLocal.__init__.<locals>.<lambda> at 0x03CA2940>): <multiprocessing.util.ForkAwareLocal object at 0x03C94EA0>
(2, 60787504, <function ProcessLocalSet.__init__.<locals>.<lambda> at 0x03CA2760>): ProcessLocalSet()
(5, 63524512, <function ForkAwareLocal.__init__.<locals>.<lambda> at 0x03CA2C60>): <multiprocessing.util.ForkAwareLocal object at 0x03C94EA0>
... <8 more lines like the two with ForkAwareLocal.__init__....>

I am not familiar with multiprocessing Managers and the doc is not completely clear to me.  Does bug3.py only run in one process or does it result in multiple processes?  If the latter, I expect it would need an "if __name__ == '__main__':" clause, at least on Windows.  (Milan, I should have asked what OS you used, as mp has OS-specific behaviors.)
(https://docs.python.org/3/library/multiprocessing.html#the-spawn-and-forkserver-start-methods, Safe importing of main module)

----------
versions: +Python 3.9 -Python 2.7, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26180>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:11:27 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Thu, 13 Jun 2019 16:11:27 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560442287.73.0.551871269059.issue37241@roundup.psfhosted.org>


Jesse Bacon <jessembacon at me.com> added the comment:

I was using anaconda distribution on OSX.  It failed for 3.6 and 3.7.  I pulled off anaconda and compiled from source and the script executed correctly regardless of whether or not "--enable-optimizations" was set.  Anaconda claims to be geared towards scientists so this is alarming.  Thank you for your time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:13:03 2019
From: report at bugs.python.org (Jesse Bacon)
Date: Thu, 13 Jun 2019 16:13:03 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560442383.87.0.263718451774.issue37241@roundup.psfhosted.org>


Change by Jesse Bacon <jessembacon at me.com>:


----------
resolution:  -> third party

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:15:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 16:15:02 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560442502.66.0.508210096543.issue36710@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13922
pull_request: https://github.com/python/cpython/pull/14060

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:23:15 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 13 Jun 2019 16:23:15 +0000
Subject: [issue37264] Python 3.7.3 win 64bit - unresolved external symbol
 PyOS_AfterFork_Child
In-Reply-To: <1560414100.26.0.196764764517.issue37264@roundup.psfhosted.org>
Message-ID: <1560442995.02.0.248499169643.issue37264@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Windows does not have fork, and so the fork functionality is not built into it (PyOS_AfterFork() is empty).

You will need to report this to mod_wsgi to be able to build without fork support.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37264>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:24:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 16:24:37 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1560443077.18.0.449632192713.issue36763@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Two interesting TODO.

sysmodule.c: get_xoptions()

        /* PEP432 TODO: we can reach this if xoptions is NULL in the main
        *  interpreter config. When that happens, we need to properly set
         * the `xoptions` reference in the main interpreter config as well.
         *
         * For Python 3.7, we shouldn't be able to get here due to the
         * combination of how _PyMainInterpreter_ReadConfig and _PySys_EndInit
         * work, but we expect 3.8+ to make the _PyMainInterpreter_ReadConfig
         * call optional for embedding applications, thus making this
         * reachable again.
         */

sysmodule.c: get_warnoptions()

        /* PEP432 TODO: we can reach this if warnoptions is NULL in the main
        *  interpreter config. When that happens, we need to properly set
         * the `warnoptions` reference in the main interpreter config as well.
         *
         * For Python 3.7, we shouldn't be able to get here due to the
         * combination of how _PyMainInterpreter_ReadConfig and _PySys_EndInit
         * work, but we expect 3.8+ to make the _PyMainInterpreter_ReadConfig
         * call optional for embedding applications, thus making this
         * reachable again.
         */

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:29:52 2019
From: report at bugs.python.org (SilentGhost)
Date: Thu, 13 Jun 2019 16:29:52 +0000
Subject: [issue37241] Item Count Error in Shelf
In-Reply-To: <1560298385.81.0.460821118129.issue37241@roundup.psfhosted.org>
Message-ID: <1560443392.72.0.781311915411.issue37241@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37241>
_______________________________________

From report at bugs.python.org  Thu Jun 13 12:33:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 16:33:16 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1560443596.04.0.92935251256.issue36763@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

_PySys_ReadPreInitOptions() code should be moved somewhere closer to PyConfig_Read().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:16:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 13 Jun 2019 18:16:26 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560449786.94.0.937944308038.issue37213@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 3498c642f4e83f3d8e2214654c0fa8e0d51cebe5 by Pablo Galindo in branch 'master':
bpo-37213: Handle negative line deltas correctly in the peephole optimizer (GH-13969)
https://github.com/python/cpython/commit/3498c642f4e83f3d8e2214654c0fa8e0d51cebe5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:17:04 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 18:17:04 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560449824.1.0.213606275411.issue37213@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13923
pull_request: https://github.com/python/cpython/pull/14063

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:30:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 18:30:07 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560450607.38.0.556940891107.issue37213@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> The optimization is skipped if lnotab contains 255. It was very uncommon in older versions (only when the function contains very large expressions, larger than hundreds of lines or bytecode instructions), but in 3.8 this situation is common.

Do you know why 255 became more common? Is it the side effect if an AST optimization?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:36:03 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 18:36:03 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560450963.83.0.615756599392.issue37213@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5282b3b1d2e0bdf13899b1616aea20a6e3c4e13e by Miss Islington (bot) in branch '3.8':
bpo-37213: Handle negative line deltas correctly in the peephole optimizer (GH-13969)
https://github.com/python/cpython/commit/5282b3b1d2e0bdf13899b1616aea20a6e3c4e13e


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:51:17 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 13 Jun 2019 18:51:17 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560451877.87.0.0449033117685.issue37213@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Should we backport this to 3.7 as well?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 14:56:04 2019
From: report at bugs.python.org (Marius Gedminas)
Date: Thu, 13 Jun 2019 18:56:04 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
Message-ID: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>


New submission from Marius Gedminas <marius at gedmin.as>:

Python 3.8 miscompiles the following code:

    $ cat /tmp/wat.py
    enable_debug = False

    if not enable_debug or not __debug__:
        print("you shall not pass!")

    $ python3.7 /tmp/wat.py
    you shall not pass!

    $ python3.8 /tmp/wat.py

(no output is produced.)

This is a distilled example from zope.traversing's codebase (https://github.com/zopefoundation/zope.traversing/issues/13).

----------
components: Interpreter Core
messages: 345533
nosy: mgedmin
priority: normal
severity: normal
status: open
title: Python 3.8b1 miscompiles conditional expressions containing __debug__
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Thu Jun 13 15:00:03 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 13 Jun 2019 19:00:03 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560452403.33.0.843982156062.issue37213@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> Should we backport this to 3.7 as well?

Not unless someone can show how this is a major problem in 3.7 and then only if the changes will not introduce any 3.7.x compatibility problems.

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 15:01:58 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 13 Jun 2019 19:01:58 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560452518.02.0.967471548835.issue37213@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

> Not unless someone can show how this is a major problem in 3.7 

I would say is not a major problem in 3.7

I will close the issue then. Thanks everyone who participated!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Thu Jun 13 15:15:00 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 13 Jun 2019 19:15:00 +0000
Subject: [issue37130] pathlib.Path.with_name() handles '.' and '..'
 inconsistently
In-Reply-To: <1559438292.33.0.601764456145.issue37130@roundup.psfhosted.org>
Message-ID: <1560453300.23.0.868635300203.issue37130@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

@Antoine: Basically Path.with_name() fails under '.' but works with '..' although with a somewhat odd result. And then after that is the fact that Path('.').name is the empty string but for Path('..').name it's '..' (which is what causes Path('.').with_name() to fail).

----------
title: pathlib does not handle '..' directory -> pathlib.Path.with_name() handles '.' and '..' inconsistently

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37130>
_______________________________________

From report at bugs.python.org  Thu Jun 13 16:00:07 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 13 Jun 2019 20:00:07 +0000
Subject: [issue37260] shutil.rmtree() FileNotFoundError race condition
In-Reply-To: <1560388241.37.0.285109327745.issue37260@roundup.psfhosted.org>
Message-ID: <1560456007.35.0.852505186703.issue37260@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +13924
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14064

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37260>
_______________________________________

From report at bugs.python.org  Thu Jun 13 16:41:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 20:41:47 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560458507.42.0.307579384838.issue36710@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 838f26402de82640698c38ea9d2be65c6cf780d6 by Victor Stinner in branch 'master':
bpo-36710: Pass explicitly tstate in sysmodule.c (GH-14060)
https://github.com/python/cpython/commit/838f26402de82640698c38ea9d2be65c6cf780d6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Thu Jun 13 16:42:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 13 Jun 2019 20:42:49 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560458569.27.0.786262478767.issue36710@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote my notes on this issue there:
https://pythoncapi.readthedocs.io/runtime.html

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Thu Jun 13 17:31:34 2019
From: report at bugs.python.org (Joe Jevnik)
Date: Thu, 13 Jun 2019 21:31:34 +0000
Subject: [issue37270] Manage memory lifetime for all type-related objects.
Message-ID: <1560461494.72.0.39613394712.issue37270@roundup.psfhosted.org>


New submission from Joe Jevnik <joe at quantopian.com>:

When using PyType_FromSpec, the memory for PyType_Spec.name, Py_tp_methods, and Py_tp_members needs to somehow outlive the resulting type. This makes it hard to use this interface to generate types without just leaking the memory for these arrays, which is bad if you are programatically creating short-lived types.

I posted about this on capi-sig, and the response seemed to be that it would be to replace the things that currently hold pointers into the array with copies of the data.

Remove internal usages of PyMethodDef and PyGetSetDef.

For PyMethodDef, change PyCFunctionObject to replace the PyMethodDef* member
with a PyCFunctionBase member. The PyCFunctionBase is a new struct to hold the
managed values of a PyMethodDef. This type is shared between PyCFunction and the
various callable descriptor objects. A PyCFunctionBase is like a PyMethodDef but
replaces the char* members with PyObject* members.

For PyGetSetDef, inline the members on the resulting PyGetSetDescrObject,
replacing all char* members with PyObject* members. The memory for the closure
is *not* managed, adding support for that would likely require an API change and
can be done in a future change.

For the tp_name field, instead of setting it directly to the value of
PyType_Spec.name, set it to the result of PyUnicode_AsUTF8(ht_name), where
ht_name is the PyUnicode object created from the original spec name. This is the
same trick used to properly manage this pointer for heap types when the __name__
is reassigned.

----------
components: Extension Modules
messages: 345539
nosy: llllllllll
priority: normal
severity: normal
status: open
title: Manage memory lifetime for all type-related objects.
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37270>
_______________________________________

From report at bugs.python.org  Thu Jun 13 17:33:06 2019
From: report at bugs.python.org (Joe Jevnik)
Date: Thu, 13 Jun 2019 21:33:06 +0000
Subject: [issue37270] Manage memory lifetime for all type-related objects.
In-Reply-To: <1560461494.72.0.39613394712.issue37270@roundup.psfhosted.org>
Message-ID: <1560461586.25.0.431674082001.issue37270@roundup.psfhosted.org>


Change by Joe Jevnik <joe at quantopian.com>:


----------
keywords: +patch
pull_requests: +13925
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14066

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37270>
_______________________________________

From report at bugs.python.org  Thu Jun 13 18:35:09 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 22:35:09 +0000
Subject: [issue37077] Threading: add builtin TID attribute to Thread objects
 for AIX
In-Reply-To: <1559042935.56.0.899309127578.issue37077@roundup.psfhosted.org>
Message-ID: <1560465309.91.0.0602837541732.issue37077@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d0eeb936d8daf05d7d89f6935e3f4c0dee49c5be by Miss Islington (bot) (Michael Felt) in branch 'master':
bpo-37077: Add native thread ID (TID) for AIX (GH-13624)
https://github.com/python/cpython/commit/d0eeb936d8daf05d7d89f6935e3f4c0dee49c5be


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37077>
_______________________________________

From report at bugs.python.org  Thu Jun 13 18:35:13 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 22:35:13 +0000
Subject: [issue37077] Threading: add builtin TID attribute to Thread objects
 for AIX
In-Reply-To: <1559042935.56.0.899309127578.issue37077@roundup.psfhosted.org>
Message-ID: <1560465313.83.0.547887326712.issue37077@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13926
pull_request: https://github.com/python/cpython/pull/14067

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37077>
_______________________________________

From report at bugs.python.org  Thu Jun 13 18:36:07 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 13 Jun 2019 22:36:07 +0000
Subject: [issue37077] Threading: add builtin TID attribute to Thread objects
 for AIX
In-Reply-To: <1559042935.56.0.899309127578.issue37077@roundup.psfhosted.org>
Message-ID: <1560465367.02.0.554596615018.issue37077@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37077>
_______________________________________

From report at bugs.python.org  Thu Jun 13 18:54:12 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 13 Jun 2019 22:54:12 +0000
Subject: [issue37077] Threading: add builtin TID attribute to Thread objects
 for AIX
In-Reply-To: <1559042935.56.0.899309127578.issue37077@roundup.psfhosted.org>
Message-ID: <1560466452.49.0.218671861293.issue37077@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 886d83e5aa8df2dd2e93421d2f614438a3244a1c by Miss Islington (bot) in branch '3.8':
bpo-37077: Add native thread ID (TID) for AIX (GH-13624)
https://github.com/python/cpython/commit/886d83e5aa8df2dd2e93421d2f614438a3244a1c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37077>
_______________________________________

From report at bugs.python.org  Thu Jun 13 21:38:43 2019
From: report at bugs.python.org (Mark Grandi)
Date: Fri, 14 Jun 2019 01:38:43 +0000
Subject: [issue9694] argparse required arguments displayed under "optional
 arguments"
In-Reply-To: <1282846759.11.0.900867962743.issue9694@psf.upfronthosting.co.za>
Message-ID: <1560476323.71.0.734801202833.issue9694@roundup.psfhosted.org>


Mark Grandi <markgrandi at gmail.com> added the comment:

Is there anything that can be done to help this issue move along? I just ran into it just now

----------
nosy: +markgrandi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9694>
_______________________________________

From report at bugs.python.org  Thu Jun 13 21:58:30 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 01:58:30 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
Message-ID: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

The peephole optimizer currently does not optimize the result of its own optimization when its possible. For example, consider the following code:

    if a:
        if b:
            if (c or d):
                foo()
        else:
            bar()
    else:
        baz()

The bytecode for this is:

  2           0 LOAD_GLOBAL              0 (a)
              2 POP_JUMP_IF_FALSE       32

  4           4 LOAD_GLOBAL              1 (b)
              6 POP_JUMP_IF_FALSE       24

  5           8 LOAD_GLOBAL              2 (c)
             10 POP_JUMP_IF_TRUE        16

  6          12 LOAD_GLOBAL              3 (d)
             14 POP_JUMP_IF_FALSE       30

  7     >>   16 LOAD_GLOBAL              4 (foo)
             18 CALL_FUNCTION            0
             20 POP_TOP
             22 JUMP_ABSOLUTE           38

  9     >>   24 LOAD_GLOBAL              5 (bar)
             26 CALL_FUNCTION            0
             28 POP_TOP
        >>   30 JUMP_FORWARD             6 (to 38)

 11     >>   32 LOAD_GLOBAL              6 (baz)
             34 CALL_FUNCTION            0
             36 POP_TOP
        >>   38 LOAD_CONST               0 (None)
             40 RETURN_VALUE

Notice that the 14 POP_JUMP_IF_FALSE 30 jumps to another jump (30 JUMP_FORWARD 6 (to 38)). If we repeat the optimizations until the resulting bytecode does not change more we get:

  2           0 LOAD_GLOBAL              0 (a)
              2 POP_JUMP_IF_FALSE       32

  4           4 LOAD_GLOBAL              1 (b)
              6 POP_JUMP_IF_FALSE       24

  5           8 LOAD_GLOBAL              2 (c)
             10 POP_JUMP_IF_TRUE        16

  6          12 LOAD_GLOBAL              3 (d)

  5          14 POP_JUMP_IF_FALSE       38

  7     >>   16 LOAD_GLOBAL              4 (foo)
             18 CALL_FUNCTION            0
             20 POP_TOP
             22 JUMP_ABSOLUTE           38

  9     >>   24 LOAD_GLOBAL              5 (bar)
             26 CALL_FUNCTION            0
             28 POP_TOP
             30 JUMP_FORWARD             6 (to 38)

 11     >>   32 LOAD_GLOBAL              6 (baz)
             34 CALL_FUNCTION            0
             36 POP_TOP
        >>   38 LOAD_CONST              

Notice that in this example the original instruction now is (14 POP_JUMP_IF_FALSE  38).

----------
components: Interpreter Core
messages: 345543
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Make multiple passes of the peephole optimizer until bytecode cannot be optimized further
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Thu Jun 13 21:58:49 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 01:58:49 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560477529.57.0.919838020045.issue37271@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13927
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14068

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Thu Jun 13 22:00:32 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 02:00:32 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560477632.05.0.19478350288.issue37271@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Thu Jun 13 23:34:40 2019
From: report at bugs.python.org (Dull Bananas)
Date: Fri, 14 Jun 2019 03:34:40 +0000
Subject: [issue37272] pygit2 won't build
Message-ID: <1560483280.0.0.881909893602.issue37272@roundup.psfhosted.org>


New submission from Dull Bananas <dull.bananas0 at gmail.com>:

I am not sure if this is an issue with Python or pygit2, but Pyhton 3.8 and 3.9 are unable to build the pygit2 package, and an error with gcc occurs. This is causing errors on my Travis CI build; here is a link where you can see build logs for my project that depends on pygit2: https://travis-ci.org/dullbananas/shellp

----------
components: Extension Modules
messages: 345544
nosy: Dull Bananas
priority: normal
severity: normal
status: open
title: pygit2 won't build
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37272>
_______________________________________

From report at bugs.python.org  Thu Jun 13 23:39:55 2019
From: report at bugs.python.org (paul j3)
Date: Fri, 14 Jun 2019 03:39:55 +0000
Subject: [issue9694] argparse required arguments displayed under "optional
 arguments"
In-Reply-To: <1282846759.11.0.900867962743.issue9694@psf.upfronthosting.co.za>
Message-ID: <1560483595.81.0.777330334855.issue9694@roundup.psfhosted.org>


paul j3 <ajipanca at gmail.com> added the comment:

Mark,

Have you tried defining your own Argument Group?  If that didn't work, what fix do you want?  Why?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9694>
_______________________________________

From report at bugs.python.org  Thu Jun 13 23:49:16 2019
From: report at bugs.python.org (Luiz Amaral)
Date: Fri, 14 Jun 2019 03:49:16 +0000
Subject: [issue37273] from pickle import rick
Message-ID: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>


New submission from Luiz Amaral <luizamaral306 at gmail.com>:

from pickle import rick
print(rick)

----------
components: Library (Lib)
messages: 345546
nosy: luxedo
priority: normal
pull_requests: 13928
severity: normal
status: open
title: from pickle import rick
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Thu Jun 13 23:49:24 2019
From: report at bugs.python.org (Luiz Amaral)
Date: Fri, 14 Jun 2019 03:49:24 +0000
Subject: [issue37273] from pickle import rick
In-Reply-To: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>
Message-ID: <1560484164.9.0.272963075645.issue37273@roundup.psfhosted.org>


Change by Luiz Amaral <luizamaral306 at gmail.com>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Fri Jun 14 00:03:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 04:03:29 +0000
Subject: [issue37273] from pickle import rick
In-Reply-To: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>
Message-ID: <1560485009.6.0.0839363658173.issue37273@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Can you please add a description over why you want to include the text in PR as part of pickle and the improvement it provides to the user?

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Fri Jun 14 00:08:33 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Fri, 14 Jun 2019 04:08:33 +0000
Subject: [issue37273] from pickle import rick
In-Reply-To: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>
Message-ID: <1560485313.48.0.827866272554.issue37273@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

This looks like some sort of spam or joke.

There's no explanation given of what this enhancement does, the PR seems to add only a rather suspicious looking triple-quoted string. (Possibly really bad ASCII art of a finger?)

In the absence of any meaningful description of what the enhancement is supposed to do, or why it should be added as an enhancement, I'm closing this as Rejected.

----------
nosy: +steven.daprano
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Fri Jun 14 00:46:37 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Fri, 14 Jun 2019 04:46:37 +0000
Subject: [issue37273] from pickle import rick
In-Reply-To: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>
Message-ID: <1560487597.78.0.858882103814.issue37273@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

It is Pickle Rick from Rick and Morty. 

https://en.wikipedia.org/wiki/Pickle_Rick

No need to be in python libraries. But you can make your own library on github with this kind of art. :)

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Fri Jun 14 00:50:52 2019
From: report at bugs.python.org (Hansol Moon)
Date: Fri, 14 Jun 2019 04:50:52 +0000
Subject: [issue37274] Scripts folder is empty in python 3.7.3 for windows.
Message-ID: <1560487852.05.0.608471969466.issue37274@roundup.psfhosted.org>


New submission from Hansol Moon <withgrit.hs at gmail.com>:

I downloaded python 3.7.3 which is the latest version of python for windows. And I was going to download Pygame via pip in Python.
and I found out that the scripts folder in Python is literally empty.
so I was not able to use pip to install Pygame..
I tried reinstalling over and over, but I have kept getting the empty scripts folder. I have no idea how to fix this.

----------
components: Installation
messages: 345550
nosy: Hansol Moon
priority: normal
severity: normal
status: open
title: Scripts folder is empty in python 3.7.3 for windows.
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37274>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:10:06 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 05:10:06 +0000
Subject: [issue37274] Scripts folder is empty in python 3.7.3 for windows.
In-Reply-To: <1560487852.05.0.608471969466.issue37274@roundup.psfhosted.org>
Message-ID: <1560489006.93.0.215687668369.issue37274@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37274>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:21:05 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 14 Jun 2019 05:21:05 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560489665.84.0.86365092708.issue37258@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:27:43 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 05:27:43 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560490063.78.0.441216380327.issue37269@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13929
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14071

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:38:27 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 05:38:27 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560490707.93.0.396499061993.issue37269@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:46:30 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 14 Jun 2019 05:46:30 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
Message-ID: <1560491190.29.0.949105060129.issue37275@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

When stdout is redirected to file and cp65001 is used, stdout encoding is unexpectable:

  # Power Shell 6 (use cp65001 by default)
  PS C:?> python3 -c "print('????')" > ps.txt

  # cmd.exe
  C:?> chcp 65001
  C:?> python3 -c "print('????')" > cmd.txt

Now, ps.txt is encoded by UTF-8, but cmd.txt is encoded by cp932 (ACP).


This is because:

* TextIOWrapper tries `os.device_encoding(1)`
* `os.device_encoding(1)` use GetConsoleOutputCP() without checking stdout is console

In the example above, a console is attached when python is called from Power Shell 6, but it is not attached when python is called from cmd.exe.

I think using GetConsoleOutputCP() for non console is abusing.

---

There is a relating issue: UTF-8 mode doesn't override stdin,stdout,stderr encoding when console is attached.

On Unix, os.device_encoding() uses locale encoding and UTF-8 mode overrides locale encoding.  Good.

But on Windows, os.device_encoding() uses GetConsole(Output)CP().  UTF-8 mode doesn't override it.

If we stop abusing GetConsoleOutputCP(), this issue is fixed automatically.
But if we keep using GetConsoleOutputCP() for stdout which is not a console, UTF-8 mode should override it.

----------
components: Windows
messages: 345551
nosy: inada.naoki, paul.moore, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: GetConsole(Output)CP is used even when stdin/stdout is redirected
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:55:00 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 05:55:00 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560491700.91.0.36282340648.issue37269@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 05f831865545b08c9a21cfb7773af58b76ec64cb by Pablo Galindo in branch 'master':
bpo-37269: Correctly optimise conditionals with constant booleans (GH-14071)
https://github.com/python/cpython/commit/05f831865545b08c9a21cfb7773af58b76ec64cb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:55:26 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 05:55:26 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560491726.24.0.78668387655.issue37269@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13930
pull_request: https://github.com/python/cpython/pull/14072

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 01:58:22 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 05:58:22 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560491902.38.0.579800816719.issue37269@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13931
pull_request: https://github.com/python/cpython/pull/14073

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:08:05 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 14 Jun 2019 06:08:05 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
Message-ID: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>


New submission from G?ry <gery.ogam at gmail.com>:

In the `concurrent.futures` standard module, the number of running calls in a `ProcessPoolExecutor` is `max_workers + 1` (unexpected) instead of `max_workers` (expected) like in a `ThreadingPoolExecutor`.

The following code snippet which submits 8 calls to 2 workers in a `ProcessPoolExecutor`:

    import concurrent.futures
    import time
    
    
    def call():
        while True:
            time.sleep(1)
    
    
    if __name__ == "__main__":
        with concurrent.futures.ProcessPoolExecutor(max_workers=2) as executor:
            futures = [executor.submit(call) for _ in range(8)]
    
            for future in futures:
                print(future.running())

prints this (3 running calls; unexpected since there are 2 workers):

> True
> True
> True
> False
> False
> False
> False
> False

while using a `ThreadPoolExecutor` prints this (2 running calls; expected):

> True
> True
> False
> False
> False
> False
> False
> False

Tested on both Windows 10 and MacOS 10.14.

----------
components: Library (Lib)
messages: 345553
nosy: asvetlov, bquinlan, inada.naoki, lukasz.langa, maggyero, ned.deily, pitrou, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: Incorrect number of running calls in ProcessPoolExecutor
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:13:28 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 06:13:28 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560492808.76.0.311775796496.issue37269@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7cd581a6bf82309b3c9b9251c54067d442732485 by Miss Islington (bot) in branch '3.8':
bpo-37269: Correctly optimise conditionals with constant booleans (GH-14071)
https://github.com/python/cpython/commit/7cd581a6bf82309b3c9b9251c54067d442732485


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:18:54 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 06:18:54 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560493134.59.0.814156533321.issue37269@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 5292179afc6fd0dc533add054d4790773c9766d0 by Pablo Galindo in branch '3.7':
[3.7] bpo-37269: Correctly optimise conditionals with constant booleans (GH-14071) (GH-14073)
https://github.com/python/cpython/commit/5292179afc6fd0dc533add054d4790773c9766d0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:19:13 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Fri, 14 Jun 2019 06:19:13 +0000
Subject: [issue37269] Python 3.8b1 miscompiles conditional expressions
 containing __debug__
In-Reply-To: <1560452164.81.0.0834317425739.issue37269@roundup.psfhosted.org>
Message-ID: <1560493153.95.0.396019831188.issue37269@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks, Marius for the report!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37269>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:20:31 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 14 Jun 2019 06:20:31 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1560493231.09.0.888871160269.issue32912@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

In the particular case of pyparsing there was a bug in the docstring.

     def sub(self, repl): 
         """ 
         Return Regex with an attached parse action to transform the parsed 
         result as if called using `re.sub(expr, repl, string) <https://docs.python.org/3/library/re.html#re.sub>`_. 
  
         Example:: 
  
             make_html = Regex(r"(\w+):(.*?):").sub(r"<\1>\2</\1>") 
             print(make_html.transformString("h1:main title:")) 
             # prints "<h1>main title</h1>" 
        """

\1 and \2 were interpreted as control characters U+0001 and U+0002, so the user could see 

        make_html = Regex(r"(\w+):(.*?):").sub(r"<^A>^B</^A>")

or

        make_html = Regex(r"(\w+):(.*?):").sub(r"<?>?</?>")

or

        make_html = Regex(r"(\w+):(.*?):").sub(r"<></>")

depending on the output device.

So this examples proves the usefulness of the new warning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:30:26 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 06:30:26 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
In-Reply-To: <1560491190.29.0.949105060129.issue37275@roundup.psfhosted.org>
Message-ID: <1560493826.09.0.214935747753.issue37275@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:36:15 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 14 Jun 2019 06:36:15 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1560494175.1.0.762428746363.issue32912@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Aaron, you have reported several different issues in your message:

* compiler warnings are emitted only once, therefore it is easy to miss them and hard to reproduce.

* warnings for multiline expressions (and multiline string literals in particularly) could be better.

* strange output of spaces in some cases.

And maybe more.

I think all of them deserve opening separate issues.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:36:36 2019
From: report at bugs.python.org (Christoph Reiter)
Date: Fri, 14 Jun 2019 06:36:36 +0000
Subject: [issue37272] pygit2 won't build
In-Reply-To: <1560483280.0.0.881909893602.issue37272@roundup.psfhosted.org>
Message-ID: <1560494196.1.0.249832817333.issue37272@roundup.psfhosted.org>


Christoph Reiter <reiter.christoph at gmail.com> added the comment:

pygit2 requires libgit2 to build which means you need to install the "libgit2-dev" package through apt.

See https://docs.travis-ci.com/user/installing-dependencies/ for how to install packages in your travis-ci setup.

The reason it works with stable Python versions is that pygit2 provides pre-built wheels on pypi for those: https://pypi.org/project/pygit2/#files

----------
nosy: +lazka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37272>
_______________________________________

From report at bugs.python.org  Fri Jun 14 02:52:19 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 06:52:19 +0000
Subject: [issue37272] pygit2 won't build
In-Reply-To: <1560483280.0.0.881909893602.issue37272@roundup.psfhosted.org>
Message-ID: <1560495139.03.0.181525346247.issue37272@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks @lazka for the details. I am closing this as third party issue.

----------
nosy: +xtreak
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37272>
_______________________________________

From report at bugs.python.org  Fri Jun 14 03:05:58 2019
From: report at bugs.python.org (Milan Zamazal)
Date: Fri, 14 Jun 2019 07:05:58 +0000
Subject: [issue26180] multiprocessing.util._afterfork_registry leak in
 threaded environment
In-Reply-To: <1453476286.88.0.329468896089.issue26180@psf.upfronthosting.co.za>
Message-ID: <1560495958.66.0.0129424965297.issue26180@roundup.psfhosted.org>


Milan Zamazal <mzamazal at redhat.com> added the comment:

I used Linux.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26180>
_______________________________________

From report at bugs.python.org  Fri Jun 14 03:10:34 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 14 Jun 2019 07:10:34 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560496234.31.0.0177439424143.issue37213@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Do you know why 255 became more common?

Because the line number is now correctly set for every bytecode instruction.

Compare the output in msg345108 for 3.8 with the corresponding output in 3.7:

  1           0 BUILD_LIST               0
              2 LOAD_FAST                0 (.0)
        >>    4 FOR_ITER                12 (to 18)

  2           6 STORE_FAST               1 (x)
              8 LOAD_FAST                1 (x)
             10 POP_JUMP_IF_FALSE        4
             12 LOAD_FAST                1 (x)
             14 LIST_APPEND              2
             16 JUMP_ABSOLUTE            4
        >>   18 RETURN_VALUE

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Fri Jun 14 04:41:30 2019
From: report at bugs.python.org (Konstantin Enchant)
Date: Fri, 14 Jun 2019 08:41:30 +0000
Subject: [issue37277] http.cookies.SimpleCookie does not parse attribute
 without value (rfc2109)
Message-ID: <1560501690.14.0.434114387204.issue37277@roundup.psfhosted.org>


New submission from Konstantin Enchant <sirkonst at gmail.com>:

Very strange case but https://www.ietf.org/rfc/rfc2109.txt (see 4.1  Syntax:  General) defines that "= value" is optional for attribute-value pairs for header Cookie.

And SimpleCookie fully broken if meets attribute without value, example:

```
>>> from http.cookies import SimpleCookie

# all ok
>>> SimpleCookie('a=1')
<SimpleCookie: a='1'>

# parse fully broken and does not parse not only `test` but `a` too
>>> SimpleCookie('test; a=1')
<SimpleCookie: >

# or
>>> SimpleCookie('a=1; test; b=2')
<SimpleCookie: >
```

I think the problem hasn't been noticed for so long because people usually use frameworks, for example, Django parse it correctly because has workaround - https://github.com/django/django/blob/master/django/http/cookie.py#L20.

Also Go Lang handle that case too, example - https://play.golang.org/p/y0eFXVq6byK

(How can you see Go Lang and Django has different behavior for that case and I think Go Lang more better do it.)

The problem seems minor not but aiohttp use SimpleCookie as is (https://github.com/aio-libs/aiohttp/blob/3.5/aiohttp/web_request.py#L482) and if request has that strange cookie value mixed with other normal values - all cookies can not be parsed by aiohttp (just request.cookies is empty). 

In real world in my web application (based on aiohttp) it fully break authentication for request based on cookies.

I hope that will be fixed for SimpleCookie without implement workaround for aiohttp like Django.

----------
messages: 345563
nosy: sirkonst
priority: normal
severity: normal
status: open
title: http.cookies.SimpleCookie does not parse attribute without value (rfc2109)
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37277>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:07:19 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 09:07:19 +0000
Subject: [issue37277] http.cookies.SimpleCookie does not parse attribute
 without value (rfc2109)
In-Reply-To: <1560501690.14.0.434114387204.issue37277@roundup.psfhosted.org>
Message-ID: <1560503239.46.0.0308233542698.issue37277@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This could be due to issue22796. See also https://bugs.python.org/issue27828#msg273355.

?  cpython git:(master) ? git checkout b1e36073cdde71468efa27e88016aa6dd46f3ec7~1 Lib/http/cookies.py
?  cpython git:(master) ? ./python.exe -c 'from http.cookies import SimpleCookie; print(SimpleCookie("a=1; test;"))' # parses a=1
Set-Cookie: a=1
?  cpython git:(master) ? git checkout b1e36073cdde71468efa27e88016aa6dd46f3ec7 Lib/http/cookies.py
?  cpython git:(master) ? ./python.exe -c 'from http.cookies import SimpleCookie; print(SimpleCookie("a=1; test;"))' # No value printed

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37277>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:14:30 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 14 Jun 2019 09:14:30 +0000
Subject: [issue37277] http.cookies.SimpleCookie does not parse attribute
 without value (rfc2109)
In-Reply-To: <1560501690.14.0.434114387204.issue37277@roundup.psfhosted.org>
Message-ID: <1560503670.87.0.313731667563.issue37277@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

This was previously reported in #27828 and was introduced by #22796 in order to fix potential security issue. Not every attribute would cause the failure to parse, but only an unusual ones (that is normally occurring "reserved" httponly or secure attributes are handled just fine).

I'd propose that a more appropriate course of action would be to stop claiming compliance with RFC 2109 and instead refer to the RFC 6265 as its behaviour is being currently implemented.

----------
nosy: +SilentGhost, pitrou -xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37277>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:14:43 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 14 Jun 2019 09:14:43 +0000
Subject: [issue37277] http.cookies.SimpleCookie does not parse attribute
 without value (rfc2109)
In-Reply-To: <1560501690.14.0.434114387204.issue37277@roundup.psfhosted.org>
Message-ID: <1560503683.53.0.32859654787.issue37277@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37277>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:49:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 09:49:54 +0000
Subject: [issue37213] Peeephole optimizer does not optimize functions with
 multiline expressions
In-Reply-To: <1560155063.44.0.426038128869.issue37213@roundup.psfhosted.org>
Message-ID: <1560505794.78.0.843995565885.issue37213@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Because the line number is now correctly set for every bytecode instruction.

That's a great enhancement! Should it be documented in https://docs.python.org/3.8/whatsnew/3.8.html ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37213>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:51:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 09:51:13 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1560505873.83.0.0444975704813.issue37276@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:54:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 09:54:38 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560506078.63.0.369636545217.issue37214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote this issue to discuss https://www.python.org/dev/peps/pep-0597/ but it's unrelated to the implementation of this PEP :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:55:44 2019
From: report at bugs.python.org (Rahul Virpara)
Date: Fri, 14 Jun 2019 09:55:44 +0000
Subject: [issue37274] Scripts folder is empty in python 3.7.3 for windows.
In-Reply-To: <1560487852.05.0.608471969466.issue37274@roundup.psfhosted.org>
Message-ID: <1560506144.23.0.958115634326.issue37274@roundup.psfhosted.org>


Rahul Virpara <rahulvirpara61 at gmail.com> added the comment:

This happened to me when I used customized option and unticked "pip".

I assume you are not doing the same.

----------
nosy: +Rahul Virpara

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37274>
_______________________________________

From report at bugs.python.org  Fri Jun 14 05:56:39 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Fri, 14 Jun 2019 09:56:39 +0000
Subject: [issue25567] shlex.quote doesn't work on bytestrings
In-Reply-To: <1446814343.82.0.823951892686.issue25567@psf.upfronthosting.co.za>
Message-ID: <1560506199.62.0.439765568631.issue25567@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Python 3.9.0a0
[GCC 7.3.0] on linux
>>> import re
>>> find_unsafe_bytes = re.compile(b'[^\w@%+=:,./-]').search
<stdin>:1: SyntaxWarning: invalid escape sequence \w

when removing \w, all the tests pass

(my regex knowledge is close to None.)

"\w stands for "word character". It always matches the ASCII characters [A-Za-z0-9_]"

replace \w with A-Za-z0-9_ ?? (all the tests pass)

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25567>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:19:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 10:19:11 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
Message-ID: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

vstinner at WIN C:\vstinner\python\master>python -m test -R 3:3 test_asyncio -m test.test_asyncio.test_windows_events.ProactorLoopCtrlC.test_ctrl_c
Running Debug|x64 interpreter...
Run tests sequentially
0:00:00 load avg: 0.00 [1/1] test_asyncio
beginning 6 repetitions
123456
......
test_asyncio leaked [1, 1, 1] references, sum=3
test_asyncio leaked [2, 1, 1] memory blocks, sum=4
test_asyncio failed

== Tests result: FAILURE ==

1 test failed:
    test_asyncio

Total duration: 13 sec 391 ms
Tests result: FAILURE



Attached PR fix the issue by joining the thread.

----------
components: Tests, asyncio
messages: 345570
nosy: asvetlov, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: test_asyncio: ProactorLoopCtrlC leaks one reference
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:21:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 10:21:19 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560507679.74.0.546525222283.issue37278@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13932
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14074

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:25:04 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:25:04 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
Message-ID: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>


New submission from Andrew Svetlov <andrew.svetlov at gmail.com>:

My fault introduced in 3.7 in initial async sendfile implementation

----------
components: asyncio
messages: 345571
nosy: asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: asyncio sendfile sends extra data in the last chunk in fallback mode
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:26:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 10:26:17 +0000
Subject: [issue34520] test_asyncio leaked [2, 2, 2] references,
 sum=6 in AMD64 Windows8.1 Refleaks 3.7
In-Reply-To: <1535386947.0.0.56676864532.issue34520@psf.upfronthosting.co.za>
Message-ID: <1560507977.11.0.190566567802.issue34520@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Sadly, without much information, it's hard to guess what leaked nor if the issue has been fixed in the meanwhile. So I close the issue as outdated.

I just found a leak in test_asyncio ProactorLoopCtrlC and I proposed a fix: https://bugs.python.org/issue37278

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34520>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:26:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 10:26:43 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560508003.19.0.237028795661.issue37278@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

bpo-34520 *might* be an old duplicate of this bug.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:27:13 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:27:13 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560508033.34.0.631519305043.issue37279@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +13933
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14075

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:29:49 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:29:49 +0000
Subject: [issue37280] Use threadpool for reading from file for sendfile
 fallback mode
Message-ID: <1560508189.12.0.504777268427.issue37280@roundup.psfhosted.org>


New submission from Andrew Svetlov <andrew.svetlov at gmail.com>:

We use thread pool executor for loop.sock_sendfile(), there is no reason to call blocking code for loop.sendfile()

----------
components: asyncio
messages: 345574
nosy: asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Use threadpool for reading from file for sendfile fallback mode
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37280>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:32:04 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:32:04 +0000
Subject: [issue37280] Use threadpool for reading from file for sendfile
 fallback mode
In-Reply-To: <1560508189.12.0.504777268427.issue37280@roundup.psfhosted.org>
Message-ID: <1560508324.05.0.894603074976.issue37280@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +13934
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14076

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37280>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:32:18 2019
From: report at bugs.python.org (=?utf-8?b?0JLQsNC70LXQvdGC0LjQvSDQkdGD0YDRh9C10L3Rjw==?=)
Date: Fri, 14 Jun 2019 10:32:18 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
Message-ID: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>


New submission from ???????? ??????? <vp.burchenya at gmail.com>:

Future has a done_callback, but Task not, why ?
Is a safe to use Task._fut_waiter future done_callback?

----------
messages: 345575
nosy: ???????? ???????
priority: normal
severity: normal
status: open
title: asyncio Task._fut_waiter done callback
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:37:19 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 14 Jun 2019 10:37:19 +0000
Subject: [issue37249] Missing declaration of _PyObject_GetMethod
In-Reply-To: <1560344083.09.0.0843105430865.issue37249@roundup.psfhosted.org>
Message-ID: <1560508639.72.0.328389985524.issue37249@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset b2f94730d947f25b8507c5f76202e917683e76f7 by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37249: add declaration of _PyObject_GetMethod (GH-14015)
https://github.com/python/cpython/commit/b2f94730d947f25b8507c5f76202e917683e76f7


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37249>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:37:37 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 14 Jun 2019 10:37:37 +0000
Subject: [issue37249] Missing declaration of _PyObject_GetMethod
In-Reply-To: <1560344083.09.0.0843105430865.issue37249@roundup.psfhosted.org>
Message-ID: <1560508657.21.0.365051731309.issue37249@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37249>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:38:02 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 10:38:02 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
In-Reply-To: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>
Message-ID: <1560508682.95.0.97135517916.issue37281@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +asyncio
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:40:27 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 14 Jun 2019 10:40:27 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560508827.7.0.955888044882.issue28805@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Victor, of the four functions you mentioned:

- _PyObject_FastCallDict: documented by PEP 590

- _PyObject_FastCallKeywords: renamed _PyObject_Vectorcall and documented by PEP 590

- _PyObject_FastCall: not sure if it's useful enough (just use _PyObject_Vectorcall with kwnames=NULL)

- _PyObject_CallNoArg: see #37194

So that leaves documenting METH_FASTCALL.

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:44:26 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:44:26 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
In-Reply-To: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>
Message-ID: <1560509066.12.0.926618401815.issue37281@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

1. Task._fut_waiter is a private API, please avoid it
2. Task class is derived from Future, thus it HAS add_done_callback() method. The other question is that from my experience if the application-level code uses add_done_callback() the design is not perfect and error-prone. add_done_callback() is useful for relatively low-level libraries.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 06:46:22 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 10:46:22 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560509182.33.0.971881876998.issue37278@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Maybe. Agree with your decision to close bpo-34520 as duplicate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:01:44 2019
From: report at bugs.python.org (=?utf-8?q?Jonat=C3=A3_Bolzan_Loss?=)
Date: Fri, 14 Jun 2019 11:01:44 +0000
Subject: [issue37282] os problems on absolute paths containing unicode
 characters on windows
Message-ID: <1560510104.32.0.366432757935.issue37282@roundup.psfhosted.org>


New submission from Jonat? Bolzan Loss <jbopen at gmail.com>:

If a absolute path is provided for some function on os module, it returns "WinError 3".

Example (considering you are on C:\Users\username):

import os                                                                                                           os.mkdir(u'Exam?pl?')
os.listdir(u'C:\\Users\username\Exam?pl?')

Result:

Traceback (most recent call last):                                                                                        File "<stdin>", line 1, in <module>                                                                                   FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\\Users\\username\\Exam?pl?'

----------
components: Windows
messages: 345580
nosy: Jonat? Bolzan Loss, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: os problems on absolute paths containing unicode characters on windows
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37282>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:03:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 11:03:06 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560510186.59.0.0553157746938.issue37278@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 07559450b2d9179e4c99e0af088ce7550e549f94 by Victor Stinner in branch 'master':
bpo-37278: Fix test_asyncio ProactorLoopCtrlC (GH-14074)
https://github.com/python/cpython/commit/07559450b2d9179e4c99e0af088ce7550e549f94


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:03:24 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 11:03:24 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560510204.65.0.848181924706.issue37278@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13935
pull_request: https://github.com/python/cpython/pull/14077

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:04:58 2019
From: report at bugs.python.org (=?utf-8?b?0JLQsNC70LXQvdGC0LjQvSDQkdGD0YDRh9C10L3Rjw==?=)
Date: Fri, 14 Jun 2019 11:04:58 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
In-Reply-To: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>
Message-ID: <1560510298.69.0.624595615932.issue37281@roundup.psfhosted.org>


???????? ??????? <vp.burchenya at gmail.com> added the comment:

Sorry, you right! But why not set_result and set_exception?
My code: waiter_task.add_done_callback(lambda f: f.result()) because i don't wont to store my running tasks in the array but i must query awaiteable for the result.
Thank you for a reply.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:07:06 2019
From: report at bugs.python.org (Paul Moore)
Date: Fri, 14 Jun 2019 11:07:06 +0000
Subject: [issue37282] os problems on absolute paths containing unicode
 characters on windows
In-Reply-To: <1560510104.32.0.366432757935.issue37282@roundup.psfhosted.org>
Message-ID: <1560510426.17.0.878653288315.issue37282@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

This works for me on Python 3.7. Can you confirm if you see the problem on 3.7, and if so, provide a more detailed example of how to reproduce?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37282>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:09:33 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 11:09:33 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
In-Reply-To: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>
Message-ID: <1560510573.55.0.190182418416.issue37281@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

See bpo-32363

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:13:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 11:13:33 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1560510813.27.0.459581465553.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The site module tries to compute the absolute path of __file__ and __cached__ attributes of all modules in sys.modules:

def abs_paths():
    """Set all module __file__ and __cached__ attributes to an absolute path"""
    for m in set(sys.modules.values()):
        if (getattr(getattr(m, '__loader__', None), '__module__', None) not in
                ('_frozen_importlib', '_frozen_importlib_external')):
            continue   # don't mess with a PEP 302-supplied __file__
        try:
            m.__file__ = os.path.abspath(m.__file__)
        except (AttributeError, OSError, TypeError):
            pass
        try:
            m.__cached__ = os.path.abspath(m.__cached__)
        except (AttributeError, OSError, TypeError):
            pass

The __path__ attribute isn't updated.

Another approach would be to hack importlib to compute the absolute path before loading a module, rather than trying to fix it *afterwards*.

One pratical problem: posixpath and ntpath are not available when importlib is setup, these modules are implemented in pure Python and so must be imported.

Maybe importlib could use a naive implementation of os.path.abspath(). Maybe the C function _Py_abspath() that I implemented in PR 14053 should be exposed somehow to importlib as a private function using a builtin module like _imp, so it can be used directly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:15:23 2019
From: report at bugs.python.org (=?utf-8?b?0JLQsNC70LXQvdGC0LjQvSDQkdGD0YDRh9C10L3Rjw==?=)
Date: Fri, 14 Jun 2019 11:15:23 +0000
Subject: [issue37281] asyncio Task._fut_waiter done callback
In-Reply-To: <1560508338.36.0.821334369353.issue37281@roundup.psfhosted.org>
Message-ID: <1560510923.55.0.824065561891.issue37281@roundup.psfhosted.org>


???????? ??????? <vp.burchenya at gmail.com> added the comment:

Thanks

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37281>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:33:36 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 11:33:36 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560512016.16.0.102802718983.issue37278@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13936
pull_request: https://github.com/python/cpython/pull/14078

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:39:24 2019
From: report at bugs.python.org (=?utf-8?q?Jonat=C3=A3_Bolzan_Loss?=)
Date: Fri, 14 Jun 2019 11:39:24 +0000
Subject: [issue37282] os problems on absolute paths containing unicode
 characters on windows
In-Reply-To: <1560510104.32.0.366432757935.issue37282@roundup.psfhosted.org>
Message-ID: <1560512364.91.0.640046971104.issue37282@roundup.psfhosted.org>


Jonat? Bolzan Loss <jbopen at gmail.com> added the comment:

You are right, my mistake. Sorry about this and thanks for checking :) .

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37282>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:52:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 11:52:29 +0000
Subject: [issue35081] Move internal headers to Include/internal/
In-Reply-To: <1540600944.05.0.788709270274.issue35081@psf.upfronthosting.co.za>
Message-ID: <1560513149.39.0.620575100243.issue35081@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13937
pull_request: https://github.com/python/cpython/pull/13890

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35081>
_______________________________________

From report at bugs.python.org  Fri Jun 14 07:53:19 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 11:53:19 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560513199.88.0.049433448517.issue37278@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8b66dbb212d7dffbf9fb545dad2a3400aead1461 by Miss Islington (bot) in branch '3.8':
bpo-37278: Fix test_asyncio ProactorLoopCtrlC (GH-14074)
https://github.com/python/cpython/commit/8b66dbb212d7dffbf9fb545dad2a3400aead1461


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:05:01 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 14 Jun 2019 12:05:01 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560513901.41.0.0638906934584.issue28805@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +13938
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14079

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:09:47 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Jacobi?=)
Date: Fri, 14 Jun 2019 12:09:47 +0000
Subject: [issue37283] Unexpected behavior when running installer a second time
 with the same arguments or unattend.xml
Message-ID: <1560514187.3.0.83059947509.issue37283@roundup.psfhosted.org>


New submission from J?rn Jacobi <jorn at geekware.dk>:

When executing the installer with arguments or using the unattend.xml to run it without UI as documented in https://python.readthedocs.io/en/stable/using/windows.html#installing-without-ui the installer ignores the arguments or unattend.xml when it's executed again.

The second time, the installer (running i modify mode) uses the default values (hereby removing the Prepenpath if set the first time)

(testet with version 3.6.6-amd64 to 3.7.3-amd64 of the executable installer)

To recreate, run the following : 

step 1 :
python-3.6.6-amd64.exe /passive InstallAllUsers=1 PrependPath=1 Include_doc=0 Include_dev=0 Include_tcltk=0 Include_test=0 SimpleInstall=1 

now python is install as expected.

step 2 : 
python-3.6.6-amd64.exe /passive InstallAllUsers=1 PrependPath=1 Include_doc=0 Include_dev=0 Include_tcltk=0 Include_test=0 SimpleInstall=1

even though the options are exactly the same, the installer now removes python from path and installs tcltk, documentation, test and dev.

step 3 : 
python-3.6.6-amd64.exe /passive InstallAllUsers=1 PrependPath=1 Include_doc=0 Include_dev=0 Include_tcltk=0 Include_test=0 SimpleInstall=1

now the installer only makes a quick check, what i would have expected in step 2, but hare only the default values are used.

----------
components: Installation
messages: 345589
nosy: J?rn Jacobi
priority: normal
severity: normal
status: open
title: Unexpected behavior when running installer a second time with the same arguments or unattend.xml
type: behavior
versions: Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37283>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:15:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 12:15:31 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560514531.73.0.260972970566.issue37278@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:15:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 12:15:46 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560514546.11.0.189555304089.issue37278@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks for the review Andrew.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:26:35 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Fri, 14 Jun 2019 12:26:35 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560515195.09.0.0584047565667.issue37250@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

I agree with Steve that broadly redefining a global name in a widely used header file is not a good idea. You never know what names users have in their code. Yes, you can work around it by undef-ing it again, but honestly, in that case, both sides are hacks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:43:46 2019
From: report at bugs.python.org (kev levrone)
Date: Fri, 14 Jun 2019 12:43:46 +0000
Subject: [issue12857] Expose called function on frame object
In-Reply-To: <1314683667.85.0.876885324202.issue12857@psf.upfronthosting.co.za>
Message-ID: <1560516226.0.0.588153930628.issue12857@roundup.psfhosted.org>


kev levrone <kevlevrone6 at gmail.com> added the comment:

def enable_ki_protection(func):
    func._trio_keyboard_interrupt_protection_enabled = True
    return func

----------
nosy: +kevlevrone
Added file: https://bugs.python.org/file48418/122.pdf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12857>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:45:06 2019
From: report at bugs.python.org (kev levrone)
Date: Fri, 14 Jun 2019 12:45:06 +0000
Subject: [issue26145] [WIP] PEP 511: Add sys.set_code_transformers()
In-Reply-To: <1453108257.94.0.438143755637.issue26145@psf.upfronthosting.co.za>
Message-ID: <1560516306.27.0.553061815699.issue26145@roundup.psfhosted.org>


Change by kev levrone <kevlevrone6 at gmail.com>:


Added file: https://bugs.python.org/file48419/123.pdf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26145>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:46:23 2019
From: report at bugs.python.org (Luiz Amaral)
Date: Fri, 14 Jun 2019 12:46:23 +0000
Subject: [issue37273] from pickle import rick
In-Reply-To: <1560484156.23.0.547175119772.issue37273@roundup.psfhosted.org>
Message-ID: <1560516383.15.0.797613895712.issue37273@roundup.psfhosted.org>


Luiz Amaral <luizamaral306 at gmail.com> added the comment:

It seemed a good idea when I made the PR, now I feel bad for wasting your time ? sorry guys.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37273>
_______________________________________

From report at bugs.python.org  Fri Jun 14 08:49:21 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 14 Jun 2019 12:49:21 +0000
Subject: [issue37283] Unexpected behavior when running installer a second time
 with the same arguments or unattend.xml
In-Reply-To: <1560514187.3.0.83059947509.issue37283@roundup.psfhosted.org>
Message-ID: <1560516561.77.0.364684994118.issue37283@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37283>
_______________________________________

From report at bugs.python.org  Fri Jun 14 09:30:48 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 13:30:48 +0000
Subject: [issue37278] test_asyncio: ProactorLoopCtrlC leaks one reference
In-Reply-To: <1560507551.61.0.999190887785.issue37278@roundup.psfhosted.org>
Message-ID: <1560519048.05.0.107888891524.issue37278@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Welcome!
Thanks for the fix!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37278>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:02:14 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 14:02:14 +0000
Subject: [issue37202] Future.cancelled is not set to true immediately after
 calling Future.cancel
In-Reply-To: <1559992040.91.0.159243641871.issue37202@roundup.psfhosted.org>
Message-ID: <1560520934.93.0.000287259407927.issue37202@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37202>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:04:48 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 14:04:48 +0000
Subject: [issue37081] Test with OpenSSL 1.1.1c
In-Reply-To: <1559058292.64.0.780398663722.issue37081@roundup.psfhosted.org>
Message-ID: <1560521088.83.0.128026874481.issue37081@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Duplicate of #35998

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> test_asyncio: test_start_tls_server_1() TimeoutError on Fedora 29

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37081>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:13:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 14:13:43 +0000
Subject: [issue26145] [WIP] PEP 511: Add sys.set_code_transformers()
In-Reply-To: <1453108257.94.0.438143755637.issue26145@psf.upfronthosting.co.za>
Message-ID: <1560521623.97.0.426972587399.issue26145@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


Removed file: https://bugs.python.org/file48419/123.pdf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26145>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:14:30 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 14:14:30 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560521670.57.0.149188088717.issue35998@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
keywords: +patch
pull_requests: +13939
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14080

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:33:31 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 14 Jun 2019 14:33:31 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560522811.21.0.864639409407.issue19865@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13940
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14081

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:36:53 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 14 Jun 2019 14:36:53 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560523013.63.0.750301110726.issue19865@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

I have created a pull request for this issue. Please take a look.

----------
nosy: +ZackerySpytz
versions: +Python 3.9 -Python 3.4, Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 10:43:48 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 14:43:48 +0000
Subject: [issue12857] Expose called function on frame object
In-Reply-To: <1314683667.85.0.876885324202.issue12857@psf.upfronthosting.co.za>
Message-ID: <1560523428.45.0.513617024161.issue12857@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


Removed file: https://bugs.python.org/file48418/122.pdf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12857>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:26:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 15:26:45 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560526005.11.0.972229522466.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset f0749da9a535375f05a2015e8960e8ae54877349 by Victor Stinner (Andrew Svetlov) in branch 'master':
bpo-35998: Avoid TimeoutError in test_asyncio: test_start_tls_server_1() (GH-14080)
https://github.com/python/cpython/commit/f0749da9a535375f05a2015e8960e8ae54877349


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:26:49 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 15:26:49 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560526009.06.0.720673439995.issue35998@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13941
pull_request: https://github.com/python/cpython/pull/14084

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:42:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 15:42:12 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560526932.56.0.664224068873.issue35998@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13942
pull_request: https://github.com/python/cpython/pull/14086

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:46:07 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 15:46:07 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560527167.01.0.677302036277.issue35998@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Finally fixed

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:49:42 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 15:49:42 +0000
Subject: [issue34651] Disallow fork in a subinterpreter.
In-Reply-To: <1536786263.28.0.956365154283.issue34651@psf.upfronthosting.co.za>
Message-ID: <1560527382.2.0.471380466463.issue34651@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

FYI, I plan on looking into this either today or next Friday.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34651>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:50:52 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 14 Jun 2019 15:50:52 +0000
Subject: [issue37274] Scripts folder is empty in python 3.7.3 for windows.
In-Reply-To: <1560487852.05.0.608471969466.issue37274@roundup.psfhosted.org>
Message-ID: <1560527452.04.0.974321126027.issue37274@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

You should have a set of log files in %TEMP%. Can you zip those up and attach them here?

Pip may be failing to install for some reason, and while this ought to be reported, it is not supposed to cause the entire installation to fail.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37274>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:54:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 15:54:04 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560527644.09.0.497769932063.issue19865@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 9765efcb39fc03d5b1abec3924388974470a8bd5 by Victor Stinner (Zackery Spytz) in branch 'master':
bpo-19865: ctypes.create_unicode_buffer() supports non-BMP strings on Windows (GH-14081)
https://github.com/python/cpython/commit/9765efcb39fc03d5b1abec3924388974470a8bd5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:54:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 14 Jun 2019 15:54:20 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
In-Reply-To: <1560491190.29.0.949105060129.issue37275@roundup.psfhosted.org>
Message-ID: <1560527660.47.0.337399077679.issue37275@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Isn't the point that device_encoding(FD) gets the encoding of the specified file? In this case stdout?

It seems odd that chcp doesn't actually update the console code page here, as that is its entire purpose. Perhaps TextIOWrapper is actually getting ACP rather than the console encoding through some other path?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:55:09 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 15:55:09 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560527709.68.0.910751670692.issue19865@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13944
pull_request: https://github.com/python/cpython/pull/14088

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 11:55:01 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 15:55:01 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560527701.13.0.0880382324509.issue19865@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13943
pull_request: https://github.com/python/cpython/pull/14087

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:01:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:01:52 +0000
Subject: [issue34651] Disallow fork in a subinterpreter.
In-Reply-To: <1536786263.28.0.956365154283.issue34651@psf.upfronthosting.co.za>
Message-ID: <1560528112.57.0.839609202509.issue34651@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-37266: "Daemon threads must be forbidden in subinterpreters".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34651>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:03:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:03:31 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560528211.78.0.154125378575.issue37261@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 212646cae6b7c4ddc8d98c8b9b6d39a5f259e864 by Victor Stinner in branch 'master':
bpo-37261: Document sys.unraisablehook corner cases (GH-14059)
https://github.com/python/cpython/commit/212646cae6b7c4ddc8d98c8b9b6d39a5f259e864


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:03:34 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 16:03:34 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560528214.01.0.511331972572.issue37261@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13945
pull_request: https://github.com/python/cpython/pull/14089

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:05:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:05:04 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560528304.1.0.997828585058.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Finally fixed

Thank you very much! I looked at this issue 2 or 3 times but I failed to fix it. This bug was super annoying: it failed multiple times per week on Fedora buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:07:44 2019
From: report at bugs.python.org (Wei Li)
Date: Fri, 14 Jun 2019 16:07:44 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1560528464.46.0.0105379368321.issue37193@roundup.psfhosted.org>


Wei Li <lwei1993 at gmail.com> added the comment:

I got the same problem when uing the ThreadingTCPServer.

I think adding 
"self._threads = list(filter(lambda x: x.is_alive(), self._threads))"
at the last line in process_request method is a potential way to fix the bug

----------
nosy: +Wei Li

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:12:55 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 16:12:55 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560528775.02.0.964899467674.issue35998@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0c2eb6d21013d77e1160250d3cf69ca80215d064 by Miss Islington (bot) in branch '3.8':
bpo-35998: Avoid TimeoutError in test_asyncio: test_start_tls_server_1() (GH-14080)
https://github.com/python/cpython/commit/0c2eb6d21013d77e1160250d3cf69ca80215d064


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:26:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:26:43 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560529603.47.0.506296625581.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 33feb2e1a391cde91aefcb8d9cf5144b5fbc5d87 by Victor Stinner in branch '3.7':
bpo-35998: Avoid TimeoutError in test_asyncio: test_start_tls_server_1() (GH-14080) (GH-14086)
https://github.com/python/cpython/commit/33feb2e1a391cde91aefcb8d9cf5144b5fbc5d87


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:30:30 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 16:30:30 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560529830.78.0.996353394652.issue19865@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0b592d513b073cd3a4ba7632907c25b8282f15ce by Miss Islington (bot) in branch '3.7':
bpo-19865: ctypes.create_unicode_buffer() supports non-BMP strings on Windows (GH-14081)
https://github.com/python/cpython/commit/0b592d513b073cd3a4ba7632907c25b8282f15ce


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:43:26 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 16:43:26 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560530606.07.0.582326371079.issue19865@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b0f6fa8d7d4c6d8263094124df9ef9cf816bbed6 by Miss Islington (bot) in branch '3.8':
bpo-19865: ctypes.create_unicode_buffer() supports non-BMP strings on Windows (GH-14081)
https://github.com/python/cpython/commit/b0f6fa8d7d4c6d8263094124df9ef9cf816bbed6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:52:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:52:17 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560531137.36.0.930023156189.issue36707@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13946
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14090

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:54:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:54:21 +0000
Subject: [issue19865] create_unicode_buffer() fails on non-BMP strings on
 Windows
In-Reply-To: <1386013006.0.0.412572088185.issue19865@psf.upfronthosting.co.za>
Message-ID: <1560531261.05.0.454275962424.issue19865@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Zackery Spytz for the fix. Thanks Gergely Erd?lyi for the bug report! Sorry for the long delay.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19865>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:55:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:55:27 +0000
Subject: [issue37266] Daemon threads must be forbidden in subinterpreters
In-Reply-To: <1560418565.72.0.288239825756.issue37266@roundup.psfhosted.org>
Message-ID: <1560531327.93.0.419606069345.issue37266@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 066e5b1a917ec2134e8997d2cadd815724314252 by Victor Stinner in branch 'master':
bpo-37266: Daemon threads are now denied in subinterpreters (GH-14049)
https://github.com/python/cpython/commit/066e5b1a917ec2134e8997d2cadd815724314252


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37266>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:56:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 16:56:51 +0000
Subject: [issue37266] Daemon threads must be forbidden in subinterpreters
In-Reply-To: <1560418565.72.0.288239825756.issue37266@roundup.psfhosted.org>
Message-ID: <1560531411.84.0.0392903269484.issue37266@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Daemon threads must die. That's a first step towards their death!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37266>
_______________________________________

From report at bugs.python.org  Fri Jun 14 12:59:57 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 16:59:57 +0000
Subject: [issue37261] test_io leaks references on AMD64 Fedora Rawhide
 Refleaks 3.8
In-Reply-To: <1560390190.75.0.577750929769.issue37261@roundup.psfhosted.org>
Message-ID: <1560531597.99.0.839821261931.issue37261@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3b976d19c8c09e83eec63a5b62daf4d55bfd6aeb by Miss Islington (bot) in branch '3.8':
bpo-37261: Document sys.unraisablehook corner cases (GH-14059)
https://github.com/python/cpython/commit/3b976d19c8c09e83eec63a5b62daf4d55bfd6aeb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37261>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:10:53 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 14 Jun 2019 17:10:53 +0000
Subject: [issue37283] Unexpected behavior when running installer a second time
 with the same arguments or unattend.xml
In-Reply-To: <1560514187.3.0.83059947509.issue37283@roundup.psfhosted.org>
Message-ID: <1560532253.19.0.0101444002549.issue37283@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Hmm... interesting.

Thanks for the heads-up, I think I know what this may be (there's a conditional planning stage in the bootstrapper that is probably being skipped on Modify). I'll take a look when I get a chance.

----------
assignee:  -> steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37283>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:29:23 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 17:29:23 +0000
Subject: [issue32280] Expose `_PyRuntime` through a section name
In-Reply-To: <1513034681.19.0.213398074469.issue32280@psf.upfronthosting.co.za>
Message-ID: <1560533363.46.0.383618111478.issue32280@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

(Sorry for the delay!)

Is the need for a named section due to the fact that _PyRuntime is part of the "internal" C-API (hidden behind the Py_BUILD_CORE macro)?  I.E. would it help to build with Py_BUILD_CORE?


Regarding the GIL:

The plan for 3.9 is to have one GIL per interpreter, so the relevant struct would be PyInterpreterState (a part of the public C-API).  That would be accessible at runtime via the fields of _PyRuntime.interpreters.


Regarding what I said before about multiple runtimes per process:

Honestly, I've yet to see any use case that would justify providing multi-runtime support.  However, there are code-health benefits to keeping *all* runtime state out of static globals.  So eliminating the _PyRuntime static variable is still a realistic possibility (for 3.9 or maybe later).

If that happens then there would have to be a new embedding C-API oriented around (opaque) PyRuntimestate pointers.  See PEP 432 and 587 for ongoing work to improve the embedding experience (for runtime initialization), including what the successors to Py_Initialize() look like.

----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32280>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:31:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 17:31:48 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1560533508.0.0.98995660211.issue35537@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 5884043252473ac733aba1d3251d4debe72511e5 by Victor Stinner in branch 'master':
bpo-35537: Rewrite setsid test for os.posix_spawn (GH-11721)
https://github.com/python/cpython/commit/5884043252473ac733aba1d3251d4debe72511e5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:31:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 17:31:48 +0000
Subject: [issue35876] test_start_new_session for posix_spawnp fails
In-Reply-To: <1549018399.45.0.971138800303.issue35876@roundup.psfhosted.org>
Message-ID: <1560533508.13.0.532294768913.issue35876@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 5884043252473ac733aba1d3251d4debe72511e5 by Victor Stinner in branch 'master':
bpo-35537: Rewrite setsid test for os.posix_spawn (GH-11721)
https://github.com/python/cpython/commit/5884043252473ac733aba1d3251d4debe72511e5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35876>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:32:18 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 17:32:18 +0000
Subject: [issue35876] test_start_new_session for posix_spawnp fails
In-Reply-To: <1549018399.45.0.971138800303.issue35876@roundup.psfhosted.org>
Message-ID: <1560533538.18.0.0597487707881.issue35876@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13948
pull_request: https://github.com/python/cpython/pull/14093

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35876>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:32:18 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 17:32:18 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1560533538.07.0.612725948096.issue35537@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13947
pull_request: https://github.com/python/cpython/pull/14093

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:35:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 17:35:33 +0000
Subject: [issue35876] test_start_new_session for posix_spawnp fails
In-Reply-To: <1549018399.45.0.971138800303.issue35876@roundup.psfhosted.org>
Message-ID: <1560533733.06.0.292727640746.issue35876@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I rewrote and reenabled the test. It should now be fixed in master, and the 3.8 backport is coming soon.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35876>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:43:31 2019
From: report at bugs.python.org (Eryk Sun)
Date: Fri, 14 Jun 2019 17:43:31 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
In-Reply-To: <1560491190.29.0.949105060129.issue37275@roundup.psfhosted.org>
Message-ID: <1560534211.78.0.175735060516.issue37275@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> # Power Shell 6 (use cp65001 by default)
> PS C:?> python3 -c "print('????')" > ps.txt

PowerShell standard I/O redirection is different from any shell I've ever used. In this case, it runs Python with StandardOutput set to a handle for a pipe instead of a handle for the file. It decodes Python's output using whatever encoding is configured for input and re-encodes it with whatever encoding is configured for output. 

To see what Python is actually writing, try using Start-Process with StandardOutput redirected to the file. For example:

    Start-Process -FilePath python3.exe -ArgumentList "-c `"print('????')`"" -NoNewWindow -Wait -RedirectStandardOutput ps.txt

> # cmd.exe
> C:?> chcp 65001
> C:?> python3 -c "print('????')" > cmd.txt

CMD uses simple redirection, like every other shell I've ever used. It runs python3.exe with a handle for the file as its StandardOutput. So "cmd.txt" contains exactly what Python writes.

> * TextIOWrapper tries `os.device_encoding(1)`
> * `os.device_encoding(1)` use GetConsoleOutputCP() without checking stdout is console

No, _Py_device_encoding returns None if the isatty(fd) is false, i.e. for a pipe or disk file. In this case, TextIOWrapper defaults to the encoding from locale.getpreferredencoding().

The current preferred encoding is the system ANSI codepage from GetACP(). Changing the default to UTF-8 would be disruptive. You can use UTF-8 mode (i.e. -X utf8). Or, to override just stdin, stdout, and stderr, set the environment variable "PYTHONIOENCODING=utf-8".

> In the example above, a console is attached when python is called from 
> Power Shell 6, but it is not attached when python is called from 
> cmd.exe.

In both cases the Python process inherits the console of the parent shell. The only way to run python.exe without a console is to use the CreateProcess creation flag DETACHED_PROCESS.

> There is a relating issue: UTF-8 mode doesn't override 
> stdin,stdout,stderr encoding when console is attached.

It works for me. For example, testing with stdout redirected to a pipe:

    C:\>python -c "import sys;print(sys.stdout.encoding)" | more
    cp1252

    C:\>python -X utf8 -c "import sys;print(sys.stdout.encoding)" | more
    utf-8

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:49:26 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 17:49:26 +0000
Subject: [issue35537] use os.posix_spawn in subprocess
In-Reply-To: <1545238079.48.0.788709270274.issue35537@psf.upfronthosting.co.za>
Message-ID: <1560534566.67.0.954966529227.issue35537@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e696b15a62dd0c85fe6ed3c9698b5f889c0bb1b3 by Miss Islington (bot) in branch '3.8':
bpo-35537: Rewrite setsid test for os.posix_spawn (GH-11721)
https://github.com/python/cpython/commit/e696b15a62dd0c85fe6ed3c9698b5f889c0bb1b3


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35537>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:49:26 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 14 Jun 2019 17:49:26 +0000
Subject: [issue35876] test_start_new_session for posix_spawnp fails
In-Reply-To: <1549018399.45.0.971138800303.issue35876@roundup.psfhosted.org>
Message-ID: <1560534566.81.0.87765344276.issue35876@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e696b15a62dd0c85fe6ed3c9698b5f889c0bb1b3 by Miss Islington (bot) in branch '3.8':
bpo-35537: Rewrite setsid test for os.posix_spawn (GH-11721)
https://github.com/python/cpython/commit/e696b15a62dd0c85fe6ed3c9698b5f889c0bb1b3


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35876>
_______________________________________

From report at bugs.python.org  Fri Jun 14 13:52:28 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 14 Jun 2019 17:52:28 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560534748.24.0.182608518728.issue35998@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thanks for the review, Victor!
I have had to fix it much earlier :(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:02:41 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 18:02:41 +0000
Subject: [issue37284] Not obvious that new required attrs of
 sys.implementation must have a PEP.
Message-ID: <1560535361.35.0.573554677552.issue37284@roundup.psfhosted.org>


New submission from Eric Snow <ericsnowcurrently at gmail.com>:

PEP 421 added sys.implementation for Python implementors to provide values required by stdlib code (e.g. importlib).  That PEP indicates that any new required attributes must go through the PEP process. [1]  That requirement isn't obvious.

To fix that we should add a brief note to the sys.implementation docs [2] identifying the requirement.


[1] https://www.python.org/dev/peps/pep-0421/#adding-new-required-attributes
[2] https://docs.python.org/3/library/sys.html#sys.implementation

----------
assignee: docs at python
components: Documentation
keywords: easy
messages: 345624
nosy: cheryl.sabella, docs at python, eric.snow
priority: normal
severity: normal
stage: needs patch
status: open
title: Not obvious that new required attrs of sys.implementation must have a PEP.
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37284>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:10:51 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 14 Jun 2019 18:10:51 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560535851.44.0.025714199676.issue37271@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:12:04 2019
From: report at bugs.python.org (Antoine Pitrou)
Date: Fri, 14 Jun 2019 18:12:04 +0000
Subject: [issue36785] Implement PEP 574
In-Reply-To: <1556908101.83.0.107763193732.issue36785@roundup.psfhosted.org>
Message-ID: <1560535924.25.0.653810644651.issue36785@roundup.psfhosted.org>


Antoine Pitrou <pitrou at free.fr> added the comment:

Now complete, closing :-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36785>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:29:57 2019
From: report at bugs.python.org (=?utf-8?q?Misty_De_M=C3=A9o?=)
Date: Fri, 14 Jun 2019 18:29:57 +0000
Subject: [issue37285] Python 2.7 setup.py incorrectly double-joins SDKROOT
Message-ID: <1560536997.94.0.77736391692.issue37285@roundup.psfhosted.org>


New submission from Misty De M?o <mistydemeo at gmail.com>:

Python 2.7's setup.py has incorrect behaviour when adding the SDKROOT to the beginning of the include path while searching.

When searching paths, find_file first checks is_macosx_sdk_path  to see if it needs to add the sdk_root: https://github.com/python/cpython/blob/2.7/setup.py#L87-L88

This is mostly correct, except one of the path prefixes it checks is /Library: https://github.com/python/cpython/blob/2.7/setup.py#L64

The Xcode CLT path is located in /Library, so this check passes. That means the /Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk portion of the path gets repeated, leading to an invalid path.

I recognize Python 2.7 isn't in active development, but I have a minimal patch to fix this that I will be submitting.

----------
components: Build
messages: 345626
nosy: mistydemeo
priority: normal
severity: normal
status: open
title: Python 2.7 setup.py incorrectly double-joins SDKROOT
type: compile error
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37285>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:30:43 2019
From: report at bugs.python.org (=?utf-8?q?Misty_De_M=C3=A9o?=)
Date: Fri, 14 Jun 2019 18:30:43 +0000
Subject: [issue37285] Python 2.7 setup.py incorrectly double-joins SDKROOT
In-Reply-To: <1560536997.94.0.77736391692.issue37285@roundup.psfhosted.org>
Message-ID: <1560537043.05.0.776304750045.issue37285@roundup.psfhosted.org>


Change by Misty De M?o <mistydemeo at gmail.com>:


----------
keywords: +patch
pull_requests: +13949
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14095

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37285>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:42:22 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 18:42:22 +0000
Subject: [issue32178] Some invalid email address groups cause an IndexError
 instead of a HeaderParseError
In-Reply-To: <1512038434.94.0.213398074469.issue32178@psf.upfronthosting.co.za>
Message-ID: <1560537742.47.0.458659885655.issue32178@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I don't think this is an issue anymore, I guess this was fixed as a part of some other PR.

I tested this out on a recent branch:

   >>> import email
   >>> msg = email.message_from_string('From: Abhilash <maxking at email.com> <Another at some.com>')
   >>> msg['From'] 
   'Abhilash <maxking at email.com> <Another at some.com>'

@david, @barry: I think we can close this issue.

----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32178>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:45:08 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 18:45:08 +0000
Subject: [issue32179] Empty email address in headers triggers an IndexError
In-Reply-To: <1512041238.12.0.213398074469.issue32179@psf.upfronthosting.co.za>
Message-ID: <1560537908.29.0.049520353056.issue32179@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I wasn't able to reproduce this on the latest master. Probably fixed as a part of some other PR.

    >>> msg = email.message_from_string('ReplyTo: ""')
    >>> msg
    <email.message.Message object at 0x7f1fc6c82eb0>
    >>> msg['ReplyTo']
    '""'

I think this issue can be closed.

----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32179>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:52:51 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 18:52:51 +0000
Subject: [issue31445] Index out of range in get of message.EmailMessage.get()
In-Reply-To: <1505296401.08.0.196475452437.issue31445@psf.upfronthosting.co.za>
Message-ID: <1560538371.39.0.224817923589.issue31445@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I can't reproduce this issue on the latest master branch. This seems to be fixed as a part of a different PR I suppose.

    >>> import email
    >>> msg = email.message_from_string("From: Bonifac Karaka : bonikar at gmail.com")
    >>> msg['From']
    'Bonifac Karaka : bonikar at gmail.com'

This is very similar to bpo-32178, which also is now fixed.

@david, @barry, I think we can close this issue.

----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31445>
_______________________________________

From report at bugs.python.org  Fri Jun 14 14:53:22 2019
From: report at bugs.python.org (=?utf-8?q?Mi=C5=82osz?=)
Date: Fri, 14 Jun 2019 18:53:22 +0000
Subject: [issue37286] Pasting emoji crashes IDLE
Message-ID: <1560538402.62.0.439555493533.issue37286@roundup.psfhosted.org>


New submission from Mi?osz <md37 at interia.com>:

On Windows 10

----------
assignee: terry.reedy
components: IDLE
messages: 345630
nosy: md37, terry.reedy
priority: normal
severity: normal
status: open
title: Pasting emoji crashes IDLE
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37286>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:02:10 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 19:02:10 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1560538930.55.0.86274672757.issue29412@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

I can't reproduce this problem with the latest master branch, it was perhaps fixed with some other PR. 

This is also a dupe of bpo-31445.

@barry, @david: I think this issue can be closed.

----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:04:12 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 19:04:12 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1560539052.11.0.241701281041.issue29412@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

For the record, this is how I tested using the master branch:

>>> msg = email.message_from_string('  To: (Recipient list suppressed)')
>>> msg['To']
>>> import email.policy
>>> msg = email.message_from_string('  To: (Recipient list suppressed)', policy=email.policy.default)
>>> msg
<email.message.EmailMessage object at 0x7f377512b370>
>>> msg['To']
>>> msg.get('to')

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:07:13 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Fri, 14 Jun 2019 19:07:13 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1560539233.38.0.783901581161.issue29412@roundup.psfhosted.org>


Abhilash Raj <raj.abhilash1 at gmail.com> added the comment:

Nevermind, I was wrong, I was able to reproduce it:

>>> msg = email.message_from_string('To: (Recipient list suppressed)', policy=email.policy.default))
  File "<stdin>", line 1
SyntaxError: unmatched ')'
>>> msg = email.message_from_string('To: (Recipient list suppressed)', policy=email.policy.default)
>>> msg.get('to')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/maxking/Documents/cpython/Lib/email/message.py", line 471, in get
    return self.policy.header_fetch_parse(k, v)
  File "/home/maxking/Documents/cpython/Lib/email/policy.py", line 163, in header_fetch_parse
    return self.header_factory(name, value)
  File "/home/maxking/Documents/cpython/Lib/email/headerregistry.py", line 589, in __call__
    return self[name](name, value)
  File "/home/maxking/Documents/cpython/Lib/email/headerregistry.py", line 197, in __new__
    cls.parse(value, kwds)
  File "/home/maxking/Documents/cpython/Lib/email/headerregistry.py", line 340, in parse
    kwds['parse_tree'] = address_list = cls.value_parser(value)
  File "/home/maxking/Documents/cpython/Lib/email/headerregistry.py", line 331, in value_parser
    address_list, value = parser.get_address_list(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1951, in get_address_list
    token, value = get_address(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1928, in get_address
    token, value = get_group(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1884, in get_group
    token, value = get_display_name(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1710, in get_display_name
    token, value = get_phrase(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1385, in get_phrase
    token, value = get_word(value)
  File "/home/maxking/Documents/cpython/Lib/email/_header_value_parser.py", line 1360, in get_word
    if value[0]=='"':
IndexError: string index out of range

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:32:58 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 14 Jun 2019 19:32:58 +0000
Subject: [issue37286] Pasting emoji crashes IDLE
In-Reply-To: <1560538402.62.0.439555493533.issue37286@roundup.psfhosted.org>
Message-ID: <1560540778.88.0.893809327141.issue37286@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Can you please add a traceback if any? See also https://bugs.python.org/issue13153

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37286>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:42:18 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 14 Jun 2019 19:42:18 +0000
Subject: [issue24980] Allow for providing 'on_new_thread' callback to
 'concurrent.futures.ThreadPoolExecutor'
In-Reply-To: <1441134792.06.0.689087897304.issue24980@psf.upfronthosting.co.za>
Message-ID: <1560541338.66.0.326853759868.issue24980@roundup.psfhosted.org>


Brian Quinlan <brian at sweetapp.com> added the comment:

Joshua, I'm closing this since I haven't heard from you in a month. Please re-open if you use case isn't handled by `initializer` and `initargs`.

----------
assignee:  -> bquinlan
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24980>
_______________________________________

From report at bugs.python.org  Fri Jun 14 15:51:36 2019
From: report at bugs.python.org (Zachary Ware)
Date: Fri, 14 Jun 2019 19:51:36 +0000
Subject: [issue12857] Expose called function on frame object
In-Reply-To: <1314683667.85.0.876885324202.issue12857@psf.upfronthosting.co.za>
Message-ID: <1560541896.79.0.334940657838.issue12857@roundup.psfhosted.org>


Change by Zachary Ware <zachary.ware at gmail.com>:


----------
Removed message: https://bugs.python.org/msg345592

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12857>
_______________________________________

From report at bugs.python.org  Fri Jun 14 16:41:30 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 20:41:30 +0000
Subject: [issue23892] Introduce sys.implementation.opt_levels
In-Reply-To: <1428529304.36.0.272921433795.issue23892@psf.upfronthosting.co.za>
Message-ID: <1560544890.74.0.0876994851114.issue23892@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

(Sorry for taking so long!)

Thanks for doing this, Cheryl!  I'm leaving a review on your PR. :)

Also, in PEP 421 it says that you need a PEP for this. [1]  "Such a PEP need not be long, just long enough."  (I just realized that the requirement isn't obvious so I've opened issue #37284.)


[1] https://www.python.org/dev/peps/pep-0421/#adding-new-required-attributes

----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23892>
_______________________________________

From report at bugs.python.org  Fri Jun 14 16:48:26 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 14 Jun 2019 20:48:26 +0000
Subject: [issue37285] Python 2.7 setup.py incorrectly double-joins SDKROOT
In-Reply-To: <1560536997.94.0.77736391692.issue37285@roundup.psfhosted.org>
Message-ID: <1560545306.65.0.919027919719.issue37285@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
assignee:  -> ned.deily
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37285>
_______________________________________

From report at bugs.python.org  Fri Jun 14 16:49:37 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 14 Jun 2019 20:49:37 +0000
Subject: [issue37286] Pasting emoji crashes IDLE
In-Reply-To: <1560538402.62.0.439555493533.issue37286@roundup.psfhosted.org>
Message-ID: <1560545377.9.0.0407148690468.issue37286@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

In the absence of evidence otherwise (the string that you pasted and the full traceback), I assume that you pasted a non-BMP codepoint, making this a duplicate of #13153.  If you think otherwise, please supply more info.

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> IDLE 3.x on Windows crashes when pasting non-BMP unicode

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37286>
_______________________________________

From report at bugs.python.org  Fri Jun 14 17:40:08 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 14 Jun 2019 21:40:08 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560548408.9.0.18686608729.issue37271@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

FWIW, when the peephole optimizer was originally accepted, it was partly on the condition that we kept it simple and fast.  Perhaps, the sentiment has changed, perhaps not.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Fri Jun 14 17:45:33 2019
From: report at bugs.python.org (Aaron Meurer)
Date: Fri, 14 Jun 2019 21:45:33 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1560548733.59.0.509162104675.issue32912@roundup.psfhosted.org>


Aaron Meurer <asmeurer at gmail.com> added the comment:

I agree. Please someone else do that. I don't know what already has issues and I unfortunately don't have time right now to help out with any of this. 

I simply mentioned all these things as arguments why Python should not (yet) make these warnings errors, which is the point of this issue. 

Also, for the pyparsing example, you would have gotten lucky because it also contained \w, which is not a valid escape. If it didn't, you wouldn't be warned. So clearly this will help things, but it will also be good to have linting tools that, for example, warn about any escape sequences inside docstrings.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Fri Jun 14 17:51:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 21:51:07 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1560534748.24.0.182608518728.issue35998@roundup.psfhosted.org>
Message-ID: <CA+3bQGFowTBKLYipBhkvS93kZcvu7QvMAVnZt5AZb5QtdXRJcw@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

> I have had to fix it much earlier :(

That's fine. If this bug was more annoying, I would have it fixed myself
earlier. But I had other more critical bugs to fix before that one. The
important part is that it is fixed now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 17:52:04 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 14 Jun 2019 21:52:04 +0000
Subject: [issue23892] Introduce sys.implementation.opt_levels
In-Reply-To: <1428529304.36.0.272921433795.issue23892@psf.upfronthosting.co.za>
Message-ID: <1560549124.61.0.646541863019.issue23892@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

There are (solvable) problems with my original recommendation:

1. sys.implementation is by definition not suitable for third-party import hooks to modify
  + it is set during the Python implementation during runtime init
  + it is effectively read-only after that
2. "opt_levels" is too specific to the CPython status quo
  + there are other ways to encode the optimizations of a bytecode file [1]
  + "optimizations" would probably be more correct
  + that opens a whole can of worms (e.g. what does sys.flags.optimize mean)

So we may want to think this over a bit before going any further.  I'm going to collect my thoughts on this and write more later. :)


[1] In PEP 488 it says:

    It is expected that beyond Python's own two optimization levels,
    third-party code will use a hash of optimization names to specify
    the optimization level, e.g. hashlib.sha256(','.join(['no dead code',
    'const folding'])).hexdigest().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23892>
_______________________________________

From report at bugs.python.org  Fri Jun 14 18:05:05 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 14 Jun 2019 22:05:05 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
In-Reply-To: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>
Message-ID: <1560549905.2.0.221184005071.issue37208@roundup.psfhosted.org>


Brian Quinlan <brian at sweetapp.com> added the comment:

That's a super interesting bug! It looks like this issue is that your exception can't be round-tripped using pickle i.e.

>>> class PoolBreaker(Exception):
...     def __init__(self, num):
...         super().__init__()
...         self.num = num
... 
>>> import pickle
>>> pickle.loads(pickle.dumps(PoolBreaker(5)))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: __init__() missing 1 required positional argument: 'num'

----------
assignee:  -> bquinlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Fri Jun 14 18:14:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 22:14:08 +0000
Subject: [issue37155] test_asyncio: test_stdin_broken_pipe() failed on AMD64
 FreeBSD CURRENT Shared 3.x
In-Reply-To: <1559669895.88.0.0230112144047.issue37155@roundup.psfhosted.org>
Message-ID: <1560550448.6.0.147360573733.issue37155@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

x86 Windows7 3.x:
https://buildbot.python.org/all/#/builders/58/builds/2627

FAIL: test_stdin_broken_pipe (test.test_asyncio.test_subprocess.SubprocessProactorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_asyncio\test_subprocess.py", line 243, in test_stdin_broken_pipe
    self.assertRaises((BrokenPipeError, ConnectionResetError),
AssertionError: (<class 'BrokenPipeError'>, <class 'ConnectionResetError'>) not raised by run_until_complete

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37155>
_______________________________________

From report at bugs.python.org  Fri Jun 14 18:14:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 22:14:29 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560550469.22.0.618992038383.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Sadly, the fix is not perfect, the test failed on the very "x86 Windows7 3.x" buildbot:
https://buildbot.python.org/all/#/builders/58/builds/2627

ERROR: test_start_tls_server_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\test_asyncio\test_sslproto.py", line 578, in test_start_tls_server_1
    self.loop.run_until_complete(run_main())
  File "D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\asyncio\base_events.py", line 606, in run_until_complete
    raise RuntimeError('Event loop stopped before Future completed.')
RuntimeError: Event loop stopped before Future completed.

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 18:16:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 14 Jun 2019 22:16:45 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560550605.38.0.231752560803.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

x86 Windows7 3.7:
https://buildbot.python.org/all/#/builders/111/builds/1123

test_start_tls_server_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... Exception in thread test-client:
Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\functional.py", line 198, in run
    self._prog(TestSocketWrapper(self._sock))
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\test_sslproto.py", line 565, in <lambda>
    with self.tcp_client(lambda sock: client(sock, addr),
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\test_sslproto.py", line 510, in client
    answer = sock.recv_all(len(ANSWER))
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\functional.py", line 138, in recv_all
    data = self.recv(n - len(buf))
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\ssl.py", line 1045, in recv
    return self.read(buflen)
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\ssl.py", line 920, in read
    return self._sslobj.read(len)
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2488)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py", line 926, in _bootstrap_inner
    self.run()
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\functional.py", line 200, in run
    self._test._abort_socket_test(ex)
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_asyncio\functional.py", line 122, in _abort_socket_test
    self.fail(ex)
  File "D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\unittest\case.py", line 693, in fail
    raise self.failureException(msg)
AssertionError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2488)

D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\threading.py:960: ResourceWarning: unclosed <ssl.SSLSocket fd=772, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 64078), raddr=('127.0.0.1', 64077)>
  del exc_type, exc_value, exc_tb
ResourceWarning: Enable tracemalloc to get the object allocation traceback
ERROR

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:21:54 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 14 Jun 2019 23:21:54 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
In-Reply-To: <1560491190.29.0.949105060129.issue37275@roundup.psfhosted.org>
Message-ID: <1560554514.11.0.333966997971.issue37275@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:22:05 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 14 Jun 2019 23:22:05 +0000
Subject: [issue37275] GetConsole(Output)CP is used even when stdin/stdout is
 redirected
In-Reply-To: <1560534211.78.0.175735060516.issue37275@roundup.psfhosted.org>
Message-ID: <CAEfz+TzpUxtsdAHKGNTxZ4++aZnDGwuXfFULf3k32vYEh2_R=A@mail.gmail.com>


Inada Naoki <songofacandy at gmail.com> added the comment:

On Sat, Jun 15, 2019 at 2:43 AM Eryk Sun <report at bugs.python.org> wrote:
>
> Eryk Sun <eryksun at gmail.com> added the comment:
>
> > # Power Shell 6 (use cp65001 by default)
> > PS C:?> python3 -c "print('????')" > ps.txt
>
> PowerShell standard I/O redirection is different from any shell I've ever used. In this case, it runs Python with StandardOutput set to a handle for a pipe instead of a handle for the file. It decodes Python's output using whatever encoding is configured for input and re-encodes it with whatever encoding is configured for output.

I'm sorry,  I mixed my assumption.  I checked `os.device_encoding()` in cmd,
but forgot to check it on Power Shell.  All I said about Power Shell was just
my assumption and it was wrong.  And thank you for clarifying.

I confirmed writing UTF-8 to pipe cause mojibake, because Power Shell decodes
it using cp932.

```
PS C:\Users\inada-n> python3 -Xutf8 -c "import os,sys;
print(os.device_encoding(1), sys.stdout.encoding, file=sys.stderr);
print('?????')" >x
None utf-8
PS C:\Users\inada-n> type x
```

Hmm, how can I teach to Power Shell about python3 is using
UTF-8 for stdout?
It seems cmd.exe with chcp 65001 and PYTHONUTF8=1 is better
than PowerShell when I want to use UTF-8 on Windows.

Anyway, nothing is wrong about python.  I just didn't understand
PowerShell at all.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37275>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:30:45 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 14 Jun 2019 23:30:45 +0000
Subject: [issue37287] picke cannot dump exceptions subclasses with different
 super() args
Message-ID: <1560555045.5.0.822054090592.issue37287@roundup.psfhosted.org>


New submission from Brian Quinlan <brian at sweetapp.com>:

$ ./python.exe nopickle.py
TypeError: __init__() missing 1 required positional argument: 'num'

The issue is that the arguments passed to Exception.__init__ (via `super()`) are collected into `args` and then serialized by pickle e.g.

>>> PickleBreaker(5).args
()
>>> PickleBreaker(5).__reduce_ex__(3)
(<class '__main__.PoolBreaker'>, (), {'num': 5})
>>> # The 1st index is the `args` tuple

Then, during load, the `args` tuple is used to initialize the Exception i.e. PickleBreaker(), which results in the `TypeError`

See https://github.com/python/cpython/blob/master/Modules/_pickle.c#L6769

----------
components: Library (Lib)
files: nopickle.py
messages: 345647
nosy: bquinlan
priority: normal
severity: normal
status: open
title: picke cannot dump exceptions subclasses with different super() args
versions: Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48420/nopickle.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37287>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:31:56 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 14 Jun 2019 23:31:56 +0000
Subject: [issue37287] picke cannot dump Exception subclasses with different
 super() args
In-Reply-To: <1560555045.5.0.822054090592.issue37287@roundup.psfhosted.org>
Message-ID: <1560555116.79.0.722546430534.issue37287@roundup.psfhosted.org>


Change by Brian Quinlan <brian at sweetapp.com>:


----------
title: picke cannot dump exceptions subclasses with different super() args -> picke cannot dump Exception subclasses with different super() args

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37287>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:33:41 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 14 Jun 2019 23:33:41 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
In-Reply-To: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>
Message-ID: <1560555221.04.0.312253992986.issue37208@roundup.psfhosted.org>


Change by Brian Quinlan <brian at sweetapp.com>:


----------
resolution:  -> duplicate
superseder:  -> picke cannot dump Exception subclasses with different super() args

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:36:17 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 14 Jun 2019 23:36:17 +0000
Subject: [issue37288] Windows arm32 buildbot build is broken
Message-ID: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

https://github.com/python/cpython/pull/14065 breaks building with --no-tkinter. Which breaks the Windows arm32 buildbot

`C:\Users\buildbot\buildarea\3.x.monson-win-arm32.nondebug\build\PCbuild\python.vcxproj(158,9): error MSB4184: The expression "[System.IO.File]::ReadAllText(C:\Users\buildbot\buildarea\3.x.monson-win-arm32.nondebug\build\externals\tcltk-8.6.9.0\arm32\tcllicense.terms)" cannot be evaluated. Could not find a part of the path 'C:\Users\buildbot\buildarea\3.x.monson-win-arm32.nondebug\build\externals\tcltk-8.6.9.0\arm32\tcllicense.terms'.`

----------
components: Build, Windows
messages: 345648
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Windows arm32 buildbot build is broken
type: compile error
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:52:46 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 14 Jun 2019 23:52:46 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560556366.76.0.0941692643213.issue37288@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

Change title: Fix Windows build when --no-tkinter is specified
I noticed this because the Windows arm32 buildbot build was broken.

----------
title: Windows arm32 buildbot build is broken -> Fix Windows build when --no-tkinter is specified

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Fri Jun 14 19:54:10 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 14 Jun 2019 23:54:10 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560556450.16.0.715985923856.issue37288@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +13951
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14096

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Fri Jun 14 20:06:08 2019
From: report at bugs.python.org (Julien Palard)
Date: Sat, 15 Jun 2019 00:06:08 +0000
Subject: [issue31200] address sanitizer build fails
In-Reply-To: <1502702493.31.0.645434199194.issue31200@psf.upfronthosting.co.za>
Message-ID: <1560557168.99.0.779021131342.issue31200@roundup.psfhosted.org>


Change by Julien Palard <julien+python at palard.fr>:


----------
pull_requests: +13952
pull_request: https://github.com/python/cpython/pull/13168

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31200>
_______________________________________

From report at bugs.python.org  Fri Jun 14 20:08:37 2019
From: report at bugs.python.org (Inada Naoki)
Date: Sat, 15 Jun 2019 00:08:37 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560557317.34.0.641631299791.issue32846@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution: wont fix -> 
stage: resolved -> 
status: closed -> open
versions: +Python 3.9 -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Fri Jun 14 21:24:44 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 15 Jun 2019 01:24:44 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560561884.5.0.339110066489.issue36707@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 7efc526e5cfb929a79c192ac2dcf7eb78d3a4401 by Victor Stinner in branch 'master':
bpo-36707: Document "m" removal from sys.abiflags (GH-14090)
https://github.com/python/cpython/commit/7efc526e5cfb929a79c192ac2dcf7eb78d3a4401


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Fri Jun 14 21:25:03 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 01:25:03 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560561903.17.0.524098290921.issue36707@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13953
pull_request: https://github.com/python/cpython/pull/14097

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Fri Jun 14 21:31:48 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 01:31:48 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560562308.14.0.117129505182.issue36707@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3fde750cc4e4057076650a92946ec1d492464799 by Miss Islington (bot) in branch '3.8':
bpo-36707: Document "m" removal from sys.abiflags (GH-14090)
https://github.com/python/cpython/commit/3fde750cc4e4057076650a92946ec1d492464799


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Fri Jun 14 21:52:51 2019
From: report at bugs.python.org (Tim Peters)
Date: Sat, 15 Jun 2019 01:52:51 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560563571.29.0.785238156168.issue32846@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Looks likely that the _major_ cause of the quadratic-time delete behavior was due to that obmalloc used a linear-time method to keep its linked list of usable arenas sorted in order of number of free pools.  When a pool became unused, its arena's count of free pools increased by one, and then order was restored by moving the arena "to the right" in the linked list, one slot at a time.

When there were only a few hundred arenas, nobody noticed.  But programs with thousands of arenas could suffer very noticeable sloth, and programs with hundreds of thousands could appear to hang (could require days to complete deleting).

This was fixed in issue #37029, using a constant-time method to restore sorted order, scheduled for release in Python 3.8.

----------
stage:  -> resolved
versions: +Python 3.8 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Fri Jun 14 21:53:54 2019
From: report at bugs.python.org (Tim Peters)
Date: Sat, 15 Jun 2019 01:53:54 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560563634.83.0.909848134309.issue32846@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
stage: resolved -> commit review

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Fri Jun 14 22:01:45 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 15 Jun 2019 02:01:45 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560564105.84.0.185809681766.issue32846@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Can we close this now?  ISTM the issue has less to do with sets and more to do with memory allocation quirks and that on modern CPUs random memory accesses are slower than sequential memory accesses.  It is not a bug that sets are unordered collections that iterate over elements in a difference order than they were inserted.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Fri Jun 14 22:12:43 2019
From: report at bugs.python.org (Tim Peters)
Date: Sat, 15 Jun 2019 02:12:43 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560564763.29.0.882089488345.issue32846@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Raymond, please read my very recent comment one above yours.  A (overall) quadratic-time algorithm (O(A**2) where A is the number of arenas) in obmalloc.c is (to my eyes) probably the _primary_ cause of the sloth here.  That's been fixed for 3.8, but I don't have enough RAM even to run Terry's test code to confirm it.

I can confirm that there's no quadratic-time behavior anymore deleting large sets of strings, but only until I run out of RAM.  Neither is the behavior linear, but it's much closer to linear than quadratic now.

If someone with more RAM can confirm this for larger sets, then fine by me if this is closed again.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Fri Jun 14 22:23:36 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 15 Jun 2019 02:23:36 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1560565416.95.0.5976004525.issue4963@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Fri Jun 14 22:24:55 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 15 Jun 2019 02:24:55 +0000
Subject: [issue26543] [EASY] imaplib noop Debug: bytes vs Unicode bug in debug
 mode
In-Reply-To: <1457738623.54.0.0867122071018.issue26543@psf.upfronthosting.co.za>
Message-ID: <1560565495.38.0.0669147032506.issue26543@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26543>
_______________________________________

From report at bugs.python.org  Fri Jun 14 23:43:32 2019
From: report at bugs.python.org (Thomas Caswell)
Date: Sat, 15 Jun 2019 03:43:32 +0000
Subject: [issue37289] regression in cython due to peephole optomization
Message-ID: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>


New submission from Thomas Caswell <tcaswell at gmail.com>:

The fix for 
https://bugs.python.org/issue37213 in 3498c642f4e83f3d8e2214654c0fa8e0d51cebe5 (https://github.com/python/cpython/pull/13969) seems to break building numpy (master) with cython (master) due to a pickle failure.

The traceback (which is mostly in the cython source) is in an attachment.

I bisected it back to this commit and tested that reverting this commit fixes the numpy build.

----------
files: np_fail.txt
messages: 345655
nosy: pablogsal, scoder, serhiy.storchaka, tcaswell, vstinner
priority: normal
severity: normal
status: open
title: regression in cython due to peephole optomization
type: behavior
versions: Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48421/np_fail.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 00:17:42 2019
From: report at bugs.python.org (Andrei Zene)
Date: Sat, 15 Jun 2019 04:17:42 +0000
Subject: [issue28708] Low FD_SETSIZE limit on Windows
In-Reply-To: <1479250358.07.0.768722440644.issue28708@psf.upfronthosting.co.za>
Message-ID: <1560572262.49.0.986576271951.issue28708@roundup.psfhosted.org>


Andrei Zene <andrei.zene at outlook.com> added the comment:

That's actually a great explanation Nathaniel. Thanks for putting that all together.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28708>
_______________________________________

From report at bugs.python.org  Sat Jun 15 00:25:07 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 15 Jun 2019 04:25:07 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560572707.05.0.88382712458.issue32846@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I reran the code in msg312188.  Ints as before, string deletion +- linear up to 100 million, much better than before.

millions   old strings    new strings
of items  create delete  create delete
   4       1.55    .36     1.7    .38
   8       3.18    .76     3.6    .78
  16       6.48   1.80     7.3   1.71
  32      13.6    5.56    14.8   3.8
  64      28     19       30     8.4
 100      56     80       50    14.3

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Sat Jun 15 00:47:44 2019
From: report at bugs.python.org (Thomas Caswell)
Date: Sat, 15 Jun 2019 04:47:44 +0000
Subject: [issue37289] regression in cython due to peephole optomization
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560574064.22.0.293488746309.issue37289@roundup.psfhosted.org>


Thomas Caswell <tcaswell at gmail.com> added the comment:

This change also causes failures in the cython test suite (see attached).

----------
Added file: https://bugs.python.org/file48422/cython_test_log.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 02:36:32 2019
From: report at bugs.python.org (p)
Date: Sat, 15 Jun 2019 06:36:32 +0000
Subject: [issue37290] Mistranslation
Message-ID: <1560580592.41.0.231348186327.issue37290@roundup.psfhosted.org>


New submission from p <pybo at getnada.com>:

https://docs.python.org/ja/3.5/library/multiprocessing.html?highlight=multiprocessing#module-multiprocessing
(?????????????????????????????????????????????????????????????????????????????????)

-->???????????????????????????????????????????????????????????????????????

----------
assignee: docs at python
components: Documentation
messages: 345659
nosy: docs at python, p
priority: normal
severity: normal
status: open
title: Mistranslation
versions: Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37290>
_______________________________________

From report at bugs.python.org  Sat Jun 15 03:06:29 2019
From: report at bugs.python.org (Martin Panter)
Date: Sat, 15 Jun 2019 07:06:29 +0000
Subject: [issue37290] Mistranslation (Japanese)
In-Reply-To: <1560580592.41.0.231348186327.issue37290@roundup.psfhosted.org>
Message-ID: <1560582389.26.0.280871705794.issue37290@roundup.psfhosted.org>


Change by Martin Panter <vadmium+py at gmail.com>:


----------
nosy: +cocoatomo
title: Mistranslation -> Mistranslation (Japanese)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37290>
_______________________________________

From report at bugs.python.org  Sat Jun 15 03:17:54 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 07:17:54 +0000
Subject: [issue37289] regression in cython due to peephole optomization
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560583074.68.0.89448395533.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Thanks for the report. I will investigate, but given that the fix just optimizes bytecode as it was done in 3.7, and this is a picke failure, it seems that is likely that some data may need to be regenerated in Cython?

Stephan probably can confirm this meanwhile we investigate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 03:37:01 2019
From: report at bugs.python.org (Caleb Hattingh)
Date: Sat, 15 Jun 2019 07:37:01 +0000
Subject: [issue34831] Asyncio Tutorial
In-Reply-To: <1538134577.09.0.545547206417.issue34831@psf.upfronthosting.co.za>
Message-ID: <1560584221.36.0.567513934382.issue34831@roundup.psfhosted.org>


Caleb Hattingh <caleb.hattingh at gmail.com> added the comment:

That was an long two months, apologies.  I've made some fixes based on review comments and cleaned up some more of the code samples.  The primary outstanding pieces are the client component of the chat application case study, and the GUI integration section of the client case study.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34831>
_______________________________________

From report at bugs.python.org  Sat Jun 15 04:23:00 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 08:23:00 +0000
Subject: [issue37290] Mistranslation (Japanese)
In-Reply-To: <1560580592.41.0.231348186327.issue37290@roundup.psfhosted.org>
Message-ID: <1560586980.2.0.108419855998.issue37290@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks for the report. Japanese translation is tracked in GitHub at https://github.com/python/python-docs-ja . I think this can be closed as third party issue and this can be raised as a GitHub issue there.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37290>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:22:15 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 09:22:15 +0000
Subject: [issue37289] regression in cython due to peephole optomization
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560590535.49.0.757931986399.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I reverted 3498c642f4e83f3d8e2214654c0fa8e0d51cebe5 and tried to build cython and numpy an it fails for me still:

> git log

commit 17e024a1a999f96fee52e99bd4587da383647993 (HEAD -> master)
Author: Pablo Galindo <pablogsal at gmail.com>
Date:   Sat Jun 15 10:16:52 2019 +0100

    revert "bpo-37213: Handle negative line deltas correctly in the peephole optimizer (GH-13969)"

    This reverts commit 3498c642f4e83f3d8e2214654c0fa8e0d51cebe5.

commit 7efc526e5cfb929a79c192ac2dcf7eb78d3a4401 (upstream/master, upstream/HEAD)
Author: Victor Stinner <vstinner at redhat.com>
Date:   Sat Jun 15 03:24:41 2019 +0200

    bpo-36707: Document "m" removal from sys.abiflags (GH-14090)


? ~/github/cpython/python.exe -m pip install . --user
/Users/pgalindo3/.local/lib/python3.9/site-packages/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
  from collections import Mapping
Looking in indexes: http://localhost:3141/pablogsal/local/+simple/
Processing /Users/pgalindo3/github/cython
Installing collected packages: Cython
  Running setup.py install for Cython ... done
Successfully installed Cython-3.0a0

? ~/github/cpython/python.exe -m pip install . --user
    Processing numpy/random/dsfmt.pyx
    Traceback (most recent call last):
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/tools/cythonize.py", line 243, in <module>
        main()
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/tools/cythonize.py", line 239, in main
        find_process_files(root_dir)
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/tools/cythonize.py", line 230, in find_process_files
        process(root_dir, fromfile, tofile, function, hash_db)
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/tools/cythonize.py", line 196, in process
        processor_function(fromfile, tofile)
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/tools/cythonize.py", line 85, in process_pyx
        subprocess.check_call(
      File "/Users/pgalindo3/github/cpython/Lib/subprocess.py", line 348, in check_call
        raise CalledProcessError(retcode, cmd)
    subprocess.CalledProcessError: Command '['/Users/pgalindo3/github/cpython/python.exe', '-m', 'cython', '-3', '--fast-fail', '-o', 'dsfmt.c', 'dsfmt.pyx']' returned non-zero exit status 1.
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/setup.py", line 443, in <module>
        setup_package()
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/setup.py", line 426, in setup_package
        generate_cython()
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-1nbv5hs2/setup.py", line 234, in generate_cython
        raise RuntimeError("Running cythonize failed!")
    RuntimeError: Running cythonize failed!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:24:25 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 09:24:25 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560590665.7.0.100703449787.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
title: regression in cython due to peephole optomization -> regression in Cython when pickling objects

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:26:30 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 09:26:30 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560590790.97.0.754996205311.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Did you open a bug in the Cython tracker?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:28:49 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 09:28:49 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560590929.74.0.679231308471.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I tried to compile numpy with python3.8 alpha 4 and Cython master and still fails:

~/github/numpy master ?
? ~/github/cpython/python.exe --version
Python 3.8.0a4

~/github/numpy master ?
? ~/github/cpython/python.exe -m pip freeze
/Users/pgalindo3/.local/lib/python3.8/site-packages/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working
  from collections import Mapping
Cython==3.0a0


~/github/numpy master ?
? ~/github/cpython/python.exe -m pip install . --user
       generate_cython()
      File "/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-vposbe_c/setup.py", line 234, in generate_cython
        raise RuntimeError("Running cythonize failed!")
    RuntimeError: Running cythonize failed!

    ----------------------------------------
Command "/Users/pgalindo3/github/cpython/python.exe -u -c "import setuptools, tokenize;__file__='/private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-vposbe_c/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-record-9l43u38y/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /private/var/folders/sw/ml9tlhsx7hd7sdqpnlzhrxxh0000gr/T/pip-req-build-vposbe_c/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:36:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 15 Jun 2019 09:36:07 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560591367.72.0.862965058853.issue36707@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ned Deily:
> My preference remains to not make the flags change at all

Well, "m" in ABI flags became useless around Python 3.4. I don't see the point of pretending that the "m" ABI is different and then provide two names for the same thing:

    python3.8 and python3.8m
    python3.8-config and python3.8m-config
    man python3.8 and man python3.8m
    etc.

I'm not sure why, but on Fedora /usr/bin/python3.7 and /usr/bin/python3.7m are two separated files... with the same content (ex: same MD5 sum). Well, it's just 17 KiB each :-) /usr/bin/python3.7-config is a symlink to python3.7m-config.

The change itself is painful for distributors like Red Hat (Fedora, RHEL), but things should be simpler once the change is done.

My long-term goal is to get a single ABI for everything: CPython, PyPy, RustPython, MicroPython, etc. :-) Maybe it's not possible, but at least I would like to move towards this goal!

Overall project:

* https://docs.python.org/3.8/whatsnew/3.8.html#debug-build-uses-the-same-abi-as-release-build
* https://pythoncapi.readthedocs.io/

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:39:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 15 Jun 2019 09:39:47 +0000
Subject: [issue36707] The "m" ABI flag of SOABI for pymalloc is no longer
 needed
In-Reply-To: <1556065645.57.0.820338293941.issue36707@roundup.psfhosted.org>
Message-ID: <1560591587.65.0.301452192969.issue36707@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks everybody for your help. It is now documented.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36707>
_______________________________________

From report at bugs.python.org  Sat Jun 15 05:46:28 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 09:46:28 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560591988.1.0.777156397823.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I have compiled CPython master, install the current Cython on pypi (not Cython master) and tried to compile numpy and it succeeds. This seems that is something on Cython master.

~/github/numpy master ?
 ~/github/cpython/python.exe --version
Python 3.9.0a0

~/github/numpy master ?
? ~/github/cpython/python.exe -m pip freeze
/Users/pgalindo3/.local/lib/python3.9/site-packages/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
  from collections import Mapping
Cython==0.29.10

? ~/github/cpython/python.exe -m pip install . --user
/Users/pgalindo3/.local/lib/python3.9/site-packages/pip/_vendor/html5lib/_trie/_base.py:3: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
  from collections import Mapping
Processing /Users/pgalindo3/github/numpy
Installing collected packages: numpy
  Running setup.py install for numpy ... done
Successfully installed numpy-1.17.0.dev0+9f8401f

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:04:16 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:04:16 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560593056.79.0.0990845197997.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
Removed message: https://bugs.python.org/msg345668

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:10:46 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:10:46 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560593446.07.0.235558584196.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
Removed message: https://bugs.python.org/msg345665

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:10:56 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:10:56 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560593456.47.0.344208112783.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
Removed message: https://bugs.python.org/msg345663

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:11:50 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:11:50 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560593510.52.0.290304315634.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

[I have deleted some comments claiming that I was not able to reproduce the issue because I managed to reproduce the issue correctly at the end]

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:16:34 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 10:16:34 +0000
Subject: [issue37290] Mistranslation (Japanese)
In-Reply-To: <1560580592.41.0.231348186327.issue37290@roundup.psfhosted.org>
Message-ID: <1560593794.88.0.00705115398301.issue37290@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37290>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:37:03 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:37:03 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560595023.39.0.0389875600942.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I managed to find the original cause, although I don't understand exactly why it happens. The error is caused by the 'if False' handling of https://github.com/python/cpython/pull/13332. There is some failure in that logic, so for now I made a PR reverting that change.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 06:37:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 10:37:26 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560595046.64.0.186186096639.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +13954
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14099

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:05:24 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:05:24 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560596724.74.0.444936021735.issue37279@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset ef2152354f03a165c5e3adb53e2276934fabd50a by Andrew Svetlov in branch 'master':
bpo-37279: Fix asyncio sendfile support when  extra data are sent in fallback mode. (GH-14075)
https://github.com/python/cpython/commit/ef2152354f03a165c5e3adb53e2276934fabd50a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:05:35 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 11:05:35 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560596735.17.0.256354730128.issue37279@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13955
pull_request: https://github.com/python/cpython/pull/14100

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:09:16 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:09:16 +0000
Subject: [issue37280] Use threadpool for reading from file for sendfile
 fallback mode
In-Reply-To: <1560508189.12.0.504777268427.issue37280@roundup.psfhosted.org>
Message-ID: <1560596956.03.0.507321370583.issue37280@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13956
pull_request: https://github.com/python/cpython/pull/14102

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37280>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:17:45 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:17:45 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560597465.57.0.970537875411.issue37279@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +13957
pull_request: https://github.com/python/cpython/pull/14103

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:18:46 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 11:18:46 +0000
Subject: [issue37280] Use threadpool for reading from file for sendfile
 fallback mode
In-Reply-To: <1560508189.12.0.504777268427.issue37280@roundup.psfhosted.org>
Message-ID: <1560597526.61.0.992026489346.issue37280@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13958
pull_request: https://github.com/python/cpython/pull/14101

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37280>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:24:19 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 11:24:19 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560597859.85.0.915507640173.issue37279@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bb07321c6a7e1cbe597c3fc5fa275a85d0f50acb by Miss Islington (bot) in branch '3.8':
bpo-37279: Fix asyncio sendfile support when  extra data are sent in fallback mode. (GH-14075)
https://github.com/python/cpython/commit/bb07321c6a7e1cbe597c3fc5fa275a85d0f50acb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:25:57 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:25:57 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560597957.78.0.97360589305.issue37279@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:26:34 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:26:34 +0000
Subject: [issue37280] Use threadpool for reading from file for sendfile
 fallback mode
In-Reply-To: <1560508189.12.0.504777268427.issue37280@roundup.psfhosted.org>
Message-ID: <1560597994.64.0.188614795709.issue37280@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37280>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:27:00 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 11:27:00 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560598020.61.0.161717079197.issue37289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Could you please provide an example of the improperly optimized code?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:30:49 2019
From: report at bugs.python.org (David Carlier)
Date: Sat, 15 Jun 2019 11:30:49 +0000
Subject: [issue37291] AST - code cleanup
Message-ID: <1560598249.35.0.0160143221148.issue37291@roundup.psfhosted.org>


New submission from David Carlier <dcarlier at afilias.info>:

Removing little dead code part.

----------
messages: 345674
nosy: David Carlier
priority: normal
pull_requests: 13959
severity: normal
status: open
title: AST - code cleanup
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37291>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:37:34 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 15 Jun 2019 11:37:34 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1560598654.69.0.498091335726.issue32912@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

[Raymond]

> Also, it gets in the way of the end-user strategy of "backslash anything that looks special"

That's not a good strategy in the first place, though: adding an extra backslash for something that doesn't need to be escaped isn't benign - it's usually an error, since it puts that backslash into the resulting string.

    >>> "abc\`d" == "abc`d"
    False

In other words, it seems to me that getting in the way of this broken end-user strategy is a *good* thing, since it warns of possible mistakes.

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:43:59 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 11:43:59 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560599039.88.0.0738736274556.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I was not able to find it in Cython but PR14099 fixes it so I prefer to revert the optimization for now and then try to add it back once we understand what's failing exactly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:44:29 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 11:44:29 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560599069.16.0.461504092662.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 07:56:30 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 11:56:30 +0000
Subject: [issue37279] asyncio sendfile sends extra data in the last chunk in
 fallback mode
In-Reply-To: <1560507904.77.0.354970791225.issue37279@roundup.psfhosted.org>
Message-ID: <1560599790.34.0.122467039213.issue37279@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset e5d67f1e31381d28b24f6e1c0f8388d9bf0bfc5f by Andrew Svetlov in branch '3.7':
[3.7] bpo-37279: Fix asyncio sendfile support when  extra data are sent in fallback mode. (GH-14075). (GH-14103)
https://github.com/python/cpython/commit/e5d67f1e31381d28b24f6e1c0f8388d9bf0bfc5f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37279>
_______________________________________

From report at bugs.python.org  Sat Jun 15 08:04:02 2019
From: report at bugs.python.org (SilentGhost)
Date: Sat, 15 Jun 2019 12:04:02 +0000
Subject: [issue37291] AST - code cleanup
In-Reply-To: <1560598249.35.0.0160143221148.issue37291@roundup.psfhosted.org>
Message-ID: <1560600242.32.0.484512633963.issue37291@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
components: +Interpreter Core
nosy: +benjamin.peterson
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37291>
_______________________________________

From report at bugs.python.org  Sat Jun 15 08:14:27 2019
From: report at bugs.python.org (Shen Han)
Date: Sat, 15 Jun 2019 12:14:27 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560600867.74.0.364700214593.issue37248@roundup.psfhosted.org>


Shen Han <shawnhan1029 at gmail.com> added the comment:

Yes, I think so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Sat Jun 15 08:16:09 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 12:16:09 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560600969.21.0.619109792514.issue37248@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks for the report. Closing.

----------
stage:  -> resolved
status: open -> closed
superseder:  -> Make lib2to3 grammar more closely match Python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Sat Jun 15 08:16:16 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 12:16:16 +0000
Subject: [issue37248] support conversion of `func(**{} if a else b)`
In-Reply-To: <1560346847.18.0.350952603259.issue37248@roundup.psfhosted.org>
Message-ID: <1560600976.79.0.186862384551.issue37248@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
resolution:  -> duplicate

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37248>
_______________________________________

From report at bugs.python.org  Sat Jun 15 09:06:31 2019
From: report at bugs.python.org (Crusader Ky)
Date: Sat, 15 Jun 2019 13:06:31 +0000
Subject: [issue37292] _xxsubinterpreters: Can't unpickle objects defined in
 __main__
Message-ID: <1560603991.54.0.788079404137.issue37292@roundup.psfhosted.org>


New submission from Crusader Ky <crusaderky at gmail.com>:

As of CPython 3.8.0b1:

If one pickles an object that is defined in the __main__ module, sends it to a subinterpreter as bytes, and then tries unpickling it there, it fails saying that __main__ doesn't define it.


import _xxsubinterpreters as interpreters
import pickle


class C:
    pass


c = C()

interp_id = interpreters.create()
c_bytes = pickle.dumps(c)
interpreters.run_string(
    interp_id,
    "import pickle; pickle.loads(c_bytes)",
    shared={"c_bytes": c_bytes},
)


If the above is executed directly with the python command-line, it fails. If it's imported from another module, it works.
One would expected behaviour compatible with sub-processes spawned with the spawn method, where the__main__ of the parent process is visible to the subprocess too.

Workarounds:
1 - define everything that must be pickled in an imported module
2 - use CloudPickle

----------
messages: 345680
nosy: Crusader Ky, eric.snow
priority: normal
severity: normal
status: open
title: _xxsubinterpreters: Can't unpickle objects defined in __main__
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37292>
_______________________________________

From report at bugs.python.org  Sat Jun 15 09:06:41 2019
From: report at bugs.python.org (Crusader Ky)
Date: Sat, 15 Jun 2019 13:06:41 +0000
Subject: [issue37292] _xxsubinterpreters: Can't unpickle objects defined in
 __main__
In-Reply-To: <1560603991.54.0.788079404137.issue37292@roundup.psfhosted.org>
Message-ID: <1560604001.89.0.572710447406.issue37292@roundup.psfhosted.org>


Change by Crusader Ky <crusaderky at gmail.com>:


----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37292>
_______________________________________

From report at bugs.python.org  Sat Jun 15 09:15:17 2019
From: report at bugs.python.org (Crusader Ky)
Date: Sat, 15 Jun 2019 13:15:17 +0000
Subject: [issue37293] concurrent.futures.InterpreterPoolExecutor
Message-ID: <1560604517.31.0.263744065617.issue37293@roundup.psfhosted.org>


New submission from Crusader Ky <crusaderky at gmail.com>:

As one of the logical consequences to PEP 554, it would be neat to have a concurrent.futures.InterpreterPoolExecutor.

I wrote the initial code at https://github.com/crusaderky/subinterpreters_tests - currently missing unit tests and pickle5 buffers support.

If everybody is happy with the design, I'll start working on a PR as soon as the GIL becomes per-interpreter (it's kinda pointless before that).

----------
components: Extension Modules
messages: 345681
nosy: Crusader Ky, eric.snow
priority: normal
severity: normal
status: open
title: concurrent.futures.InterpreterPoolExecutor
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37293>
_______________________________________

From report at bugs.python.org  Sat Jun 15 10:58:03 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 14:58:03 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560610683.39.0.777188414381.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 7a68f8c28bb78d957555a5001dac4df6345434a0 by Pablo Galindo in branch 'master':
bpo-37289: Remove 'if False' handling in the peephole optimizer (GH-14099)
https://github.com/python/cpython/commit/7a68f8c28bb78d957555a5001dac4df6345434a0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 10:58:13 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 14:58:13 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560610693.55.0.949202857849.issue37289@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13960
pull_request: https://github.com/python/cpython/pull/14111

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 10:58:40 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 14:58:40 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560610720.53.0.327974094312.issue37289@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13961
pull_request: https://github.com/python/cpython/pull/14112

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:02:45 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 15:02:45 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560610965.34.0.284018468483.issue35998@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Ooops. Looks like a real problem, not test-only :(

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:19:58 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 15:19:58 +0000
Subject: [issue1875] "if 0: return" not raising SyntaxError
In-Reply-To: <1200768950.55.0.245752373825.issue1875@psf.upfronthosting.co.za>
Message-ID: <1560611998.6.0.317921757072.issue1875@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The issue is not fixed yet. The compiler now rejects

if 0:
    return

but it still accepts

if 1:
    pass
else:
    return

while 0:
    return

----------
resolution: fixed -> 
stage: resolved -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1875>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:20:40 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:20:40 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560612040.29.0.311538230651.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Serhiy, this is the code that was incorrectly optimized:

  3           0 LOAD_GLOBAL              0 (g)
              2 LOAD_ATTR                1 (__code__)
              4 POP_JUMP_IF_FALSE        8
              6 JUMP_FORWARD             4 (to 12)
        >>    8 LOAD_CONST               0 (None)
             10 POP_JUMP_IF_FALSE       20

  4     >>   12 LOAD_GLOBAL              2 (print)
             14 LOAD_CONST               2 ('Called!')
             16 CALL_FUNCTION            1
             18 POP_TOP
        >>   20 LOAD_CONST               0 (None)
             22 RETURN_VALUE

def g():
    if True if g.__code__ else None:
        print("Called!")

g()

The problem is that [LOAD_CONST               0 (None)] made the peephole to delete the block because it does not detect that previous conditions in the same conditional could be True. The general case was made by looking back for POP_JUMP_IF_{FALSE,TRUE} but with this construct JUMP_FORWARD appears.

I think handling this condition in the peephole optimizer can be very dangerous error prone to get right because all the information is lost, but doing it at the ast level makes us lose syntax errors in optimized blocks, which is also wrong. Any ideas?

It happens here in Cython:

https://github.com/cython/cython/blob/master/Cython/Compiler/Nodes.py#L5131

That's why the errors manifest as pickling errors

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:21:48 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:21:48 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560612108.5.0.586576797271.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Just to be clear, before PR14099, the code was wrongly optimized to:

  3           0 LOAD_GLOBAL              0 (g)
              2 LOAD_ATTR                1 (__code__)
              4 POP_JUMP_IF_FALSE        8
              6 JUMP_FORWARD             0 (to 8)

  4     >>    8 LOAD_CONST               0 (None)
             10 RETURN_VALUE

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:22:11 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:22:11 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560612131.32.0.705844410185.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 284daeade210d3aac049f4278a1fb76d19e6d78a by Pablo Galindo (Miss Islington (bot)) in branch '3.8':
bpo-37289: Remove 'if False' handling in the peephole optimizer (GH-14099) (GH-14112)
https://github.com/python/cpython/commit/284daeade210d3aac049f4278a1fb76d19e6d78a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:22:37 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:22:37 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560612157.49.0.223718254429.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 81fecf7b7a6e766a213c6e670219c1da52461589 by Pablo Galindo (Miss Islington (bot)) in branch '3.7':
bpo-37289: Remove 'if False' handling in the peephole optimizer (GH-14099) (GH-14111)
https://github.com/python/cpython/commit/81fecf7b7a6e766a213c6e670219c1da52461589


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:23:55 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 15:23:55 +0000
Subject: [issue36785] Implement PEP 574
In-Reply-To: <1556908101.83.0.107763193732.issue36785@roundup.psfhosted.org>
Message-ID: <1560612235.14.0.128684960575.issue36785@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13962
pull_request: https://github.com/python/cpython/pull/14113

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36785>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:29:46 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 15:29:46 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1560612586.94.0.195235768027.issue35121@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 979daae300916adb399ab5b51410b6ebd0888f13 by Miss Islington (bot) (Xtreak) in branch '2.7':
[2.7] bpo-35121: prefix dot in domain for proper subdomain validation (GH-10258) (GH-13426)
https://github.com/python/cpython/commit/979daae300916adb399ab5b51410b6ebd0888f13


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:41:25 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 15:41:25 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560613285.14.0.788973744059.issue37289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Do you mind to add a test?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:46:40 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 15 Jun 2019 15:46:40 +0000
Subject: [issue1572968] release GIL while doing I/O operations in the mmap
 module
Message-ID: <1560613600.78.0.554955757059.issue1572968@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13963
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14114

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1572968>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:48:30 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 15 Jun 2019 15:48:30 +0000
Subject: [issue1572968] release GIL while doing I/O operations in the mmap
 module
Message-ID: <1560613710.7.0.67844363596.issue1572968@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
components: +Extension Modules -Library (Lib)
nosy: +ZackerySpytz
versions: +Python 3.9 -Python 2.7, Python 3.1

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1572968>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:51:01 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:51:01 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560613861.26.0.0107280678314.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Sure, will do.

How you think we should handle this particular optimization? Do you see a more resilient way of doing this on the peephole optimizer?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:52:32 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Sat, 15 Jun 2019 15:52:32 +0000
Subject: [issue28009] core logic of uuid.getnode() needs refresh
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560613952.09.0.537606815586.issue28009@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:


New changeset 3a1d50e7e573efb577714146bed5c03b9c95f466 by Nick Coghlan (Michael Felt) in branch 'master':
bpo-28009: Fix uuid SkipUnless logic to be based on platform programs capable of introspection (GH-12777)
https://github.com/python/cpython/commit/3a1d50e7e573efb577714146bed5c03b9c95f466


----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:52:39 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 15:52:39 +0000
Subject: [issue28009] core logic of uuid.getnode() needs refresh
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560613959.47.0.846867414535.issue28009@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13964
pull_request: https://github.com/python/cpython/pull/14115

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Sat Jun 15 11:54:22 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 15:54:22 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560614062.46.0.49811048647.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Would it make sense to put this on the compiler? When we run compile_if we could check if there is one constant in the test and of the constant is true we skip the block.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:03:01 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 16:03:01 +0000
Subject: [issue36785] Implement PEP 574
In-Reply-To: <1556908101.83.0.107763193732.issue36785@roundup.psfhosted.org>
Message-ID: <1560614581.06.0.956303739043.issue36785@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 298023633fde5cd60926a2923a01d896550cbf84 by Miss Islington (bot) in branch '3.8':
bpo-36785: PEP 574 What's New entry (GH-13931)
https://github.com/python/cpython/commit/298023633fde5cd60926a2923a01d896550cbf84


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36785>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:09:49 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:09:49 +0000
Subject: [issue1875] "if 0: return" not raising SyntaxError
In-Reply-To: <1200768950.55.0.245752373825.issue1875@psf.upfronthosting.co.za>
Message-ID: <1560614989.95.0.336273555566.issue1875@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13965
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14116

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue1875>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:09:50 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:09:50 +0000
Subject: [issue32477] Move jumps optimization from the peepholer to the
 compiler
In-Reply-To: <1514844207.77.0.467229070634.issue32477@psf.upfronthosting.co.za>
Message-ID: <1560614990.06.0.68296983022.issue32477@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13966
pull_request: https://github.com/python/cpython/pull/14116

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32477>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:10:37 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 15 Jun 2019 16:10:37 +0000
Subject: [issue28009] core logic of uuid.getnode() needs refresh
In-Reply-To: <1473290315.48.0.840701308825.issue28009@psf.upfronthosting.co.za>
Message-ID: <1560615037.5.0.0612473874408.issue28009@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f0e5c01182daefa20c624383c8a37c25eacfde43 by Miss Islington (bot) in branch '3.8':
bpo-28009: Fix uuid SkipUnless logic to be based on platform programs capable of introspection (GH-12777)
https://github.com/python/cpython/commit/f0e5c01182daefa20c624383c8a37c25eacfde43


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28009>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:22:31 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:22:31 +0000
Subject: [issue32477] Move jumps optimization from the peepholer to the
 compiler
In-Reply-To: <1514844207.77.0.467229070634.issue32477@psf.upfronthosting.co.za>
Message-ID: <1560615751.21.0.17231600116.issue32477@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

PR 14116 is based on the part of PR 5077. It serves three functions:

* Finally fixes issue1875.

* Simplifies the code. Removes special cases for "if 0" and "while 1". 31 insertions, 80 deletions in Python/compile.c + Python/peephole.c.

* However such optimization is now applied in more general cases, not just for "if" and "while".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32477>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:22:38 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:22:38 +0000
Subject: [issue32477] Move jumps optimization from the peepholer to the
 compiler
In-Reply-To: <1514844207.77.0.467229070634.issue32477@psf.upfronthosting.co.za>
Message-ID: <1560615758.72.0.127585549555.issue32477@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32477>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:29:32 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:29:32 +0000
Subject: [issue35647] Cookie path check returns incorrect results
In-Reply-To: <1546502396.67.0.243403156352.issue35647@roundup.psfhosted.org>
Message-ID: <1560616172.28.0.518202195244.issue35647@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset ee15aa2b8501718cb77e339381f72409a416f801 by Serhiy Storchaka (Xtreak) in branch '2.7':
[2.7] bpo-35647: Fix path check in cookiejar. (GH-11436) (GH-13427)
https://github.com/python/cpython/commit/ee15aa2b8501718cb77e339381f72409a416f801


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35647>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:34:36 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 16:34:36 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560616476.53.0.15958969102.issue37251@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
keywords: +patch
pull_requests: +13967
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14117

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:36:55 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:36:55 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560616615.26.0.510544679812.issue37289@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, it could be moved to the compiler. See issue32477 which moves at that direction.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:37:47 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 16:37:47 +0000
Subject: [issue35647] Cookie path check returns incorrect results
In-Reply-To: <1546502396.67.0.243403156352.issue35647@roundup.psfhosted.org>
Message-ID: <1560616667.37.0.332173267694.issue35647@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Closing this as resolved since the fix was merged to all branches. Thank you all.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35647>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:38:00 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 16:38:00 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1560616680.52.0.31790679103.issue35121@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Closing this as resolved since the fix was merged to all branches. Thank you all.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:41:48 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 16:41:48 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560616908.89.0.635527958101.issue37271@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

We should handle this with care and prove that the optimization loop is finite.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:44:46 2019
From: report at bugs.python.org (Thomas Caswell)
Date: Sat, 15 Jun 2019 16:44:46 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560617086.37.0.488750641817.issue37289@roundup.psfhosted.org>


Thomas Caswell <tcaswell at gmail.com> added the comment:

I can confirm that master branches of cpython, cython, and numpy all build together again, thank you for the quick investigation and fix!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:52:55 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sat, 15 Jun 2019 16:52:55 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1560617575.19.0.439303063057.issue32912@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

[Aaron]

> [...] makes it very difficult for library authors to fix this.

If you're willing to use 3rd party libraries, then my own experience is that `pycodestyle` or `flake8` make this easy: you just need to run "flake8 --select W605" at the root of your repository tree to get a list of all the code locations that need to be fixed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:53:06 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 15 Jun 2019 16:53:06 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560617586.74.0.202595979561.issue37251@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I created PR to ensure the __code__ object is checked to be a CodeType and converted the report to a unittest. I also found a similar function _is_async_func [0] which also seems to perform similar check but is used only in create_autospec. creating an autospec function out of MagicMock with a function spec is not possible so though the change could be made it's not testable. Also changing _is_async_func to _is_async_obj in create_autospec shows no test case failure. Can this be removed to use only _is_async_obj? Is there a difference in their usage due to isawaitable check present in _is_async_obj that needs a test?

# create_autospec with MagicMock(spec=lambda x: x)

$ cpython git:(bpo37251) ./python.exe
Python 3.9.0a0 (heads/master:7a68f8c28b, Jun 15 2019, 21:00:05)
[Clang 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from unittest.mock import *
>>> create_autospec(MagicMock())
<MagicMock spec='MagicMock' id='4370353280'>
>>> create_autospec(MagicMock(spec=lambda x: x))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 2547, in create_autospec
    mock = Klass(parent=_parent, _new_parent=_parent, _new_name=_new_name,
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 2066, in __init__
    super().__init__(*args, **kwargs)
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 1996, in __init__
    _safe_super(AsyncMagicMixin, self).__init__(*args, **kw)
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 1007, in __init__
    _safe_super(CallableMixin, self).__init__(
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 442, in __init__
    self._mock_add_spec(spec, spec_set, _spec_as_instance, _eat_self)
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 503, in _mock_add_spec
    res = _get_signature_object(spec,
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/unittest/mock.py", line 99, in _get_signature_object
    return func, inspect.signature(sig_func)
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/inspect.py", line 3093, in signature
    return Signature.from_callable(obj, follow_wrapped=follow_wrapped)
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/inspect.py", line 2842, in from_callable
    return _signature_from_callable(obj, sigcls=cls,
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/inspect.py", line 2292, in _signature_from_callable
    return _signature_from_function(sigcls, obj,
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/inspect.py", line 2175, in _signature_from_function
    parameters.append(Parameter(name, annotation=annotation,
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/inspect.py", line 2495, in __init__
    raise TypeError(msg)
TypeError: name must be a str, not a MagicMock


[0] https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/unittest/mock.py#L55

----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Sat Jun 15 12:58:59 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 16:58:59 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560617939.53.0.485514677813.issue37271@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

We can add a #define for a maximum numbers of iterations. The pyperformance test suite shows speed ups of 2-3% without PGO/LTO. I will ran more concise experiments including PGO but even with a max cap of iterations (10 in my experiments) we get nice improvements without much more complexity.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:01:59 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 17:01:59 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560618119.05.0.589991316692.issue37271@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Probably is not that easy, but a naive thought respecting loops:

As the peephole optimizer only produces code that is the same length or smaller and it works by feeling noops and deleting them, the only loop would be code that is of the same length but different, but that cannot happen by adding noops and removing them, right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:45:31 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 15 Jun 2019 17:45:31 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560620731.75.0.281101150653.issue37271@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Tim, do you have any thoughts on this?

In the past, there was an implicit red-line that we would not cross even if a performance improvement was possible.  Given that that was a long time ago and that the newer devs are both more aggressive and more fearless, we ought to re-examine whether the red-line should be made explicit or whether it no longer applies.

For this particular patch, a source of discomfort is that the optimization step takes longer (due to multiple passes).  So, we sometimes get faster wordcode but that time it takes to get there is longer.

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:47:34 2019
From: report at bugs.python.org (Big Stone)
Date: Sat, 15 Jun 2019 17:47:34 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560620854.13.0.295726905835.issue35360@roundup.psfhosted.org>


Big Stone <stonebig34 at gmail.com> added the comment:

any hope for beta2 ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:49:58 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 15 Jun 2019 17:49:58 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
Message-ID: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>


New submission from G?ry <gery.ogam at gmail.com>:

The following code hangs forever instead of printing "called" 10 times:

    from concurrent.futures import ProcessPoolExecutor
    
    class A:
        def f(self):
            print("called")
    
    class B(A):
        def f(self):
            executor = ProcessPoolExecutor(max_workers=2)
            futures = [executor.submit(super(B, self).f)
                       for _ in range(10)]
    
    if __name__ == "__main__":
        B().f()

The same code with `super(B, self)` replaced with `super()` raises the following error:

> TypeError: super(type, obj): obj must be an instance or subtype of type

However, replacing `ProcessPoolExecutor` with `ThreadPoolExecutor` works  as expected, but only with `super(B, self)` (with `super()` it still raises the same error).

----------
components: Library (Lib)
messages: 345709
nosy: asvetlov, bquinlan, inada.naoki, lukasz.langa, maggyero, ned.deily, pitrou, serhiy.storchaka
priority: normal
severity: normal
status: open
title: ProcessPoolExecutor fails with super
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:52:48 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 15 Jun 2019 17:52:48 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560621168.7.0.246984085897.issue37271@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

>So, we sometimes get faster wordcode but that time it takes to get there is longer.

Is worth noting that the (very small) overhead to obtain the wordcode happens once but the benefits of the resulting opcode will be felt every time you execute it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 13:52:54 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 15 Jun 2019 17:52:54 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560621174.32.0.308919011937.issue37294@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 14:41:46 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Sat, 15 Jun 2019 18:41:46 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1560624106.07.0.0825617480988.issue33972@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +13968
pull_request: https://github.com/python/cpython/pull/14119

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:17:40 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 15 Jun 2019 19:17:40 +0000
Subject: [issue37295] Possible optimizations for math.comb()
Message-ID: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

The implementation of math.comb() is nice in that it limits the size of intermediate values as much as possible and it avoids unnecessary steps when min(k,n-k) is small with respect to k.

There are some ways it can be made better or faster:

1) For small values of n, there is no need to use PyLong objects at every step.  Plain C integers would suffice and we would no longer need to make repeated allocations for all the intermediate values.  For 32-bit builds, this could be done for n<=30.  For 64-bit builds, it applies to n<=62.  Adding this fast path would likely give a 10x to 50x speed-up.

2) For slightly larger values of n, the computation could be sped-up by precomputing one or more rows of binomial coefficients (perhaps for n=75, n=150, and n=225).  The calculation could then start from that row instead of from higher rows on Pascal's triangle.   

For example comb(100, 55) is currently computed as:
    comb(55,1) * 56 // 2 * 57 // 3 ... 100 // 45    <== 45 steps

Instead, it could be computed as:
    comb(75,20) * 76 // 21 * 77 // 22 ... 100 / 45  <== 25 steps
           ^-- found by table lookup 

This gives a nice speed-up in exchange for a little memory in an array of constants (for n=75, we would need an array of length 75//2 after exploiting symmetry).  Almost all cases would should show some benefit and in favorable cases like comb(76, 20) the speed-up would be nearly 75x.

3) When k is close to n/2, the current algorithm is slower than just computing (n!) / (k! * (n-k)!). However, the factorial method comes at the cost of more memory usage for large n.  The factorial method consumes memory proportional to n*log2(n) while the current early-cancellation method uses memory proportional to n+log2(n).  Above some threshold for memory pain, the current method should always be preferred.  I'm not sure the factorial method should be used at all, but it is embarrassing that factorial calls sometimes beat the current C implementation:

    $ python3.8 -m timeit -r 11 -s 'from math import comb, factorial as fact' -s 'n=100_000' -s 'k = n//2' 'comb(n, k)'
    1 loop, best of 11: 1.52 sec per loop
    $ python3.8 -m timeit -r 11 -s 'from math import comb, factorial as fact' -s 'n=100_000' -s 'k = n//2' 'fact(n) // (fact(k) * fact(n-k))'
    1 loop, best of 11: 518 msec per loop

4) For values such as n=1_000_000 and k=500_000, the running time is very long and the routine doesn't respond to SIGINT.  We could add checks for keyboard interrupts for large n.  Also consider releasing the GIL.

5) The inner-loop current does a pure python subtraction than could in many cases be done with plain C integers.  When n is smaller than maxsize, we could have a code path that replaces "PyNumber_Subtract(factor, _PyLong_One)" with something like "PyLong_FromUnsignedLongLong((unsigned long long)n - i)".

----------
components: Library (Lib)
messages: 345711
nosy: mark.dickinson, pablogsal, rhettinger, serhiy.storchaka, tim.peters
priority: normal
severity: normal
status: open
title: Possible optimizations for math.comb()
type: performance
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:27:39 2019
From: report at bugs.python.org (Rick)
Date: Sat, 15 Jun 2019 19:27:39 +0000
Subject: [issue37296] pdb next vs __next__
Message-ID: <1560626859.25.0.0533027405715.issue37296@roundup.psfhosted.org>


New submission from Rick <tsingi at tutanota.com>:

Don't know how to get version from pdb, Makefile says 2.7

Code runs but when debugging I get an error that an iterator has no next() function.  It has got a __next__() function, and it runs, just not under pdb.

If I create a spurious next() function, pdb runs, and calls the __next__() function.

----------
messages: 345712
nosy: tsingi
priority: normal
severity: normal
status: open
title: pdb next vs __next__
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37296>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:53:38 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 15 Jun 2019 19:53:38 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560628418.28.0.859551150499.issue37294@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:53:55 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 15 Jun 2019 19:53:55 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560628435.66.0.234205510386.issue37271@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I'm familiar with the trade-offs (I'm the original designer of this code), but it is possible to use that reasoning to talk yourself into thinking that any optimization to code generation is worth it.  

The speed of the compile does matter as well (think about uses of exec() in dataclasses for example).  Also, the level of complexity matters as well.  The last time we introduced recursive passes for part of the peepholer (in constant folding), it took years to get it fully debugged and it caused a number of bug reports with respect to total compilation time.

FWIW, Guido was never sold on the merits of having a peephole optimizer and the tool spent much of its life on the verge of being ripped-out.  To accommodate his wishes and our design instincts, we agreed at the outset to keep this "dirt simple".  (Put another way, for over a decade every developer who looked at this resisted going down this obvious line of development).

That said, I'll leave it to Tim to decide.  He helped talked Guido into letting me add this and he is the one who first proposed setting tight limits on how far we would go.

(One last thought, be sure to coordinate with Serhiy who is actively transferring responsibilities upstream to the AST level manipulations so they can be analyzed at a higher level.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:58:30 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 19:58:30 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560628710.01.0.236947958255.issue37294@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

The use case is weird.
I don't think we need to do something with the issue.

----------
nosy: +gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 15:58:59 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 15 Jun 2019 19:58:59 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560628739.88.0.606108946739.issue37294@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 16:49:08 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 15 Jun 2019 20:49:08 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560631748.34.0.877129876584.issue37271@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I afraid that the time of the peephole optimization is nothing in comparison with the cost of deduplicating constants in compile.c.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 16:56:13 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 15 Jun 2019 20:56:13 +0000
Subject: [issue37294] ProcessPoolExecutor fails with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560632173.11.0.60138346228.issue37294@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Andrew Svetlov

Well this was just an example for illustrating the issue. In real code I need this to create `ThreadPoolMixin` and `ProcessPoolMixin` classes (similar to the `socketserver.ThreadingMixIn` and `socketserver.ForkingMixIn` classes in the standard library, but using a thread/process pool with a fixed size instead of creating a new thread/process per request) for mixing with my server classes. But because of this `ProcessPoolExecutor` issue, I cannot use my `ProcessPoolMixin` class but only my `ThreadPoolMixin` currently.

The fact is one cannot submit a parent method call to a `ProcessPoolExecutor`.

This code snippet prints the exception raised by the call:

from concurrent.futures import ProcessPoolExecutor

class A:
    def f(self):
        print("called")

class B(A):
    def f(self):
        executor = ProcessPoolExecutor(max_workers=2)
        print(executor.submit(super().f).exception())

if __name__ == "__main__":
    B().f()

It prints this:

> [Errno 24] Too many open files
> None
> None
> None
> ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 17:11:32 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sat, 15 Jun 2019 21:11:32 +0000
Subject: [issue37271] Make multiple passes of the peephole optimizer until
 bytecode cannot be optimized further
In-Reply-To: <1560477510.59.0.491449903314.issue37271@roundup.psfhosted.org>
Message-ID: <1560633092.12.0.104709562114.issue37271@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
assignee:  -> tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37271>
_______________________________________

From report at bugs.python.org  Sat Jun 15 18:21:15 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sat, 15 Jun 2019 22:21:15 +0000
Subject: [issue37294] concurrent.futures.ProcessPoolExecutor and
 multiprocessing.pool.Pool fail with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560637275.58.0.89059030021.issue37294@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

And like the `concurrent.futures` module for `concurrent.futures.ProcessPoolExecutor` but not for `concurrent.futures.ThreadPoolExecutor` (see above), the `multiprocessing.pool` module seems also affected by a similar problem for `multiprocessing.pool.Pool` (process pools) but not for `multiprocessing.pool.ThreadPool` (thread pools).

Indeed the following code:

    import multiprocessing.pool
    
    class A:
        def f(self):
            print("called")
    
    class B(A):
        def f(self):
            pool = multiprocessing.pool.Pool(2)
            pool.apply(super().f)
    
    if __name__ == "__main__":
        B().f()

raises the following exception:

> AssertionError: daemonic processes are not allowed to have children

----------
title: ProcessPoolExecutor fails with super -> concurrent.futures.ProcessPoolExecutor and multiprocessing.pool.Pool fail with super

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sat Jun 15 19:22:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 15 Jun 2019 23:22:49 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560640969.61.0.222849520777.issue37289@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I don't understand if this issue is a recent regression or not. Python 3.7 has been modified, but the reporter only mentions Python 3.8.

I concur with Serhiy, a test is needed to prevent future regressions on this fix.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sat Jun 15 20:13:31 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 16 Jun 2019 00:13:31 +0000
Subject: [issue37260] shutil.rmtree() FileNotFoundError race condition
In-Reply-To: <1560388241.37.0.285109327745.issue37260@roundup.psfhosted.org>
Message-ID: <1560644011.14.0.752282887709.issue37260@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

The PR is ready for review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37260>
_______________________________________

From report at bugs.python.org  Sat Jun 15 20:38:45 2019
From: report at bugs.python.org (Tim Peters)
Date: Sun, 16 Jun 2019 00:38:45 +0000
Subject: [issue32846] Deletion of large sets of strings is extra slow
In-Reply-To: <1518654213.84.0.467229070634.issue32846@psf.upfronthosting.co.za>
Message-ID: <1560645525.41.0.64275156879.issue32846@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

Thanks, Terry!  Based on your latest results, "quadratic time" isn't plausible here anymore, so I'm closing this.  Nasty cache effects certainly played a role, but they were just a flea on the dog ;-)

----------
resolution:  -> fixed
stage: commit review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32846>
_______________________________________

From report at bugs.python.org  Sat Jun 15 21:40:57 2019
From: report at bugs.python.org (George Xie)
Date: Sun, 16 Jun 2019 01:40:57 +0000
Subject: [issue37297] function changed when pickle bound method object
Message-ID: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>


New submission from George Xie <georgexsh at gmail.com>:

if we create a bound method object `f` with function object `A.f` and instance object `B()`,
when pickling this bound method object:

	import pickle

	class A():
	    def f(self):
	        pass

	class B():
	    def f(self):
	        pass

	o = B()
	f = A.f.__get__(o)
	pf = pickle.loads(pickle.dumps(f))
	print(f)
	print(pf)

we get:

	<bound method A.f of <__main__.B object at 0x10b82ac18>>
	<bound method B.f of <__main__.B object at 0x10b82ac88>>

the underlaying function are lost, changed from `A.f` to `B.f`.

as pickle calls `__reduce__` method of `method object`, IMO [its implementation][1] simply ignored the real function, whcih is not right.

I have tried a [wordaround][2]:

	import types
	import copyreg

	def my_reduce(obj):
	    return (obj.__func__.__get__, (obj.__self__,))

	copyreg.pickle(types.MethodType, my_reduce)


[1]: https://github.com/python/cpython/blob/v3.7.3/Objects/classobject.c#L75-L89
[2]: https://stackoverflow.com/a/56614748/4201810

----------
components: Library (Lib)
messages: 345721
nosy: georgexsh
priority: normal
severity: normal
status: open
title: function changed when pickle bound method object
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Sat Jun 15 21:51:12 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 01:51:12 +0000
Subject: [issue37298] IDLE: Revise html to tkinker converter for help.html
Message-ID: <1560649872.44.0.457910225797.issue37298@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

Sphinx 2.? generates different html than 1.8 such that the display of  
Help ==> IDLE Help has extra blank lines. Among possibly other things, the contents of <li>...</li> is wrapped in <p>...</p> and blank lines appear between the bullet and text.
 
<ul class="simple">
-<li>coded in 100% pure Python, using the <a class="reference internal" href="tkinter.html#module-tkinter" title="tkinter: Interface to Tcl/Tk for graphical user interfaces"><code class="xref py py-mod docutils literal notranslate"><span class="pre">tkinter</span></code></a> GUI toolkit</li>
-<li>cross-platform: works mostly the same on Windows, Unix, and macOS</li>
...
+<li><p>coded in 100% pure Python, using the <a class="reference internal" href="tkinter.html#module-tkinter" title="tkinter: Interface to Tcl/Tk for graphical user interfaces"><code class="xref py py-mod docutils literal notranslate"><span class="pre">tkinter</span></code></a> GUI toolkit</p></li>
+<li><p>cross-platform: works mostly the same on Windows, Unix, and macOS</p></li>
...
 </ul>

A similar issue afflicts the menu, with blank lines between the menu item and the explanation.

The html original 3x/Doc/build/html/library/idle.html#index-0 looks normal in Firefox.  The html parser class in help.py needs to ignore <p> within <li>.  It should specify which version of Sphinx it is compatible with.

Do any of you have any idea what the html change might be about?  Is there something wrong with idle.rst?

----------
assignee: terry.reedy
components: IDLE
messages: 345722
nosy: cheryl.sabella, markroseman, mdk, terry.reedy
priority: normal
severity: normal
stage: needs patch
status: open
title: IDLE: Revise html to tkinker converter for help.html
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37298>
_______________________________________

From report at bugs.python.org  Sat Jun 15 22:22:30 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Sun, 16 Jun 2019 02:22:30 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
Message-ID: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>


New submission from YoSTEALTH <ritesh at stealthcentral.com>:

from asyncio import run


async def true():
    return True


async def false():
    return False


async def error():
    a = false()
    b = true()
    return await (a or b)
    # Good Error
    #   "RuntimeWarning: coroutine 'true' was never awaited print(await error())"


async def no_error():
    return await (false() or true())  # False
    # Bad Problem
    #   `RuntimeWarning` is not raised for 'true'.

    # Note
    #   The correct syntax is `return (await false()) or (await true()) as it should return `True`
    #   not `False`


async def test():
    print(await no_error())  # False
    print(await error())     # RuntimeWarning(...), False


if __name__ == '__main__':
    run(test())


- Tested in Python 3.8.0b1
- Why does `error()` return `RuntimeWarning` but `no_error()` does not?

----------
components: asyncio
messages: 345723
nosy: YoSTEALTH, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: RuntimeWarning is NOT raised
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Sat Jun 15 22:30:33 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 02:30:33 +0000
Subject: [issue37300] a Py_XINCREF in classobject.c are not necessary
Message-ID: <1560652233.24.0.743311547248.issue37300@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
components: Interpreter Core
nosy: shihai1991
priority: normal
severity: normal
status: open
title: a Py_XINCREF in classobject.c are not necessary
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37300>
_______________________________________

From report at bugs.python.org  Sat Jun 15 22:34:04 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 02:34:04 +0000
Subject: [issue37300] a Py_XINCREF in classobject.c are not necessary
Message-ID: <1560652444.61.0.474294719721.issue37300@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +13969
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14120

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37300>
_______________________________________

From report at bugs.python.org  Sat Jun 15 23:38:49 2019
From: report at bugs.python.org (vsbogd)
Date: Sun, 16 Jun 2019 03:38:49 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
Message-ID: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>


New submission from vsbogd <vsbogd at gmail.com>:

Steps to reproduce: Use POST request with "multipart/form-data" encoding to pass long (more than 64KiB) file to the CGI script.
Expected result: Script receives the whole file.
Actual result: Script receives only first part which size is about size of the TCP packet.

Scripts to test issue are attached. To run test execute:
$ python test_cgi_server.py &
$ python test_cgi_client.py 
$ kill %1

----------
components: Library (Lib)
files: test_cgi.zip
messages: 345724
nosy: vsbogd
priority: normal
severity: normal
status: open
title: CGIHTTPServer doesn't handle long POST requests
type: behavior
versions: Python 3.6
Added file: https://bugs.python.org/file48423/test_cgi.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Sat Jun 15 23:50:37 2019
From: report at bugs.python.org (vsbogd)
Date: Sun, 16 Jun 2019 03:50:37 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560657037.14.0.131884305953.issue37301@roundup.psfhosted.org>


vsbogd <vsbogd at gmail.com> added the comment:

Analysis:

self.rfile.read(nbytes)

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L1207

Doesn't read full content of the file but only first chunk because self.rfile is not BufferedIO instance. In fact it is SocketIO instance. The reason is that CGIHTTPServer sets rbufsize to 0:

    # Make rfile unbuffered -- we need to read one line and then pass
    # the rest to a subprocess, so we can't use buffered input.
    rbufsize = 0

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L975-L977

So the minimal fix is to set rbufsize back to -1 again. This fix requires one more change, because code below:

            # throw away additional data [see bug #427345]
            while select.select([self.rfile._sock], [], [], 0)[0]:
                if not self.rfile._sock.recv(1):
                    break

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L1210-L1213

expects self.rfile instance to be SocketIO. 

This could be fixed by replacing this code by:


So the minimal fix is to set rbufsize back to -1 again. This fix requires one more change, because code below:

            # throw away additional data [see bug #427345]
            while select.select([self.rfile], [], [], 0)[0]:
                if not self.rfile.read(1):
                    break

like it is implemented in another branch of the condition check:

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L1163-L1166

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Sun Jun 16 00:46:08 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sun, 16 Jun 2019 04:46:08 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
Message-ID: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>


New submission from Jeffrey Kintscher <websurfer at surf2c.net>:

Add an "onerror" callback parameter to the tempfile.TemporaryDirectory member functions so that the caller can perform special handling for directory items that it can't automatically delete. The caller created the undeletable directory entries, so it is reasonable to believe the caller may know how to unmake what they made.

This enhancement is needed to provide the desired behavior described in issue #29982 and issue #36422.

----------
messages: 345726
nosy: Jeffrey.Kintscher, giampaolo.rodola, gvanrossum, josh.r, max, paul.moore, riccardomurri, serhiy.storchaka, steve.dower, tarek, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Add an "onerror" callback parameter to the tempfile.TemporaryDirectory member functions

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Sun Jun 16 00:55:09 2019
From: report at bugs.python.org (Dong-hee Na)
Date: Sun, 16 Jun 2019 04:55:09 +0000
Subject: [issue37303] Rename parameter name of imghdr what
Message-ID: <1560660909.55.0.86099057914.issue37303@roundup.psfhosted.org>


New submission from Dong-hee Na <donghee.na92 at gmail.com>:

Still https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/imghdr.py#L11 signature is def what(file, h=None).

I 'd like to suggest to update it into def what(filename, h=None)
Also, the doc of imghdr represents it as the filename.
https://docs.python.org/3/library/imghdr.html

note that sndhdr is already using this name.
https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/sndhdr.py#L52

If this proposal is accepted, I'd like to send a patch for it.

----------
components: Library (Lib)
messages: 345727
nosy: corona10
priority: normal
severity: normal
status: open
title: Rename parameter name of imghdr what
type: enhancement
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37303>
_______________________________________

From report at bugs.python.org  Sun Jun 16 01:04:24 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 16 Jun 2019 05:04:24 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1560661464.32.0.0605699124655.issue37302@roundup.psfhosted.org>


Change by Guido van Rossum <guido at python.org>:


----------
nosy:  -gvanrossum

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Sun Jun 16 01:52:18 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 16 Jun 2019 05:52:18 +0000
Subject: [issue37303] Rename parameter name of imghdr what
In-Reply-To: <1560660909.55.0.86099057914.issue37303@roundup.psfhosted.org>
Message-ID: <1560664338.94.0.633120883469.issue37303@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

file can be a positional or keyword argument. Someone might be using it as a keyword argument and this would require a deprecation period before renaming could be done.

./python.exe
Python 3.9.0a0 (heads/master:7a68f8c28b, Jun 15 2019, 21:00:05)
[Clang 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import inspect, imghdr
>>> imghdr.what(file="README.rst")
>>> imghdr.what("README.rst")
>>> inspect.signature(imghdr.what).parameters['file'].kind.description
'positional or keyword'

----------
nosy: +xtreak
versions:  -Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37303>
_______________________________________

From report at bugs.python.org  Sun Jun 16 02:24:06 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 16 Jun 2019 06:24:06 +0000
Subject: [issue37303] Rename parameter name of imghdr what
In-Reply-To: <1560660909.55.0.86099057914.issue37303@roundup.psfhosted.org>
Message-ID: <1560666246.97.0.0158538719255.issue37303@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Inlike to sndhdr.what(), imghdr.what() accepts not only file names, by file objects theirself. The feature was added at 1997 in 45ac47c0b2798cc3a29cf5111694aba5e9347e08.

----------
nosy: +serhiy.storchaka
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37303>
_______________________________________

From report at bugs.python.org  Sun Jun 16 02:49:02 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 16 Jun 2019 06:49:02 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560667742.68.0.364769578251.issue35922@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:


New changeset 8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668 by Tal Einat (R?mi Lapeyre) in branch 'master':
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)
https://github.com/python/cpython/commit/8047e0e1c620f69cc21f9ca48b24bf2cdd5c3668


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 02:49:24 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 06:49:24 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560667764.77.0.660107391695.issue35922@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13970
pull_request: https://github.com/python/cpython/pull/14121

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 02:49:31 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 06:49:31 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560667771.69.0.813052994358.issue35922@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13971
pull_request: https://github.com/python/cpython/pull/14122

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 02:59:34 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 16 Jun 2019 06:59:34 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560668374.5.0.803230906803.issue37295@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Optimizations 2 and 3 look something like this:

    bc75 = [comb(75, r) for r in range(75//2+1)]
    bc150 = [comb(150, r) for r in range(150//2+1)]
    bc225 = [comb(225, r) for r in range(225//2+1)]

    def comb(n, k):
        if n < 0 or k < 0: raise ValueError
        if k > n: return 0
        k = min(k, n-k)
        if k > n // 3 and n < 100_000:
            return factorial(n) // (factorial(r) * factorial(n-r))
        if 75 <= n <= 75 + k:
            c, num, den, times = bc75[75-(n-k)], 75+1, 75-(n-k)+1, n-75
        elif 150 <= n <= 150 + k:
            c, num, den, times = bc150[150-(n-k)], 150+1, 150-(n-k)+1, n-150
        elif 225 <= n <= 225 + k:
            c, num, den, times = bc225[225-(n-k)], 225+1, 225-(n-k)+1, n-225
        else:
            c, num, den, times = 1, n-k+1, 1, k
        for i in range(times):
            c = c * num // den
            num += 1
            den += 1
        return c

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Sun Jun 16 03:07:58 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 07:07:58 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560668878.05.0.107317561261.issue35922@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 58a1a76baefc92d9e2392a5dbf65e39e44fb8f55 by Miss Islington (bot) in branch '3.8':
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)
https://github.com/python/cpython/commit/58a1a76baefc92d9e2392a5dbf65e39e44fb8f55


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 03:10:09 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 07:10:09 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560669009.46.0.0482702905622.issue35922@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 45d6547acfb9ae1639adbe03dd14f38cd0642ca2 by Miss Islington (bot) in branch '3.7':
bpo-35922: Fix RobotFileParser when robots.txt has no relevant crawl delay or request rate (GH-11791)
https://github.com/python/cpython/commit/45d6547acfb9ae1639adbe03dd14f38cd0642ca2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 03:14:52 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 16 Jun 2019 07:14:52 +0000
Subject: [issue35922] robotparser crawl_delay and request_rate do not work
 with no matching entry
In-Reply-To: <1549485183.59.0.634497522614.issue35922@roundup.psfhosted.org>
Message-ID: <1560669292.66.0.296404479963.issue35922@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

R?mi, thanks for the great work writing the PR and quickly going through several iterations of reviews and revisions!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35922>
_______________________________________

From report at bugs.python.org  Sun Jun 16 03:56:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 16 Jun 2019 07:56:57 +0000
Subject: [issue35647] Cookie path check returns incorrect results
In-Reply-To: <1560616667.37.0.332173267694.issue35647@roundup.psfhosted.org>
Message-ID: <CA+3bQGH5xcR+Czo2m-k6_xPX5AOKUfoVzwGHOC8Z9A5E0kwWfw@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

Well done Karthikeyan Singaravelan! I planned to review your 2.7 change,
but I didn't manage to find time for that. So thanks Serhiy for merging it!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35647>
_______________________________________

From report at bugs.python.org  Sun Jun 16 03:58:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sun, 16 Jun 2019 07:58:29 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1560616680.52.0.31790679103.issue35121@roundup.psfhosted.org>
Message-ID: <CA+3bQGH5zRxRvBqpwVnhSiF+QsC9sAvh6HszeW6Bkj_47fZc0A@mail.gmail.com>


STINNER Victor <vstinner at redhat.com> added the comment:

Again, well done Karthikeyan Singaravelan!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Sun Jun 16 04:02:30 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 08:02:30 +0000
Subject: [issue37300] a Py_XINCREF in classobject.c are not necessary
Message-ID: <1560672150.38.0.453600538086.issue37300@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

a Py_XINCREF in classobject.c are not necessary

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37300>
_______________________________________

From report at bugs.python.org  Sun Jun 16 05:34:30 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 16 Jun 2019 09:34:30 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560677670.92.0.262743129978.issue37297@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
nosy: +maggyero

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Sun Jun 16 05:36:41 2019
From: report at bugs.python.org (Christopher A. Chavez)
Date: Sun, 16 Jun 2019 09:36:41 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560677801.21.0.07954657142.issue34796@roundup.psfhosted.org>


Change by Christopher A. Chavez <chrischavez at gmx.us>:


----------
nosy: +chrstphrchvz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 05:46:23 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 09:46:23 +0000
Subject: [issue37304] compiler need support in(de)crement operation or all of
 it should have syntax error.
Message-ID: <1560678383.11.0.0486916958299.issue37304@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

compiler need support unary operation of in(de)crement or all of it should have syntax error.I have found many user have confused about it(such as:https://stackoverflow.com/questions/2632677/python-integer-incrementing-with). Of course, it is a big change of grammar and it need core developer team to make decision.

If core developer team support it, i will try my best to do it;)

The behavior is:

$ ./python
Python 3.8.0a4+ (heads/master:e225beb, Jun  4 2019, 00:35:07)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-36)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> i = 1;
>>> ++i
1
>>> i++
  File "<stdin>", line 1
    i++
      ^
SyntaxError: invalid syntax

----------
components: Interpreter Core
messages: 345738
nosy: shihai1991
priority: normal
severity: normal
status: open
title: compiler need support in(de)crement operation or all of it should have syntax error.
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37304>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:14:06 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 10:14:06 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1560680046.32.0.0913465349075.issue35431@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13972
pull_request: https://github.com/python/cpython/pull/14125

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:20:41 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 16 Jun 2019 10:20:41 +0000
Subject: [issue37304] compiler need support in(de)crement operation or all of
 it should have syntax error.
In-Reply-To: <1560678383.11.0.0486916958299.issue37304@roundup.psfhosted.org>
Message-ID: <1560680441.07.0.898864811324.issue37304@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

For the reasons already discussed on the Stackoverflow link you gave, Python does not have pre- and post-increment and -decrement operators, and probably never will.

I'm closing this ticket as Won't Fix, but if you wish to discuss it further, you can raise it on Python-Ideas for community feedback. If there is significant interest, you can then write a PEP for it, and if the PEP is approved, then you can re-open this ticket and provide a PR or patch.


https://mail.python.org/mailman3/lists/python-ideas.python.org/

https://www.python.org/dev/peps/

----------
nosy: +steven.daprano
resolution:  -> wont fix
stage:  -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37304>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:28:00 2019
From: report at bugs.python.org (shajianrui)
Date: Sun, 16 Jun 2019 10:28:00 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560680880.71.0.641198769762.issue37301@roundup.psfhosted.org>


shajianrui <shajianrui at 126.com> added the comment:

I have the same problem, and use a similar walk-around:
1. I set the rbufsize to -1
2. I use self.connection.recv instead of self.rfile.read(), like this:
    while select.select([self.connection], [], [], 0)[0]:
        if not self.connection.recv(1):

However, when I go through the code, I find that at line 967 in server.py(I am using python 3.7), there is a comment:
    # Make rfile unbuffered -- we need to read one line and then pass
    # the rest to a subprocess, so we can't use buffered input.
    rbufsize = 0

Seems for some reasons the author set rfile unbuffered, and I know nothing about it.

If you know much about it, please give me some hints, thank you.

----------
nosy: +shajianrui

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:41:01 2019
From: report at bugs.python.org (=?utf-8?q?Filip_=C5=A0?=)
Date: Sun, 16 Jun 2019 10:41:01 +0000
Subject: [issue37305] Add MIME type for Web App Manifest
Message-ID: <1560681661.87.0.393263592015.issue37305@roundup.psfhosted.org>


New submission from Filip ? <filip.stamcar at hotmail.com>:

Web App Manifest ( https://w3c.github.io/manifest/ ) is "JSON-based manifest file that provides developers with a centralized place to put metadata associated with a web application".

Although it is not required, it is recommended by W3C ( https://w3c.github.io/manifest/#media-type-registration ) that manifest uses `application/manifest+json` media type and `.webmanifest` extension.

This should also be used by Python's mimetypes module.


I can submit PR for this, but I don't know if it should be added to `types_map` or `common_types`. It is currently not registered with IANA, but it is "for community review and will be submitted to the IESG for review, approval, and registration with IANA".

If it is not strictly needed for MIME type that it is registered with IANA, I will add it to `types_map`. If it is, I will add it `common_types` and later move it to `types_map` when it will be registered. What should I choose?

----------
messages: 345741
nosy: filips123
priority: normal
severity: normal
status: open
title: Add MIME type for Web App Manifest
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37305>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:42:36 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 16 Jun 2019 10:42:36 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560681756.08.0.135888212204.issue37301@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
nosy: +georg.brandl

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Sun Jun 16 06:51:50 2019
From: report at bugs.python.org (Alejandro Gonzalez)
Date: Sun, 16 Jun 2019 10:51:50 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560682310.42.0.376610198049.issue28869@roundup.psfhosted.org>


Change by Alejandro Gonzalez <alejandrojgt at gmail.com>:


----------
keywords: +patch
pull_requests: +13973
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14126

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Sun Jun 16 07:08:35 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 11:08:35 +0000
Subject: [issue37304] compiler need support in(de)crement operation or all of
 it should have syntax error.
In-Reply-To: <1560678383.11.0.0486916958299.issue37304@roundup.psfhosted.org>
Message-ID: <1560683315.52.0.0973466192438.issue37304@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Thank for your suggestion,Steven. If python can not support post-increment and -decrement operators now, i think ++i should raise syntax error as i++.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37304>
_______________________________________

From report at bugs.python.org  Sun Jun 16 07:43:42 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 16 Jun 2019 11:43:42 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1560685422.41.0.80785401951.issue37289@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +13974
pull_request: https://github.com/python/cpython/pull/14127

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Sun Jun 16 07:56:02 2019
From: report at bugs.python.org (flipchan)
Date: Sun, 16 Jun 2019 11:56:02 +0000
Subject: [issue37306] "~/" not working with open() function in posix systems
Message-ID: <1560686162.92.0.88188278628.issue37306@roundup.psfhosted.org>


New submission from flipchan <flipchan at riseup.net>:

"~/" being a shortcut to the current home directory on posix systems(bsd/linux).
its not working with the build in open() function open:

It works to get the path as a string:
    with open(str(Path.home())+'/.hey', wb') as minfil:                                                       
        minfil.write(nycklen)
        
But not out of the box:        
    with open('~/.hey', 'wb') as minfil:
        minfil.write(nycklen)          
 
        
   
However, "~/" is working with os.path modules:   
     os.path.isfile("~/.hey")


Tested with Python 3.6.8

----------
components: Library (Lib)
messages: 345743
nosy: flipchan
priority: normal
severity: normal
status: open
title: "~/" not working with open() function in posix systems
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37306>
_______________________________________

From report at bugs.python.org  Sun Jun 16 07:59:07 2019
From: report at bugs.python.org (Franklin? Lee)
Date: Sun, 16 Jun 2019 11:59:07 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
Message-ID: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>


New submission from Franklin? Lee <leewangzhong at gmail.com>:

isinstance:
> If classinfo is not a class (type object), it may be a tuple of type objects, or may recursively contain other such tuples (other sequence types are not accepted).

issubclass:
> classinfo may be a tuple of class objects, in which case every entry in classinfo will be checked.

It is unclear from the docs whether
    issubclass(bool, (int, float))
should return True (because bool is a subclass of int),
or False (because bool is NOT a subclass of float).
(It returns True.)

It's likely also false that every entry will be checked, since presumably the function uses short-circuit logic.

issubclass's doc also doesn't mention the recursive tuple case that isinstance's doc has.

----------
assignee: docs at python
components: Documentation
messages: 345744
nosy: docs at python, leewz
priority: normal
severity: normal
status: open
title: isinstance/issubclass doc isn't clear on whether it's an AND or an OR.
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:09:26 2019
From: report at bugs.python.org (flipchan)
Date: Sun, 16 Jun 2019 12:09:26 +0000
Subject: [issue37306] "~/" not working with open() function in posix systems
In-Reply-To: <1560686162.92.0.88188278628.issue37306@roundup.psfhosted.org>
Message-ID: <1560686966.39.0.31474370569.issue37306@roundup.psfhosted.org>


flipchan <flipchan at riseup.net> added the comment:

scratch """
However, "~/" is working with os.path modules:   
     os.path.isfile("~/.hey")

"""
that's not working either

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37306>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:13:45 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 16 Jun 2019 12:13:45 +0000
Subject: [issue37306] "~/" not working with open() function in posix systems
In-Reply-To: <1560686162.92.0.88188278628.issue37306@roundup.psfhosted.org>
Message-ID: <1560687225.64.0.534277289935.issue37306@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

Yes, '~' is not working out of the box and never had. You need to use os.path.expanduser or pathllib.Path.expanduser to get the useable path.

----------
nosy: +SilentGhost
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37306>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:23:06 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 16 Jun 2019 12:23:06 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560687786.85.0.072213613968.issue37307@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

Where are you seeing the text you've quoted for isinstance? You've marked as all versions affected, but for the master docs the text for isinstance is different and is unambiguous re treatment of tuple classinfo.

I agree with all your points about issubclass

----------
nosy: +SilentGhost

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:24:53 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 16 Jun 2019 12:24:53 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560687893.56.0.44192817913.issue37307@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

> It's likely also false that every entry will be checked, since presumably the function uses short-circuit logic.

This, however, would be good to verify first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:29:23 2019
From: report at bugs.python.org (Franklin? Lee)
Date: Sun, 16 Jun 2019 12:29:23 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560688163.72.0.10840203127.issue37307@roundup.psfhosted.org>


Franklin? Lee <leewangzhong at gmail.com> added the comment:

My mistake. I selected all versions after checking issubclass for 2.7 and several 3.x, but added the isinstance notes later without paying attention to versions.

I copied the isinstance text from 3.2 docs. As you said, it's not the current text.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:32:03 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 16 Jun 2019 12:32:03 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560688323.49.0.318193890227.issue37307@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

docstring for issubclass is a bit clear on the behavior


issubclass(cls, class_or_tuple, /)
    Return whether 'cls' is a derived from another class or is the same class.

    A tuple, as in ``issubclass(x, (A, B, ...))``, may be given as the target to
    check against. This is equivalent to ``issubclass(x, A) or issubclass(x, B)
    or ...`` etc.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:34:32 2019
From: report at bugs.python.org (Franklin? Lee)
Date: Sun, 16 Jun 2019 12:34:32 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560688472.35.0.804002903903.issue37307@roundup.psfhosted.org>


Franklin? Lee <leewangzhong at gmail.com> added the comment:

> > It's likely also false that every entry will be checked, since presumably the function uses short-circuit logic.

> This, however, would be good to verify first.

Verified.
https://github.com/python/cpython/blob/36dcaab7fde5d2e54cdeff5b705b5adcb27726dd/Objects/abstract.c#L2517

It loops through the tuple until it finds success or error.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:37:45 2019
From: report at bugs.python.org (SilentGhost)
Date: Sun, 16 Jun 2019 12:37:45 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1560688665.82.0.3931981019.issue37307@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

It's the same behaviour as for isinstance, could be enough to add "classinfo is treated as in isinstance call" to avoid duplication. This would also solve short-cutting imprecision.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Sun Jun 16 08:40:50 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 16 Jun 2019 12:40:50 +0000
Subject: [issue37306] "~/" not working with open() function in posix systems
In-Reply-To: <1560686162.92.0.88188278628.issue37306@roundup.psfhosted.org>
Message-ID: <1560688850.09.0.938387754006.issue37306@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Support for "~" isn't strictly part of the POSIX file system standard, it is a *shell* shortcut. As far as the file system is concerned, "~" is just a regular character like any other.

----------
nosy: +steven.daprano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37306>
_______________________________________

From report at bugs.python.org  Sun Jun 16 09:07:18 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Sun, 16 Jun 2019 13:07:18 +0000
Subject: [issue37304] compiler need support in(de)crement operation or all of
 it should have syntax error.
In-Reply-To: <1560678383.11.0.0486916958299.issue37304@roundup.psfhosted.org>
Message-ID: <1560690438.78.0.350331832721.issue37304@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Since ++i already has a meaning, it won't become a syntax error without an extremely good reason, and I don't think this case meets that standard.

But as Steven says, if you want to pursue it, you should start with a discussion on python-ideas.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37304>
_______________________________________

From report at bugs.python.org  Sun Jun 16 09:47:43 2019
From: report at bugs.python.org (Caleb Hattingh)
Date: Sun, 16 Jun 2019 13:47:43 +0000
Subject: [issue34831] Asyncio Tutorial
In-Reply-To: <1538134577.09.0.545547206417.issue34831@psf.upfronthosting.co.za>
Message-ID: <1560692863.59.0.800401052014.issue34831@roundup.psfhosted.org>


Caleb Hattingh <caleb.hattingh at gmail.com> added the comment:

FYI I'm going to be using the 3rd-party prompt-toolkit for the chat client. (The server depends only on asyncio only).  I put several hours research into finding a way for the CLI chat client to be not terrible, but it gets very complicated trying to manage stdin and stdout with asyncio.  OTOH prompt-toolkit just gives us exactly what we need, and the code looks short, neat and easy to understand. I hope that's ok (that I'll be mentioning a 3rd party lib in the tutorial).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34831>
_______________________________________

From report at bugs.python.org  Sun Jun 16 10:15:29 2019
From: report at bugs.python.org (Marco Sulla)
Date: Sun, 16 Jun 2019 14:15:29 +0000
Subject: [issue36964] `python3 -m venv NAME`: virtualenv is not portable
In-Reply-To: <1558267639.25.0.0700835222258.issue36964@roundup.psfhosted.org>
Message-ID: <1560694529.45.0.112006196876.issue36964@roundup.psfhosted.org>


Marco Sulla <launchpad.net at marco.sulla.e4ward.com> added the comment:

> I don't like the idea of changing what VIRTUAL_ENV gets set to when I 
> believe you should recreate the virtual environment as necessary and 
> risk surprising people who expect VIRTUAL_ENV to function as it does 
> today and has for years.

(Talking to the wind) Well, didn't you have software tests?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36964>
_______________________________________

From report at bugs.python.org  Sun Jun 16 10:55:17 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 14:55:17 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560696917.34.0.233431340931.issue34796@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Ned, is the version of tcl/tk on Mac the same in 3.8.0b1 and upcoming 3.7.4 as it was last September?  (8.6.8 in 3.7.3, not sure in Sept.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 11:10:51 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 16 Jun 2019 15:10:51 +0000
Subject: [issue36429] Fix starting IDLE with pyshell
In-Reply-To: <1553569758.24.0.333404497739.issue36429@roundup.psfhosted.org>
Message-ID: <1560697851.69.0.235840340084.issue36429@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Terry, it looks like you merged a fix for this. Should this be closed?

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36429>
_______________________________________

From report at bugs.python.org  Sun Jun 16 11:15:35 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 16 Jun 2019 15:15:35 +0000
Subject: [issue37304] compiler need support in(de)crement operation or all of
 it should have syntax error.
In-Reply-To: <1560678383.11.0.0486916958299.issue37304@roundup.psfhosted.org>
Message-ID: <1560698135.43.0.94746671628.issue37304@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

got it, Eric

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37304>
_______________________________________

From report at bugs.python.org  Sun Jun 16 11:50:30 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 16 Jun 2019 15:50:30 +0000
Subject: [issue34831] Asyncio Tutorial
In-Reply-To: <1538134577.09.0.545547206417.issue34831@psf.upfronthosting.co.za>
Message-ID: <1560700230.64.0.833965405637.issue34831@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy:  -ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34831>
_______________________________________

From report at bugs.python.org  Sun Jun 16 12:30:48 2019
From: report at bugs.python.org (Aymeric Augustin)
Date: Sun, 16 Jun 2019 16:30:48 +0000
Subject: [issue34506] Traceback logged when SSL handshake fails
In-Reply-To: <1535269470.94.0.56676864532.issue34506@psf.upfronthosting.co.za>
Message-ID: <1560702648.82.0.973020324304.issue34506@roundup.psfhosted.org>


Aymeric Augustin <aymeric.augustin at m4x.org> added the comment:

The same issue was reported in the bug tracker for websockets: https://github.com/aaugustin/websockets/issues/614

----------
nosy: +aymeric.augustin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34506>
_______________________________________

From report at bugs.python.org  Sun Jun 16 12:44:20 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Sun, 16 Jun 2019 16:44:20 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560703460.75.0.718470697393.issue37295@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

(1), (4) and (5) sound good to me.

For (1), it might make sense to ignore the 32-bit vs. 64-bit distinction and use `uint64_t` for the internal computations. Then we can do up to n = 62 regardless of platform.

(2) feels like too much extra complication to me, but that would become clearer with an implementation.

For (3), I somewhat agree that the factorial method should be avoided.

For (4), I don't see how/when the GIL could be released: doesn't the algorithm involve lots of memory allocations/deallocations and reference count adjustments?

Can the suggested performance improvements go into 3.8, or should they wait for 3.9? It's not clear to me whether a performance improvement after feature freeze is okay or not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Sun Jun 16 13:03:26 2019
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 16 Jun 2019 17:03:26 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560704606.76.0.859004453554.issue28805@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 5600b5e1b24a3491e83f1b3038a7ea047a34c0bf by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-28805: document METH_FASTCALL (GH-14079)
https://github.com/python/cpython/commit/5600b5e1b24a3491e83f1b3038a7ea047a34c0bf


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Sun Jun 16 13:23:58 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 16 Jun 2019 17:23:58 +0000
Subject: [issue37308] Possible mojibake in mmap.mmap() when using the tagname
 parameter on Windows
Message-ID: <1560705838.82.0.210132642555.issue37308@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

mmap.mmap() passes a char * encoded as UTF-8 to CreateFileMappingA() when the tagname parameter is used.

This was reported by Eryk Sun on PR 14114.

----------
components: Extension Modules, Windows
messages: 345763
nosy: ZackerySpytz, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Possible mojibake in mmap.mmap() when using the tagname parameter on Windows
type: behavior
versions: Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37308>
_______________________________________

From report at bugs.python.org  Sun Jun 16 13:30:55 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 16 Jun 2019 17:30:55 +0000
Subject: [issue37308] Possible mojibake in mmap.mmap() when using the tagname
 parameter on Windows
In-Reply-To: <1560705838.82.0.210132642555.issue37308@roundup.psfhosted.org>
Message-ID: <1560706255.23.0.0769209632232.issue37308@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13975
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14133

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37308>
_______________________________________

From report at bugs.python.org  Sun Jun 16 14:42:03 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 16 Jun 2019 18:42:03 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560710523.15.0.771568262918.issue34796@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As far as I recall, we have only ever shipped 8.6.8 in final releases since we started providing a built-in Tcl/Tk in the python.org macOS installers as of 3.7.0, 3.6.8, and 2.7.16 (https://www.python.org/download/mac/tcltk/).  There was the disastrous attempt to update to 8.6.9+ during the 3.7.2rc phase which we ultimately reverted prior to 3.7.2 final, as documented in Issue35485.  Since then, there do not seem to have been any official releases of 8.6.9 so we remain with 8.6.8.  It would probably be a good thing for someone to work with the Tk folks on seeing whether the problems seen are being resolved but it's not something I expect to have time for in the foreseeable future.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 14:46:14 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 16 Jun 2019 18:46:14 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560710774.77.0.864757417772.issue34796@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> Since then, there do not seem to have been any official releases of 8.6.9 so we remain with 8.6.8

That is: there have been no official releases of Tk past 8.6.9.1 which was tried, along with the then current HEAD of the 8.6 maintenance branch, back in December.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 14:53:08 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 16 Jun 2019 18:53:08 +0000
Subject: [issue34506] Traceback logged when SSL handshake fails
In-Reply-To: <1535269470.94.0.56676864532.issue34506@psf.upfronthosting.co.za>
Message-ID: <1560711188.54.0.131185221748.issue34506@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
components: +asyncio
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34506>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:07:44 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 19:07:44 +0000
Subject: [issue36429] Fix starting IDLE with pyshell
In-Reply-To: <1553569758.24.0.333404497739.issue36429@roundup.psfhosted.org>
Message-ID: <1560712064.91.0.717530742329.issue36429@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36429>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:09:00 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 19:09:00 +0000
Subject: [issue36429] Fix starting IDLE with pyshell
In-Reply-To: <1553569758.24.0.333404497739.issue36429@roundup.psfhosted.org>
Message-ID: <1560712140.26.0.800809820239.issue36429@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Yep.  I changes the headers but must have neglected to hit [Submit Changes].

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36429>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:14:44 2019
From: report at bugs.python.org (Christopher A. Chavez)
Date: Sun, 16 Jun 2019 19:14:44 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560712484.94.0.959535473289.issue34796@roundup.psfhosted.org>


Christopher A. Chavez <chrischavez at gmx.us> added the comment:

I have not successfully reproduced the issue here with tkinter 3.7.3 using 8.6.9.1 or recent core-8-6-branch on macOS Mojave.

I understand the reporter of this issue believed this was not an upstream Tk issue. However there's a recently opened upstream ticket relating to scrollbars on Aqua which may be of interest: 
https://core.tcl-lang.org/tk/info/8476b757811b3694

At the moment, one of the Tk Aqua developers appears to advise against using the normal (non-Ttk) scrollbar at all on macOS because it has never worked properly and likely will not be fixed, and instead suggests using the new Ttk scrollbar implementation, which should be available in 8.6.10.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:20:38 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 16 Jun 2019 19:20:38 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560712838.57.0.238318980843.issue34796@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As far as I recall, the scrollbar issue did seem to be fixed in 8.6.9.1 so that was one plus for updating.  But, as described in Issue35485, updating introduced other, far more serious new problems so we decided to revert to 8.6.8 and wait for a new official release.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:21:51 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 19:21:51 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560712911.04.0.867343489779.issue34796@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

This should probably be closed as 3rd party, but someone needs to verify that the bug is in tk.  In the meanwhile, let it sit.

Vlad's test works perfectly on Windows with 8.6.9.  In multiple tries, mouse at (x, Y <= 16) is top arrow, (x, y >= 17) is slider.

----------
nosy:  -ronaldoussoren
stage: needs patch -> test needed
versions: +Python 3.9 -Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:33:41 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 16 Jun 2019 19:33:41 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560713621.86.0.63063182753.issue28869@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Getting the module name from the caller's frame is an expensive operation. It is safe to set __module__ to None. In such case the pickle module is able to find the proper module containing the definition of the class.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:34:17 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 19:34:17 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560713657.1.0.831771138176.issue34796@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Christopher, I submitted before seeing your message.  Thank you for the additional info, which verifies that this is an upstream issue.  Apparently, the current ttk.Scrollbar on the 8.6.8 we currently deliver should sort of work.

----------
resolution:  -> third party
stage: test needed -> resolved
status: open -> closed
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:37:09 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 16 Jun 2019 19:37:09 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560713829.5.0.677405601178.issue28869@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

>>> from abc import *
>>> A = ABCMeta('A', (), {})
>>> A.__module__
'abc'
>>> import pickle, pickletools
>>> pickletools.dis(pickletools.optimize(pickle.dumps(A)))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
_pickle.PicklingError: Can't pickle <class 'abc.A'>: attribute lookup A on abc failed
>>> A.__module__ = None
>>> pickletools.dis(pickletools.optimize(pickle.dumps(A)))
    0: \x80 PROTO      4
    2: \x95 FRAME      15
   11: \x8c SHORT_BINUNICODE '__main__'
   21: \x8c SHORT_BINUNICODE 'A'
   24: \x93 STACK_GLOBAL
   25: .    STOP
highest protocol among opcodes = 4

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Sun Jun 16 15:45:42 2019
From: report at bugs.python.org (Christopher A. Chavez)
Date: Sun, 16 Jun 2019 19:45:42 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560714342.73.0.810506531099.issue34796@roundup.psfhosted.org>


Christopher A. Chavez <chrischavez at gmx.us> added the comment:

> Apparently, the current ttk.Scrollbar on the 8.6.8 we currently deliver should sort of work.

I'm not sure if that is the case, though I have not tested with 8.6.8 (I do not currently have access to High Sierra or earlier). Based on a comment by the developer (Marc Culler) in https://core.tcl-lang.org/tk/tktview?name=0d63621b6c it sounds like the Ttk scrollbar is a completely new implementation for 8.6.10, whereas before (8.6.9.1? 8.6.8?) any code requesting a Ttk scrollbar on Aqua normally got a non-Ttk scrollbar instead.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:05:39 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 16 Jun 2019 20:05:39 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560715539.84.0.468461100921.issue37297@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
nosy: +brett.cannon, pitrou, rhettinger, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:14:13 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 20:14:13 +0000
Subject: [issue34796] Tkinter scrollbar issues on Mac.
In-Reply-To: <1537834124.67.0.545547206417.issue34796@psf.upfronthosting.co.za>
Message-ID: <1560716053.89.0.836140344806.issue34796@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

IDLE currently uses whatever 'ttk.Scrollbar' is. Unlike Windows, there are no top and bottom arrows, but this is also true with Safari, so I presume normal.

"Clicking trough near slider has no effect".  True for large file and small slider, not for medium file with large slider.

"Clicking top of slider treated as clicking on trough above slider.  True for about top 2 mm of the slider, when click and hold does not grab the slider.  If the slider is not at the top, it moves up.

So ttk slider becomes less useful as the file gets large, and only half usable at about 3000 lines and up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34796>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:19:33 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sun, 16 Jun 2019 20:19:33 +0000
Subject: [issue37300] a Py_XINCREF in classobject.c are not necessary
In-Reply-To: <1560672150.38.0.453600538086.issue37300@roundup.psfhosted.org>
Message-ID: <1560716373.54.0.403214361555.issue37300@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset c83356cae2e375324ff4a3fb5d574ebde5c827a9 by Benjamin Peterson (Hai Shi) in branch 'master':
closes bpo-37300: Remove unnecessary Py_XINCREF in classobject.c. (GH-14120)
https://github.com/python/cpython/commit/c83356cae2e375324ff4a3fb5d574ebde5c827a9


----------
nosy: +benjamin.peterson
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37300>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:20:16 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 16 Jun 2019 20:20:16 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560716416.43.0.229386793536.issue37297@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

As you stated on Stackoverflow, the fact that the function `A.f` becomes the function `B.f` after a pickling-unpickling sequence creates an infinite recursive call of `B.f` in worker processes started with `multiprocessing.pool.Pool().apply(super().f)` or `concurrent.futures.ProcessPoolExecutor().submit(super().f)` in `B.f` where B is a subclass of A. This infinite recursion has crashed my laptop several times today, so it looks like it is a rather critical issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:31:45 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 16 Jun 2019 20:31:45 +0000
Subject: [issue37294] concurrent.futures.ProcessPoolExecutor and
 multiprocessing.pool.Pool fail with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1560717105.86.0.176621951864.issue37294@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

George Xie found the root cause of this issue (a bug in the function method_reduce in cpython/Objects/classobject.c):

https://stackoverflow.com/questions/56609847/why-do-concurrent-futures-processpoolexecutor-and-multiprocessing-pool-pool-fail/56614748#56614748

and he filed the specific bug here:

https://bugs.python.org/issue37297

The issue looks serious as it creates an infinite recursion that crashed my laptop several times today.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:34:13 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 20:34:13 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560717253.05.0.99058032389.issue37220@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
keywords: +patch
pull_requests: +13976
pull_request: https://github.com/python/cpython/pull/14134

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:34:16 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 20:34:16 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560717256.73.0.618956088815.issue37220@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 66d47da86aff15be34adbec02596bb3188684c0d by Terry Jan Reedy in branch 'master':
bpo-37220: Fix 2.7 test -R crash on Windows. (GH-13957)
https://github.com/python/cpython/commit/66d47da86aff15be34adbec02596bb3188684c0d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:40:18 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 20:40:18 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560717618.55.0.641722760631.issue37220@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13977
pull_request: https://github.com/python/cpython/pull/14135

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 16:52:35 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 20:52:35 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560718355.03.0.678977890715.issue37220@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0c45aee8036a27fb76d6d8d4bac61c3715aec22d by Miss Islington (bot) in branch '3.7':
bpo-37220: Fix 2.7 test -R crash on Windows. (GH-13957)
https://github.com/python/cpython/commit/0c45aee8036a27fb76d6d8d4bac61c3715aec22d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:10:52 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 21:10:52 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560719452.62.0.924203826008.issue37220@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2acaf496b71224ff6d170ea12b0876d65195be7b by Miss Islington (bot) in branch '3.8':
bpo-37220: Fix 2.7 test -R crash on Windows. (GH-13957)
https://github.com/python/cpython/commit/2acaf496b71224ff6d170ea12b0876d65195be7b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:23:22 2019
From: report at bugs.python.org (Gil Forcada Codinachs)
Date: Sun, 16 Jun 2019 21:23:22 +0000
Subject: [issue9267] Update pickle opcode documentation in pickletools for 3.x
In-Reply-To: <1279217581.88.0.294098163632.issue9267@psf.upfronthosting.co.za>
Message-ID: <1560720202.5.0.382551649293.issue9267@roundup.psfhosted.org>


Gil Forcada Codinachs <gil.gnome at gmail.com> added the comment:

pickletools documentation is here:

https://docs.python.org/3/library/pickletools.html#module-pickletools

Sources are here:

https://github.com/python/cpython/blob/master/Doc/library/pickletools.rst

----------
nosy: +gforcada

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9267>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:31:17 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 21:31:17 +0000
Subject: [issue37220] test_idle crash on Windows 2.7 when run with -R:
In-Reply-To: <1560206989.94.0.836960275888.issue37220@roundup.psfhosted.org>
Message-ID: <1560720677.5.0.408907445417.issue37220@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords:  -patch
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37220>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:36:36 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 21:36:36 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560720996.99.0.220580683071.issue37039@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:42:05 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Sun, 16 Jun 2019 21:42:05 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1560721325.84.0.0820308695402.issue35224@roundup.psfhosted.org>


J?rn Heissler <launchpad at joern.heissler.de> added the comment:

Hello,

https://www.python.org/dev/peps/pep-0572/#change-to-evaluation-order mentions a change of evaluation order for dict comprehensions. It looks like this is not implemented yet (as of commit 66d47da8).

Will this be implemented in this issue, or should I create a new one?

Thanks

----------
nosy: +joernheissler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 16 17:54:05 2019
From: report at bugs.python.org (Gil Forcada Codinachs)
Date: Sun, 16 Jun 2019 21:54:05 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1560722045.84.0.557877168257.issue19696@roundup.psfhosted.org>


Gil Forcada Codinachs <gil.gnome at gmail.com> added the comment:

At least test_namespace_pkgs is already moved, see https://bugs.python.org/issue21097

Should then this issue be closed?

I see that there are a few other tests that have import on its name and are outside either test_import or test_importlib:

- test_pkgimport.py
- test_threaded_import.py
- test_zipimport.py
- test_zipimport_support.py
- threaded_import_hangers.py

Should those be actually moved to test_importlib?

----------
nosy: +gforcada

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Sun Jun 16 18:09:34 2019
From: report at bugs.python.org (=?utf-8?q?Bo=C5=A1tjan_Mejak?=)
Date: Sun, 16 Jun 2019 22:09:34 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560722974.1.0.6636725429.issue37295@roundup.psfhosted.org>


Bo?tjan Mejak <bostjan.xperia at gmail.com> added the comment:

Performance improvements is what a beta build exists for in the first place.

----------
nosy: +PedanticHacker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Sun Jun 16 18:22:01 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 22:22:01 +0000
Subject: [issue37309] idlelib/NEWS.txt for 3.9.0 and backports
Message-ID: <1560723721.58.0.865881864361.issue37309@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

Master is 3.9.0a0 as of 2019 June 4.

----------
assignee: terry.reedy
components: IDLE
messages: 345785
nosy: terry.reedy
priority: normal
severity: normal
stage: commit review
status: open
title: idlelib/NEWS.txt for 3.9.0 and backports
type: enhancement
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37309>
_______________________________________

From report at bugs.python.org  Sun Jun 16 18:24:02 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 22:24:02 +0000
Subject: [issue34162] idlelib/NEWS.txt for 3.8.0 (and backports)
In-Reply-To: <1532067299.29.0.56676864532.issue34162@psf.upfronthosting.co.za>
Message-ID: <1560723842.9.0.00492714470953.issue34162@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Master became 3.9.0a0 as of 2019 June 4.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
superseder:  -> idlelib/NEWS.txt for 3.9.0 and backports

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34162>
_______________________________________

From report at bugs.python.org  Sun Jun 16 18:46:11 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 22:46:11 +0000
Subject: [issue37309] idlelib/NEWS.txt for 3.9.0 and backports
In-Reply-To: <1560723721.58.0.865881864361.issue37309@roundup.psfhosted.org>
Message-ID: <1560725171.56.0.204775445575.issue37309@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

However, this starts with first merge that does not go in 3.8.0, which will be after 3.8.0c1.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37309>
_______________________________________

From report at bugs.python.org  Sun Jun 16 18:53:19 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sun, 16 Jun 2019 22:53:19 +0000
Subject: [issue34162] idlelib/NEWS.txt for 3.8.0 (and backports)
In-Reply-To: <1532067299.29.0.56676864532.issue34162@psf.upfronthosting.co.za>
Message-ID: <1560725599.72.0.593038773301.issue34162@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Closed prematurely.  This continues until last IDLE addition to 3.8.0

----------
resolution: fixed -> 
stage: resolved -> commit review
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34162>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:18:39 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 23:18:39 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560727119.03.0.658924407045.issue28805@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13978
pull_request: https://github.com/python/cpython/pull/14136

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:18:57 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 23:18:57 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560727137.38.0.962835389678.issue28805@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13979
pull_request: https://github.com/python/cpython/pull/14137

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:24:10 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 23:24:10 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560727450.69.0.722865012859.issue28805@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b101fa7783615051a89500e488708b955eac94c5 by Miss Islington (bot) in branch '3.7':
bpo-28805: document METH_FASTCALL (GH-14079)
https://github.com/python/cpython/commit/b101fa7783615051a89500e488708b955eac94c5


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:25:40 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 16 Jun 2019 23:25:40 +0000
Subject: [issue28805] Add documentation for METH_FASTCALL and
 _PyObject_FastCall*()
In-Reply-To: <1480158534.61.0.510309261592.issue28805@psf.upfronthosting.co.za>
Message-ID: <1560727540.73.0.0257602726188.issue28805@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e784f9f1c3fdd2102aae3fc0fe226408ff3a6029 by Miss Islington (bot) in branch '3.8':
bpo-28805: document METH_FASTCALL (GH-14079)
https://github.com/python/cpython/commit/e784f9f1c3fdd2102aae3fc0fe226408ff3a6029


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28805>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:26:20 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 16 Jun 2019 23:26:20 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1560721325.84.0.0820308695402.issue35224@roundup.psfhosted.org>
Message-ID: <CAP7+vJKd+GVEy_AZW8BDy7eSonLFb8gioZMM8EHn6M3Z=AVRkA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Do you want to give it a try yourself?

On Sun, Jun 16, 2019 at 14:42 J?rn Heissler <report at bugs.python.org> wrote:

>
> J?rn Heissler <launchpad at joern.heissler.de> added the comment:
>
> Hello,
>
> https://www.python.org/dev/peps/pep-0572/#change-to-evaluation-order
> mentions a change of evaluation order for dict comprehensions. It looks
> like this is not implemented yet (as of commit 66d47da8).
>
> Will this be implemented in this issue, or should I create a new one?
>
> Thanks
>
> ----------
> nosy: +joernheissler
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue35224>
> _______________________________________
>
-- 
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 16 19:55:01 2019
From: report at bugs.python.org (Hunter Turcin)
Date: Sun, 16 Jun 2019 23:55:01 +0000
Subject: [issue36956] Calling "functions" used to implement generators/comps
 easily cause crash
In-Reply-To: <1558187601.17.0.878025070628.issue36956@roundup.psfhosted.org>
Message-ID: <1560729301.2.0.101563670277.issue36956@roundup.psfhosted.org>


Change by Hunter Turcin <huntertur at gmail.com>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36956>
_______________________________________

From report at bugs.python.org  Sun Jun 16 20:01:49 2019
From: report at bugs.python.org (PyScripter)
Date: Mon, 17 Jun 2019 00:01:49 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560729709.6.0.780898496248.issue37189@roundup.psfhosted.org>


PyScripter <pyscripter at gmail.com> added the comment:

This does break PyScripter Python for Delphi as well.  The question whether this change was intentional in which case it would need to be explained and documented, or accidental and will be reversed begs an answer.

----------
nosy: +pyscripter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Sun Jun 16 20:43:39 2019
From: report at bugs.python.org (Gordon Marler)
Date: Mon, 17 Jun 2019 00:43:39 +0000
Subject: [issue37310] Solaris 11.3 w/ Studio 12.6 test_ctypes fail
Message-ID: <1560732219.57.0.838922158225.issue37310@roundup.psfhosted.org>


New submission from Gordon Marler <gmarler2 at gmail.com>:

Building a 64-bit Python 3.7.3 on Solaris 11.3 with Studio 12.6, and these test_ctypes tests fail:

python -m test -v test_ctypes

...

======================================================================
FAIL: test_ints (ctypes.test.test_bitfields.C_Test)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/ctypes/test/test_bitfields.py", line 40, in test_ints
    self.assertEqual(getattr(b, name), func(byref(b), name.encode('ascii')))
AssertionError: -1 != 1

======================================================================
FAIL: test_shorts (ctypes.test.test_bitfields.C_Test)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/ctypes/test/test_bitfields.py", line 47, in test_shorts
    self.assertEqual(getattr(b, name), func(byref(b), name.encode('ascii')))
AssertionError: -1 != 1

======================================================================
FAIL: test_pass_by_value (ctypes.test.test_structures.StructureTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/ctypes/test/test_structures.py", line 416, in test_pass_by_value
    self.assertEqual(s.first, 0xdeadbeef)
AssertionError: 195948557 != 3735928559

----------------------------------------------------------------------

Ran 472 tests in 3.545s

FAILED (failures=3, skipped=94)
test test_ctypes failed
test_ctypes failed

----------
components: Tests, ctypes
messages: 345793
nosy: gmarler
priority: normal
severity: normal
status: open
title: Solaris 11.3 w/ Studio 12.6 test_ctypes fail
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37310>
_______________________________________

From report at bugs.python.org  Sun Jun 16 20:57:11 2019
From: report at bugs.python.org (Gordon Marler)
Date: Mon, 17 Jun 2019 00:57:11 +0000
Subject: [issue37311] Solaris 11.3 w/ Studio 12.6 test_support fail
Message-ID: <1560733031.84.0.520294809269.issue37311@roundup.psfhosted.org>


New submission from Gordon Marler <gmarler2 at gmail.com>:

This failure confuses me, as it seems to occur in a test_rmtree subtest, and there's a warning that test_support is modifying something towards the end:

$ python -m test -W test_support

...

======================================================================
ERROR: test_rmtree (test.test_support.TestSupport)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/support/__init__.py", line 309, in _force_run
    return func(*args)
PermissionError: [Errno 13] Permission denied: '@test_11251_tmpd/subdir'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/test_support.py", line 73, in test_rmtree
    support.rmtree(dirpath)
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/support/__init__.py", line 431, in rmtree
    _rmtree(path)
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/support/__init__.py", line 411, in _rmtree
    _rmtree_inner(path)
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/support/__init__.py", line 410, in _rmtree_inner
    _force_run(path, os.unlink, fullname)
  File "/perfwork/gitwork/python/solaris/components/python/python373/Python-3.7.3/Lib/test/support/__init__.py", line 315, in _force_run
    return func(*args)
PermissionError: [Errno 1] Not owner: '@test_11251_tmpd/subdir'

----------------------------------------------------------------------

Ran 42 tests in 34.112s

FAILED (errors=1, skipped=1)
Warning -- files was modified by test_support
  Before: []
  After:  ['@test_11251_tmpd/']
test test_support failed
test_support failed in 34 sec 255 ms

== Tests result: FAILURE ==

1 test failed:
    test_support

Total duration: 34 sec 322 ms
Tests result: FAILURE

----------
components: Tests
messages: 345794
nosy: gmarler
priority: normal
severity: normal
status: open
title: Solaris 11.3 w/ Studio 12.6 test_support fail
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37311>
_______________________________________

From report at bugs.python.org  Sun Jun 16 21:28:15 2019
From: report at bugs.python.org (Martin Panter)
Date: Mon, 17 Jun 2019 01:28:15 +0000
Subject: [issue31233] socketserver.ThreadingMixIn leaks running threads after
 server_close()
In-Reply-To: <1503073499.39.0.93886151367.issue31233@psf.upfronthosting.co.za>
Message-ID: <1560734895.82.0.130887340833.issue31233@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

FYI the change here to remember all the thread objects ever created looks to be the cause of the memory leak reported in Issue 37193

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31233>
_______________________________________

From report at bugs.python.org  Sun Jun 16 21:46:26 2019
From: report at bugs.python.org (George Xie)
Date: Mon, 17 Jun 2019 01:46:26 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560735986.56.0.869901023851.issue37297@roundup.psfhosted.org>


Change by George Xie <georgexsh at gmail.com>:


----------
keywords: +patch
Added file: https://bugs.python.org/file48424/0001-fix-bound-method-__reduce__-bug.patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Sun Jun 16 21:47:45 2019
From: report at bugs.python.org (Martin Panter)
Date: Mon, 17 Jun 2019 01:47:45 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1560736065.96.0.0771991843935.issue37193@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

Looking at the code, this would be caused by Issue 31233. I expect 3.7+ is affected. 3.6 has similar code, but the leaking looks to be disabled by default. 2.7 doesn't collect a "_threads" list at all.

Looks like Victor was aware of the leak when he changed the code: <https://bugs.python.org/issue31233#msg304619>, but maybe he pushed the code and then forgot about the problem.

A possible problem with Norihiro's solution is modifying the "_threads" list from multiple threads without any synchronization. (Not sure if that is a problem, or is it guaranteed to be okay due to GIL etc?) Also, since the thread is removing itself from the list, it will still run a short while after the removal, so there is a window when the "server_close" method will not wait for that thread. Might also defeat the "dangling thread" accounting that I believe was Victor's motivation for his change.

Wei's proposal is to check for cleaning up when a new request is handled. That relies on a new request coming in to free up memory. Perhaps we could use similar strategy to the Forking mixin, which I believe cleans up expired children periodically, without relying on a new request.

----------
keywords: +3.7regression
nosy: +martin.panter, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Sun Jun 16 22:46:07 2019
From: report at bugs.python.org (Alejandro Gonzalez)
Date: Mon, 17 Jun 2019 02:46:07 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560739567.27.0.730213589207.issue28869@roundup.psfhosted.org>


Alejandro Gonzalez <alejandrojgt at gmail.com> added the comment:

>Getting the module name from the caller's frame is an expensive operation. It is safe to set __module__ to None. In such case the pickle module is able to find the proper module containing the definition of the class.

Wow, indeed it works. I also tried it from another module other than `__main__` and it works.

Checking the source, I see the "magic" happens in pickle's `whichmodule` function when looping over `sys.modules` if `__module__` is not found. If that case, why check for `__module__` in the first place? wouldn't it be simpler to always loop over sys.modules? Is it to avoid looping over `sys.modules` whenever possible?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Sun Jun 16 23:39:07 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Mon, 17 Jun 2019 03:39:07 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1560742747.16.0.725483461457.issue35224@roundup.psfhosted.org>


Change by J?rn Heissler <launchpad at joern.heissler.de>:


----------
pull_requests: +13980
pull_request: https://github.com/python/cpython/pull/14139

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 16 23:43:49 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Mon, 17 Jun 2019 03:43:49 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1560743029.5.0.982885766011.issue35224@roundup.psfhosted.org>


J?rn Heissler <launchpad at joern.heissler.de> added the comment:

I tried and it appears to work: https://github.com/python/cpython/pull/14139

As I'm not familiar with cpython code, chances are that I missed something important.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:17:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 07:17:19 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560755839.01.0.685425293504.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 28fca0c422b425a6be43be31add0a5328c16b0b8 by Victor Stinner (Zackery Spytz) in branch 'master':
bpo-37267: Do not check for FILE_TYPE_CHAR in os.dup() on Windows (GH-14051)
https://github.com/python/cpython/commit/28fca0c422b425a6be43be31add0a5328c16b0b8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:17:38 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 07:17:38 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560755858.26.0.595844466787.issue37267@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13981
pull_request: https://github.com/python/cpython/pull/14140

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:17:44 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 07:17:44 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560755864.31.0.723767233823.issue37267@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13982
pull_request: https://github.com/python/cpython/pull/14141

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:21:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 07:21:01 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560756061.05.0.150766288359.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

According to the discussion in PR 14051: if os.dup() fails to make the new file descriptor new inheritable for a character device, the error must not be ignored. Instead, the caller is supposed to use os.dup(fd, inheritable=False).

Before *this bugfix*, os.dup() didn't respect its contract: fd2 was inheritable sometimes. Now the caller is aware of such special case and so can handle it properly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:22:45 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:22:45 +0000
Subject: [issue35021] Assertion failures in datetimemodule.c.
In-Reply-To: <1539884234.35.0.788709270274.issue35021@psf.upfronthosting.co.za>
Message-ID: <1560756165.22.0.318312642261.issue35021@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Can we close this or is there anything further needed for this issue?

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35021>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:24:21 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:24:21 +0000
Subject: [issue36225] Lingering subinterpreters should be implicitly cleared
 on shutdown
In-Reply-To: <1551964663.69.0.686712846789.issue36225@roundup.psfhosted.org>
Message-ID: <1560756261.47.0.159481304033.issue36225@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Ping.  It was marked as a 3.7regression but perhaps it should now be just targeted for 3.8.

----------
nosy: +ned.deily
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36225>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:31:25 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Mon, 17 Jun 2019 07:31:25 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560756685.73.0.875434082119.issue37299@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

I think the reason for the difference here is in the `no_error` function you never actually create the coroutine `true()`, so there's nothing to warn about.

One thing that's confusing things about this example is that the `false()` evaluates to True, because it returns a coroutine object (rather than the value `False`):

    >>> async def false(): 
    ...:     return False 
    ...:                                                                                                                                     

    >>> bool(false())                                                                                                                       
    True

If you expand your `false() or true()` statement, it's equivalent to:

    x = false()
    if not x:
        x = true()

    return await x

Since `false()` is truthy, you don't expect true() to ever be called, hence no warning.

@YoSTEALTH Does this make sense? Does it solve the issue?

----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:31:41 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:31:41 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560756701.72.0.920059289752.issue36688@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Ping.  This was marked as a 3.7regression and there is a PR waiting for review.  Do we have plans to remove _dummy_thread in 3.8 or 3.9?

----------
nosy: +ned.deily
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:34:15 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:34:15 +0000
Subject: [issue36403] AsyncIterator on 3.7: __aiter__ no longer honors finally
 blocks
In-Reply-To: <1553300107.21.0.160175909039.issue36403@roundup.psfhosted.org>
Message-ID: <1560756855.52.0.00273704712069.issue36403@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Ping.  This was marked as a 3.7regression.  Is a change needed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36403>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:37:32 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:37:32 +0000
Subject: [issue34806] distutils tests fail with recent 3.7 branch
In-Reply-To: <1537949180.44.0.545547206417.issue34806@psf.upfronthosting.co.za>
Message-ID: <1560757052.24.0.705545052421.issue34806@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Since there has been no followup on this, I assume it is no longer a problem for anyone and am closing.

----------
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34806>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:42:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 07:42:37 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560757357.16.0.936426385357.issue37189@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13983
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14142

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:45:16 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 07:45:16 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560757516.09.0.368464152829.issue35998@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

What to do here?  This was originally filed as a "release blocker" and I allowed 3.7.3 to go out without a resolution for it since we had agreed to @christian.heimes proposal to defer full support of OpenSSL 1.1.1 until 3.7.4.  Now we are approaching code cutoff for 3.7.4.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:47:23 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 07:47:23 +0000
Subject: [issue36403] AsyncIterator on 3.7: __aiter__ no longer honors finally
 blocks
In-Reply-To: <1553300107.21.0.160175909039.issue36403@roundup.psfhosted.org>
Message-ID: <1560757643.69.0.730570108912.issue36403@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

>From my understanding yield inside __aiter__ is a forbidden construction. Even if parser allows it the statement doesn't make any sense.

I'm very interested to hear Yuri opinion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36403>
_______________________________________

From report at bugs.python.org  Mon Jun 17 03:48:56 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 07:48:56 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560757736.95.0.172860236688.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Attached PR 14142 fix bpo-34646 regression.

> It shouldn't break existing code because PyRun_String has a macro expansion to PyRun_StringFlags. ABI compatibility between major releases is not provided.

Many applications don't use Python header files, but access directly libpython. For example, py2app uses dlsym():
https://bitbucket.org/ronaldoussoren/py2app/src/default/py2app/apptemplate/src/main.c

PyInstaller uses GetProcAddress() on Windows or dlsym() on other platforms:
* https://github.com/pyinstaller/pyinstaller/blob/1844d69f5aa1d64d3feca912ed1698664a3faf3e/bootloader/src/pyi_python.h
* https://github.com/pyinstaller/pyinstaller/blob/1844d69f5aa1d64d3feca912ed1698664a3faf3e/bootloader/src/pyi_pythonlib.c

That's why PyRun_String() is defined as an alias using a macro *and* as a function in pythonrun.c:

#undef PyRun_String
PyObject *
PyRun_String(const char *str, int s, PyObject *g, PyObject *l)
{
    return PyRun_StringFlags(str, s, g, l, NULL);
}

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:02:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:02:35 +0000
Subject: [issue37312] Remove deprecated _dummy_thread and dummy_threading
 modules
Message-ID: <1560758555.75.0.0564764505885.issue37312@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The _dummy_thread and dummy_threading modules are deprecated since Python 3.7 which now requires threading support. Attached PR removes these modules.

----------
components: Library (Lib)
messages: 345810
nosy: vstinner
priority: normal
severity: normal
status: open
title: Remove deprecated _dummy_thread and dummy_threading modules
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37312>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:05:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:05:48 +0000
Subject: [issue37312] Remove deprecated _dummy_thread and dummy_threading
 modules
In-Reply-To: <1560758555.75.0.0564764505885.issue37312@roundup.psfhosted.org>
Message-ID: <1560758748.92.0.705780092213.issue37312@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +13984
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14143

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37312>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:07:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:07:53 +0000
Subject: [issue37312] Remove deprecated _dummy_thread and dummy_threading
 modules
In-Reply-To: <1560758555.75.0.0564764505885.issue37312@roundup.psfhosted.org>
Message-ID: <1560758873.53.0.40389885539.issue37312@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 3.7 has been modified to always require threading support:

* https://bugs.python.org/issue31370
* https://mail.python.org/pipermail/python-dev/2017-September/149156.html

commit a6a4dc816d68df04a7d592e0b6af8c7ecc4d4344
Author: Antoine Pitrou <pitrou at free.fr>
Date:   Thu Sep 7 18:56:24 2017 +0200
 
    bpo-31370: Remove support for threads-less builds (#3385)
   
    * Remove Setup.config
    * Always define WITH_THREAD for compatibility.

--

In Python 3.8, the dummy_threading module is documented as:

"This module provides a duplicate interface to the threading module. It was meant to be imported when the _thread module was not provided on a platform.

Be careful to not use this module where deadlock might occur from a thread being created that blocks waiting for another thread to be created. This often occurs with blocking I/O."

https://docs.python.org/dev/library/dummy_threading.html

And the doc starts with: "Deprecated since version 3.7: Python now always has threading enabled. Please use threading instead."

IMHO it's now time to remove this module.

--

I proposed to remove these modules today after I saw a bug on _dummy_thread: bpo-36688.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37312>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:08:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:08:15 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560758895.96.0.0826901710013.issue36688@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created bpo-37312: "Remove deprecated _dummy_thread and dummy_threading modules" (in Python 3.9).

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:10:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:10:22 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560759022.32.0.310036585977.issue36688@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c5905f39bcf4ef895d42eede41bb5a2f071a501d by Victor Stinner (Joost Lek) in branch 'master':
bpo-36688: Adding an implementation of RLock in _dummy_thread (GH-12943)
https://github.com/python/cpython/commit/c5905f39bcf4ef895d42eede41bb5a2f071a501d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:10:52 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 08:10:52 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560759052.49.0.193382734458.issue36688@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13985
pull_request: https://github.com/python/cpython/pull/14144

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:10:58 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 08:10:58 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560759058.8.0.165041686494.issue36688@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13986
pull_request: https://github.com/python/cpython/pull/14145

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:12:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:12:47 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560759167.22.0.240898589696.issue36688@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Ping.  This was marked as a 3.7regression and there is a PR waiting for review.

PR 12943 seems reasonable to me. I merged it.

> Do we have plans to remove _dummy_thread in 3.8 or 3.9?

I created bpo-37312 for Python 3.9. IMHO it's too late for 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:16:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:16:18 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1560759378.89.0.521669927984.issue37193@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

PR 13893 with an additional lock sounds like a reasonable solution. The code should be skipped if the thread is a daemon thread.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:18:46 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Mon, 17 Jun 2019 08:18:46 +0000
Subject: [issue24255] Replace debuglevel-related logic with logging
In-Reply-To: <1432189554.94.0.727112934658.issue24255@psf.upfronthosting.co.za>
Message-ID: <1560759526.0.0.923350252668.issue24255@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

PR waiting review, Stage should be 'patch review'

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24255>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:19:21 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 08:19:21 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1560759561.11.0.371793440558.issue35431@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +13987
pull_request: https://github.com/python/cpython/pull/14146

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:20:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:20:03 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1560759603.25.0.0800181439868.issue37193@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Martin Panter: In addition to PR 13893 change, what do you think of also using a weakref? It might make the code even more reliable if something goes wrong.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:26:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:26:00 +0000
Subject: [issue37313] test_concurrent_futures stopped after 25 hours on AMD64
 Windows7 SP1 3.7
Message-ID: <1560759960.52.0.187936052525.issue37313@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

AMD64 Windows7 SP1 3.7:
https://buildbot.python.org/all/#/builders/130/builds/935

0:23:27 load avg: 7.92 [412/416] test_plistlib passed -- running: test_venv (1 min 26 sec), test_concurrent_futures (23 min 26 sec)
0:23:32 load avg: 7.29 [413/416] test_argparse passed -- running: test_venv (1 min 31 sec), test_concurrent_futures (23 min 31 sec)
0:23:34 load avg: 7.29 [414/416] test_venv passed (1 min 32 sec) -- running: test_concurrent_futures (23 min 32 sec)
0:23:37 load avg: 6.71 [415/416] test_largefile passed -- running: test_concurrent_futures (23 min 35 sec)
running: test_concurrent_futures (24 min 6 sec)
running: test_concurrent_futures (24 min 36 sec)
...
running: test_concurrent_futures (25 hour 25 min)
running: test_concurrent_futures (25 hour 26 min)
running: test_concurrent_futures (25 hour 26 min)
running: test_concurrent_futures (25 hour 27 min)
running: test_concurrent_futures (25 hour 27 min)
running: test_concurrent_futures (25 hour 28 min)
program finished with exit code 1
elapsedTime=91968.468000

----------
components: Tests
messages: 345818
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_concurrent_futures stopped after 25 hours on AMD64 Windows7 SP1 3.7
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37313>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:28:49 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 08:28:49 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560760129.63.0.506724981517.issue36688@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 351b0e793e35510e8cbbcbb455a1b9544e808cdd by Miss Islington (bot) in branch '3.7':
bpo-36688: Adding an implementation of RLock in _dummy_thread (GH-12943)
https://github.com/python/cpython/commit/351b0e793e35510e8cbbcbb455a1b9544e808cdd


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:34:30 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 08:34:30 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560760470.66.0.0163931288882.issue36688@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ad505918a1829e6fa2a48a7665234d60a9377e98 by Miss Islington (bot) in branch '3.8':
bpo-36688: Adding an implementation of RLock in _dummy_thread (GH-12943)
https://github.com/python/cpython/commit/ad505918a1829e6fa2a48a7665234d60a9377e98


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:41:11 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Mon, 17 Jun 2019 08:41:11 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560760871.82.0.385194875128.issue37299@roundup.psfhosted.org>


YoSTEALTH <ritesh at stealthcentral.com> added the comment:

Yes, this was the previous conclusion.

In a large code base, its hard to find such solution easily! There are many cases where `await` is not called and `RuntimeWarning` is not raised. Hard to narrow down the exact problem.

Maybe there needs to be a better way to evaluate coroutine vs waiting for the garbage collection to happen to riase `RuntimeWarning`

Paul, thanks for taking time to answer :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:42:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:42:38 +0000
Subject: [issue37314] Compilation failed on AMD64 Debian root 3.8: undefined
 reference to _PyTraceMalloc_NewReference
Message-ID: <1560760958.7.0.704551196442.issue37314@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

AMD64 Debian root 3.8:
https://buildbot.python.org/all/#builders/211/builds/47

libpython3.8d.a(bytesobject.o): In function `_Py_NewReference':
/root/buildarea/3.8.angelico-debian-amd64/build/./Include/object.h:439: undefined reference to `_PyTraceMalloc_NewReference'
/root/buildarea/3.8.angelico-debian-amd64/build/./Include/object.h:439: undefined reference to `_PyTraceMalloc_NewReference'
/root/buildarea/3.8.angelico-debian-amd64/build/./Include/object.h:439: undefined reference to `_PyTraceMalloc_NewReference'
/root/buildarea/3.8.angelico-debian-amd64/build/./Include/object.h:439: undefined reference to `_PyTraceMalloc_NewReference'

----------
components: Tests
messages: 345822
nosy: vstinner
priority: normal
severity: normal
status: open
title: Compilation failed on AMD64 Debian root 3.8: undefined reference to _PyTraceMalloc_NewReference
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37314>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:44:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:44:28 +0000
Subject: [issue36688] _dummy_thread lacks an RLock implementaiton
In-Reply-To: <1555827608.59.0.767546227499.issue36688@roundup.psfhosted.org>
Message-ID: <1560761068.43.0.338534897678.issue36688@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Joost Lek for the fix and Karthikeyan Singaravelan for the bug report. It's now fixed in 3.7, 3.8 and master branches. I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36688>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:45:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:45:07 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560761107.25.0.204240536196.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 71589491ad0da27f57789b97354f6094a91e2eb3 by Victor Stinner (Miss Islington (bot)) in branch '3.7':
bpo-37267: Do not check for FILE_TYPE_CHAR in os.dup() on Windows (GH-14051) (GH-14141)
https://github.com/python/cpython/commit/71589491ad0da27f57789b97354f6094a91e2eb3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:45:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:45:29 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560761129.69.0.426334591702.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 693945d45dfe50c843970cab3e3aa1fa3a3eddbe by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-37267: Do not check for FILE_TYPE_CHAR in os.dup() on Windows (GH-14051) (GH-14140)
https://github.com/python/cpython/commit/693945d45dfe50c843970cab3e3aa1fa3a3eddbe


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:45:59 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 08:45:59 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560761159.31.0.392974594579.issue34631@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

It looks we missed the window for 3.7.4 here.  (I assume the Windows installer build is not using 1.1.1.  Steve?)  Talking with Christian about this in IRC, we agreed, the CI pipelines (Azure and travis) are now using 1.1.1c and I've put a request to the buildbot owners to upgrade to 1.1.1c if possible.  So let's retarget 1.1.1c for 3.7.5 then which will be right around the time 1.1.0 support ends.  In the meantime, we should update other installers to 1.1.0k and 1.0.2s.

----------
title: Upgrade to OpenSSL 1.1.1b -> Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
versions: +Python 2.7, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:49:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 08:49:27 +0000
Subject: [issue37267] os.dup() creates an inheritable fd when handling a
 character file on Windows
In-Reply-To: <1560420750.69.0.156424123047.issue37267@roundup.psfhosted.org>
Message-ID: <1560761367.89.0.0122706639361.issue37267@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Zackery Spytz as usual!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37267>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:49:55 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 08:49:55 +0000
Subject: [issue37315] Deprecate using math.factorial() with floats
Message-ID: <1560761395.48.0.0855458048325.issue37315@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Currently math.factorial() accepts integer-like objects (including objects with defined __index__) as well as float instances with integral value (but not arbitrary float-like objects with defined __float__). I suppose this was happen because factorial() was the first integer functions in the math module, and all other functions accepted floats at that time. See also issue7550. But now we have more pure integer functions in the math module: gcd, isqrt, comb, perm. Seems accepting floats in factorial was a mistake. Now we can fix it, and deprecate using factorial() with floats.

Initial version of factorial() accepted also non-integral numbers (except float) with defined __int__. It was fixed in issue33083.

----------
components: Extension Modules
messages: 345828
nosy: mark.dickinson, pablogsal, rhettinger, serhiy.storchaka, stutzbach
priority: normal
severity: normal
status: open
title: Deprecate using math.factorial() with floats
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37315>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:54:51 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 08:54:51 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560761691.57.0.00913659880287.issue37299@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

The solution is called static analyzers and "type hints".
Mypy detects the absence of "await" pretty well.
In turn, CPython does the best in runtime mode for detecting not-awaited awaitables when possible.

I think we should close the issue, it doesn't show a bug but requests for nice-to-have thing which is solved by another tool.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 04:58:12 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 08:58:12 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560761892.36.0.790816171449.issue35998@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

No idea what to do.
SSL support is obviously broken.
Current code is too complex to maintain.

Yuri has a full reimplementation of ssl_proto.py in uvloop.
It *seem* to work and can be backported.

I'm sick now, can be ready to work back in a day or two.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:01:16 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 09:01:16 +0000
Subject: [issue37315] Deprecate using math.factorial() with floats
In-Reply-To: <1560761395.48.0.0855458048325.issue37315@roundup.psfhosted.org>
Message-ID: <1560762076.97.0.947993874482.issue37315@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +patch
pull_requests: +13988
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14147

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37315>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:06:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 09:06:30 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560762390.49.0.870760081226.issue35031@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13989
pull_request: https://github.com/python/cpython/pull/14148

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:09:20 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Mon, 17 Jun 2019 09:09:20 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560762560.77.0.236387257897.issue37297@roundup.psfhosted.org>


Change by G?ry <gery.ogam at gmail.com>:


----------
nosy: +asvetlov, christian.heimes, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:12:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 09:12:06 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560762726.56.0.814999654671.issue35031@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Commit f6a47f3e316cede2a07a1f74a509f6d80ab8fef0 introduced a workaround on Windows and FreeBSD. It was removed by commit f0749da9a535375f05a2015e8960e8ae54877349 in bpo-35998... but then Windows restarted to fail:
https://bugs.python.org/issue35998#msg345644

So I wrote PR 14148 to reintroduce the workaround until someone finds time to have a look.

Note: this issue is open since October 2018.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:32:26 2019
From: report at bugs.python.org (Mike Gleen)
Date: Mon, 17 Jun 2019 09:32:26 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560763946.59.0.305783374784.issue34903@roundup.psfhosted.org>


Change by Mike Gleen <mike.gleen at gmail.com>:


----------
pull_requests: +13990
pull_request: https://github.com/python/cpython/pull/14149

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:47:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 09:47:55 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560764875.24.0.771502248222.issue35031@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c034b7824f5a7c50f2946ab3931633200e31d903 by Victor Stinner in branch 'master':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/c034b7824f5a7c50f2946ab3931633200e31d903


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:47:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 09:47:55 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560764875.41.0.775382763371.issue35998@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c034b7824f5a7c50f2946ab3931633200e31d903 by Victor Stinner in branch 'master':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/c034b7824f5a7c50f2946ab3931633200e31d903


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:48:16 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 09:48:16 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560764896.52.0.439357169267.issue35031@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13991
pull_request: https://github.com/python/cpython/pull/14150

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:48:16 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 09:48:16 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560764896.63.0.960664305463.issue35998@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13992
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14150

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:48:24 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 09:48:24 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560764904.12.0.913701352851.issue35031@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13993
pull_request: https://github.com/python/cpython/pull/14151

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:48:24 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 09:48:24 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560764904.21.0.199745796767.issue35998@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13994
pull_request: https://github.com/python/cpython/pull/14151

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:51:19 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 17 Jun 2019 09:51:19 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
Message-ID: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

new_mmap_object() should pass the fd variable to PySys_Audit(), not fileno.

Also, there's a missing call to va_end() in PySys_Audit() itself.

----------
components: Extension Modules
messages: 345834
nosy: ZackerySpytz
priority: normal
severity: normal
status: open
title: mmap.mmap() passes the wrong variable to PySys_Audit()
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:52:41 2019
From: report at bugs.python.org (vsbogd)
Date: Mon, 17 Jun 2019 09:52:41 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560765161.67.0.617712255458.issue37301@roundup.psfhosted.org>


vsbogd <vsbogd at gmail.com> added the comment:

Yeah, I have seen this comment as well. As I see this code for the first time I am not very familiar with it. 

It seems that this explanation is related to the case when non-Python CGI script is executed:

                os.dup2(self.rfile.fileno(), 0)
                os.dup2(self.wfile.fileno(), 1)
                os.execve(scriptfile, args, env)

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L1176-L1178

On one hand the comment seems reasonable: as fileno is duped one cannot just read from it ahead of time. On the other hand few lines earlier one can see:

                # throw away additional data [see bug #427345]
                while select.select([self.rfile], [], [], 0)[0]:
                    if not self.rfile.read(1):
                        break

https://github.com/python/cpython/blob/3a1d50e7e573efb577714146bed5c03b9c95f466/Lib/http/server.py#L1163-L1166

which also seems like reading ahead of time.

My opinion this case should be tested after fix and if it works then fix can be applied without hesitation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:54:48 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 17 Jun 2019 09:54:48 +0000
Subject: [issue37231] Optimize calling special methods
In-Reply-To: <1560258460.83.0.570346812053.issue37231@roundup.psfhosted.org>
Message-ID: <1560765288.08.0.0476043144341.issue37231@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +13996
pull_request: https://github.com/python/cpython/pull/14153

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37231>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:54:46 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 17 Jun 2019 09:54:46 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1560765286.19.0.474377805353.issue37316@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +13995
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14152

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Mon Jun 17 05:55:12 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 09:55:12 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560765312.78.0.293373879525.issue34631@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> (I assume the Windows installer build is not using 1.1.1.  Steve?)

After doing a little more homework and better understanding PCbuild/get_externals.bat, https://github.com/python/cpython-source-deps, and https://github.com/python/cpython-bin-deps and their twisting branches, it appears we *are* using 1.1.1, in particular, 1.1.1b for 3.7 and 3.8 Windows builds.  So:

1. Can/should be try to update to 1.1.1c for 3.7.4 on Windows, and

2. Should I try to update the macOS installer to 1.1.1c for 3.7.4?

For the latter, I'll give it a try and see how smoothly it goes before making a final decision.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:06:56 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 10:06:56 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560766016.8.0.56618629577.issue35031@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a5ddbfbf50715e3d4b90ad367ed6827c6cbcc52f by Miss Islington (bot) in branch '3.8':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/a5ddbfbf50715e3d4b90ad367ed6827c6cbcc52f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:06:56 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 10:06:56 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560766016.92.0.454955642893.issue35998@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a5ddbfbf50715e3d4b90ad367ed6827c6cbcc52f by Miss Islington (bot) in branch '3.8':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/a5ddbfbf50715e3d4b90ad367ed6827c6cbcc52f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:10:52 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 10:10:52 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560766252.58.0.241413996389.issue35031@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0040903bbae043225499babae23649d896ea2eec by Miss Islington (bot) in branch '3.7':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/0040903bbae043225499babae23649d896ea2eec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:10:52 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 10:10:52 +0000
Subject: [issue35998] test_asyncio: test_start_tls_server_1() TimeoutError on
 Fedora 29
In-Reply-To: <1550225538.04.0.738886867119.issue35998@roundup.psfhosted.org>
Message-ID: <1560766252.69.0.582360587418.issue35998@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0040903bbae043225499babae23649d896ea2eec by Miss Islington (bot) in branch '3.7':
bpo-35031, test_asycio: disable TLS 1.3 in test_start_tls_server_1() (GH-14148)
https://github.com/python/cpython/commit/0040903bbae043225499babae23649d896ea2eec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35998>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:19:06 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 10:19:06 +0000
Subject: [issue33725] Python crashes on macOS after fork with no exec
In-Reply-To: <1527814386.62.0.682650639539.issue33725@psf.upfronthosting.co.za>
Message-ID: <1560766746.38.0.346099100645.issue33725@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As far as I can tell, the only thing left to do for this issue is to add a documentation warning to the 3.7 documents similar to what was added to 3.8 but without the change in default.  A PR would be nice.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33725>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:48:32 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Mon, 17 Jun 2019 10:48:32 +0000
Subject: [issue37315] Deprecate using math.factorial() with floats
In-Reply-To: <1560761395.48.0.0855458048325.issue37315@roundup.psfhosted.org>
Message-ID: <1560768512.63.0.089569272375.issue37315@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

+1 from me; let's make `factorial` consistent with the other integer-based  math module functions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37315>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:56:17 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 10:56:17 +0000
Subject: [issue34506] Traceback logged when SSL handshake fails
In-Reply-To: <1535269470.94.0.56676864532.issue34506@psf.upfronthosting.co.za>
Message-ID: <1560768977.55.0.0357319501528.issue34506@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I believe the issue is a duplicate for #37035 at least regarding traceback logging.

It can be closed, OSError exceptions are not logged anymore.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34506>
_______________________________________

From report at bugs.python.org  Mon Jun 17 06:58:17 2019
From: report at bugs.python.org (Aymeric Augustin)
Date: Mon, 17 Jun 2019 10:58:17 +0000
Subject: [issue34506] Traceback logged when SSL handshake fails
In-Reply-To: <1535269470.94.0.56676864532.issue34506@psf.upfronthosting.co.za>
Message-ID: <1560769097.54.0.562688735238.issue34506@roundup.psfhosted.org>


Aymeric Augustin <aymeric.augustin at m4x.org> added the comment:

Yes, that seems reasonable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34506>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:05:17 2019
From: report at bugs.python.org (Jeremy Kloth)
Date: Mon, 17 Jun 2019 11:05:17 +0000
Subject: [issue37313] test_concurrent_futures stopped after 25 hours on AMD64
 Windows7 SP1 3.7
In-Reply-To: <1560759960.52.0.187936052525.issue37313@roundup.psfhosted.org>
Message-ID: <1560769517.4.0.94910113993.issue37313@roundup.psfhosted.org>


Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com> added the comment:

The test run was stopped by me terminating the stuck processes on the buildbot worker itself.  This happens approximately once a month or so.

As of late, its been stuck in test_concurrent_futures, but it can get stuck in any test that uses multiprocessing (the spawned pool never terminates).

----------
nosy: +jkloth

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37313>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:40:46 2019
From: report at bugs.python.org (Mark Summerfield)
Date: Mon, 17 Jun 2019 11:40:46 +0000
Subject: [issue4198] os.path.normcase gets fooled on windows with mapped linux
 network drive
In-Reply-To: <1224885833.7.0.0397055051655.issue4198@psf.upfronthosting.co.za>
Message-ID: <1560771646.06.0.476241810373.issue4198@roundup.psfhosted.org>


Mark Summerfield <mark at qtrac.eu> added the comment:

When running a VirtualBox Windows 7 guest on Linux I have found that os.path.samefile() returns False when the filenames are the same, e.g.,

f = r'V:\pdfs\boson1.pdf'
same = os.path.samefile(f, f)
print(same) # expected True; got False

I mention it here because it may be part of the same problem.
I'm using Python 3.7.2.

----------
nosy: +mark
versions: +Python 3.7 -Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4198>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:40:59 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 11:40:59 +0000
Subject: [issue34506] Traceback logged when SSL handshake fails
In-Reply-To: <1535269470.94.0.56676864532.issue34506@psf.upfronthosting.co.za>
Message-ID: <1560771659.47.0.870854870916.issue34506@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Don't log OSError exceptions in asyncio transports

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34506>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:41:48 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 17 Jun 2019 11:41:48 +0000
Subject: [issue37231] Optimize calling special methods
In-Reply-To: <1560258460.83.0.570346812053.issue37231@roundup.psfhosted.org>
Message-ID: <1560771708.59.0.223970094063.issue37231@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 0456df4a55ec9a4e8f4425df92bbe63a290f3f2f by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37231: remove _PyObject_FastCall_Prepend (GH-14153)
https://github.com/python/cpython/commit/0456df4a55ec9a4e8f4425df92bbe63a290f3f2f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37231>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:53:26 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 17 Jun 2019 11:53:26 +0000
Subject: [issue36922] Implement Py_TPFLAGS_METHOD_DESCRIPTOR
In-Reply-To: <1557909585.08.0.913937443168.issue36922@roundup.psfhosted.org>
Message-ID: <1560772406.54.0.958849516721.issue36922@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 2e9954d3472a23919b96323fcd5bb6c1d6927155 by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-36922: use Py_TPFLAGS_METHOD_DESCRIPTOR in lookup_maybe_method() (GH-13865)
https://github.com/python/cpython/commit/2e9954d3472a23919b96323fcd5bb6c1d6927155


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36922>
_______________________________________

From report at bugs.python.org  Mon Jun 17 07:53:53 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 11:53:53 +0000
Subject: [issue36922] Implement Py_TPFLAGS_METHOD_DESCRIPTOR
In-Reply-To: <1557909585.08.0.913937443168.issue36922@roundup.psfhosted.org>
Message-ID: <1560772433.39.0.988679300368.issue36922@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +13997
pull_request: https://github.com/python/cpython/pull/14155

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36922>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:12:55 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 12:12:55 +0000
Subject: [issue36922] Implement Py_TPFLAGS_METHOD_DESCRIPTOR
In-Reply-To: <1557909585.08.0.913937443168.issue36922@roundup.psfhosted.org>
Message-ID: <1560773575.31.0.63510877139.issue36922@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 988fff5d0e7fccecbf776c08ec56695820b3b4a8 by Miss Islington (bot) in branch '3.8':
bpo-36922: use Py_TPFLAGS_METHOD_DESCRIPTOR in lookup_maybe_method() (GH-13865)
https://github.com/python/cpython/commit/988fff5d0e7fccecbf776c08ec56695820b3b4a8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36922>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:18:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:18:47 +0000
Subject: [issue37312] Remove deprecated _dummy_thread and dummy_threading
 modules
In-Reply-To: <1560758555.75.0.0564764505885.issue37312@roundup.psfhosted.org>
Message-ID: <1560773927.03.0.160552367804.issue37312@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 8bf08ee45b7c2341f0d0175b91892843a37c23da by Victor Stinner in branch 'master':
bpo-37312: Remove _dummy_thread and dummy_threading modules (GH-14143)
https://github.com/python/cpython/commit/8bf08ee45b7c2341f0d0175b91892843a37c23da


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37312>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:20:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:20:26 +0000
Subject: [issue37312] Remove deprecated _dummy_thread and dummy_threading
 modules
In-Reply-To: <1560758555.75.0.0564764505885.issue37312@roundup.psfhosted.org>
Message-ID: <1560774026.31.0.915932909196.issue37312@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Bye bye dummy_threading. As explained in PR 14143, I kept a reference to dummy_threading in 2to3 on purpose. Keep it there is fine, it helps to port legacy Python 2 code to Python 3.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37312>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:27:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:27:32 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560774452.45.0.814089175277.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 2ff58a24e8a1c7e290d025d69ebaea0bbead3b8c by Victor Stinner in branch 'master':
bpo-37194: Add a new public PyObject_CallNoArgs() function (GH-13890)
https://github.com/python/cpython/commit/2ff58a24e8a1c7e290d025d69ebaea0bbead3b8c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:38:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:38:39 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560775119.91.0.353355326052.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13998
pull_request: https://github.com/python/cpython/pull/14156

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:52:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:52:40 +0000
Subject: [issue36732] test_asyncio: test_huge_content_recvinto() fails randomly
In-Reply-To: <1556264661.54.0.31283754406.issue36732@roundup.psfhosted.org>
Message-ID: <1560775960.9.0.664576288127.issue36732@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New failure on AMD64 Windows7 SP1 3.8:
https://buildbot.python.org/all/#/builders/208/builds/75

======================================================================
ERROR: test_huge_content_recvinto (test.test_asyncio.test_sock_lowlevel.SelectEventLoopTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 225, in test_huge_content_recvinto
    self.loop.run_until_complete(
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\base_events.py", line 608, in run_until_complete
    return future.result()
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 211, in _basetest_huge_content_recvinto
    nbytes = await self.loop.sock_recv_into(sock, buf)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\selector_events.py", line 400, in sock_recv_into
    return await fut
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\selector_events.py", line 409, in _sock_recv_into
    nbytes = sock.recv_into(buf)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host

(... test_asyncio re-run in verbose mode ...)

======================================================================
ERROR: test_huge_content (test.test_asyncio.test_sock_lowlevel.ProactorEventLoopTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\windows_events.py", line 453, in finish_recv
    return ov.getresult()
OSError: [WinError 64] The specified network name is no longer available

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 170, in test_huge_content
    self.loop.run_until_complete(
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\base_events.py", line 608, in run_until_complete
    return future.result()
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 157, in _basetest_huge_content
    data = await self.loop.sock_recv(sock, DATA_SIZE)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\proactor_events.py", line 690, in sock_recv
    return await self._proactor.recv(sock, n)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\windows_events.py", line 808, in _poll
    value = callback(transferred, key, ov)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\asyncio\windows_events.py", line 457, in finish_recv
    raise ConnectionResetError(*exc.args)
ConnectionResetError: [WinError 64] The specified network name is no longer available

----------
resolution: out of date -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36732>
_______________________________________

From report at bugs.python.org  Mon Jun 17 08:58:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 12:58:21 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560776301.47.0.884645626683.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 1ce2656f13e726b3b99d4c968926908cff1f460a by Victor Stinner in branch 'master':
bpo-37194: Complete PyObject_CallXXX() docs (GH-14156)
https://github.com/python/cpython/commit/1ce2656f13e726b3b99d4c968926908cff1f460a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:02:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:02:04 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560776524.12.0.283916881652.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +13999
pull_request: https://github.com/python/cpython/pull/14157

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:07:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:07:47 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560776867.47.0.631222572997.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14000
pull_request: https://github.com/python/cpython/pull/14158

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:09:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:09:16 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560776956.43.0.0377275058581.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> bpo-37191: the new vector APIs declare "static inline" functions which are no C89 compatible and so cause compilation issues on pygobject3, python-dbus, xen (for example).

bpo-37191 have been fixed, so this issue can now be closed.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:20:41 2019
From: report at bugs.python.org (prince parker)
Date: Mon, 17 Jun 2019 13:20:41 +0000
Subject: [issue32545] Unable to install Python 3.7.0a4 on Windows 10 - Error
 0x80070643: Failed to install MSI package.
In-Reply-To: <1515875653.34.0.467229070634.issue32545@psf.upfronthosting.co.za>
Message-ID: <1560777641.36.0.942490855037.issue32545@roundup.psfhosted.org>


prince parker <gikoli at silvercoin.life> added the comment:

>From the log record, everything I can advise is that it neglected to open the document containing data about progressing introduces. At a supposition, another introduce was running (possibly fizzled?) and didn't tidy up appropriately. 
https://antimalwareserviceexecutables.com/

Rebooting ought to by and large determination that. In the event that it doesn't, you're either taking a gander at genuine OS defilement (worth testing if some other MSI installers work - Anaconda does not utilize MSI) or plate debasement.

----------
hgrepos: +383
nosy: +prince_parker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32545>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:23:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:23:57 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560777837.8.0.048766398492.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ac4202ee4d53d6c0a07109e03795b70d91edbbb3 by Victor Stinner in branch '3.7':
bpo-37194: Complete PyObject_CallXXX() docs (GH-14156) (GH-14158)
https://github.com/python/cpython/commit/ac4202ee4d53d6c0a07109e03795b70d91edbbb3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:24:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:24:02 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560777842.54.0.220291720016.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 71031cf4ed5ac9e330c8890b92379d9df383925b by Victor Stinner in branch '3.8':
bpo-37194: Complete PyObject_CallXXX() docs (GH-14156) (GH-14157)
https://github.com/python/cpython/commit/71031cf4ed5ac9e330c8890b92379d9df383925b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:28:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 13:28:21 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560778101.6.0.0050069334137.issue37194@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14001
pull_request: https://github.com/python/cpython/pull/14159

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:57:58 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 13:57:58 +0000
Subject: [issue37315] Deprecate using math.factorial() with floats
In-Reply-To: <1560761395.48.0.0855458048325.issue37315@roundup.psfhosted.org>
Message-ID: <1560779878.37.0.850064375819.issue37315@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 231aad38493c871dd32930a21d256cbacd2ae20c by Serhiy Storchaka in branch 'master':
bpo-37315: Deprecate accepting floats in math.factorial(). (GH-14147)
https://github.com/python/cpython/commit/231aad38493c871dd32930a21d256cbacd2ae20c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37315>
_______________________________________

From report at bugs.python.org  Mon Jun 17 09:58:42 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 13:58:42 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1560779922.4.0.850247301781.issue35431@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 1b8a46d59734a77cd1f5ffcf3bdfcaafd58a87e7 by Serhiy Storchaka in branch 'master':
bpo-35431: Test math.comb() and math.perm() for OverflowError only on CPython. (GH-14146)
https://github.com/python/cpython/commit/1b8a46d59734a77cd1f5ffcf3bdfcaafd58a87e7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Mon Jun 17 10:02:26 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 14:02:26 +0000
Subject: [issue37315] Deprecate using math.factorial() with floats
In-Reply-To: <1560761395.48.0.0855458048325.issue37315@roundup.psfhosted.org>
Message-ID: <1560780146.2.0.308084241478.issue37315@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37315>
_______________________________________

From report at bugs.python.org  Mon Jun 17 10:10:41 2019
From: report at bugs.python.org (Carlos Mermingas)
Date: Mon, 17 Jun 2019 14:10:41 +0000
Subject: [issue37317] asyncio gather doesn't handle custom exceptions that
 inherit from BaseException
Message-ID: <1560780641.84.0.00364750397427.issue37317@roundup.psfhosted.org>


New submission from Carlos Mermingas <cmermingas at gmail.com>:

asyncio.gather doesn't handle custom exception exceptions that inherit from BaseException in the same manner that it handles those that inherit from Exception, regardless of whether return_exceptions is set to True or False.

In the example below, I am using return_exceptions=True. If the custom exception inherits from Exception, a list printed, as expected. Conversely, if the custom exception inherits from BaseException, it is propagated:


import asyncio


class CustomException(BaseException):  # It works if base class changed to Exception
    pass


async def do_this(x):
    if x == 5:
        raise CustomException()
    await asyncio.sleep(1)
    print(f'THIS DONE: {x}')


async def main():
    print('BEGIN')
    tasks = [do_this(x) for x in range(1, 11)]
    result = await asyncio.gather(*tasks, return_exceptions=True)
    print(f'Result: {result}')
    print('END')


asyncio.run(main())

----------
components: Library (Lib)
messages: 345861
nosy: cmermingas
priority: normal
severity: normal
status: open
title: asyncio gather doesn't handle custom exceptions that inherit from BaseException
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37317>
_______________________________________

From report at bugs.python.org  Mon Jun 17 10:40:21 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 17 Jun 2019 14:40:21 +0000
Subject: [issue37317] asyncio gather doesn't handle custom exceptions that
 inherit from BaseException
In-Reply-To: <1560780641.84.0.00364750397427.issue37317@roundup.psfhosted.org>
Message-ID: <1560782421.01.0.492264164736.issue37317@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +asyncio
nosy: +asvetlov, yselivanov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37317>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:15:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 15:15:59 +0000
Subject: [issue37194] Move new vector private declarations to the internal C
 API
In-Reply-To: <1559908440.37.0.746705371355.issue37194@roundup.psfhosted.org>
Message-ID: <1560784559.63.0.214835313047.issue37194@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 5352cc41fa4eb5f0dc847709392e88473b8593b0 by Victor Stinner in branch 'master':
bpo-37194: Add PyObject_CallNoArgs() rationale (GH-14159)
https://github.com/python/cpython/commit/5352cc41fa4eb5f0dc847709392e88473b8593b0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37194>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:17:02 2019
From: report at bugs.python.org (ChrisRands)
Date: Mon, 17 Jun 2019 15:17:02 +0000
Subject: [issue37318] builtins.True exists but can't be accessed
Message-ID: <1560784622.94.0.240402132833.issue37318@roundup.psfhosted.org>


New submission from ChrisRands <chrisrands0 at gmail.com>:

On Python 3:

>>> import builtins
>>> 'True' in dir(builtins)
True
>>> builtins.True
  File "<stdin>", line 1
    builtins.True
                ^
SyntaxError: invalid syntax
>>> 

So "True" is a keyword, I guess this explains the behaviour, but still seems odd to me?

Relevant SO question:
https://stackoverflow.com/questions/56633402/why-are-true-and-false-being-set-in-globals-by-this-code

----------
messages: 345863
nosy: ChrisRands
priority: normal
severity: normal
status: open
title: builtins.True exists but can't be accessed
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37318>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:21:35 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 15:21:35 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560784895.57.0.90302911002.issue37288@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 00f6493084c385033fe5574314223217d9a26672 by Steve Dower (Paul Monson) in branch 'master':
bpo-37288: Fix Windows build when --no-tkinter is specified (GH-14096)
https://github.com/python/cpython/commit/00f6493084c385033fe5574314223217d9a26672


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:22:20 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 15:22:20 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560784940.87.0.20625859694.issue37288@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14002
pull_request: https://github.com/python/cpython/pull/14160

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:23:21 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 15:23:21 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560785001.42.0.901029931129.issue35360@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Has anyone tried building with the newer SQLite and confirmed that the tests and any scenarios they use still work?

We don't currently have a SQLite expert to do these kinds of things.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:24:03 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 15:24:03 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560785043.21.0.904810094267.issue37288@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks, Paul!

----------
assignee:  -> steve.dower
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:24:52 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Mon, 17 Jun 2019 15:24:52 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560785092.9.0.219611107476.issue37297@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@George Xie

There is an issue with the Python workaround `multiprocessing.reduction.register(types.MethodType, my_reduce)` that you proposed. If you then instantiate a `multiprocessing.Manager()` you get this exception:

> python
Python 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import multiprocessing
>>> import types
>>> def my_reduce(obj):
...     return (obj.__func__.__get__, (obj.__self__,))
...
>>> multiprocessing.reduction.register(types.MethodType, my_reduce)
>>> multiprocessing.Manager()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Program Files\Python37\lib\multiprocessing\context.py", line 56, in Manager
    m.start()
  File "C:\Program Files\Python37\lib\multiprocessing\managers.py", line 543, in start
    self._process.start()
  File "C:\Program Files\Python37\lib\multiprocessing\process.py", line 112, in start
    self._popen = self._Popen(self)
  File "C:\Program Files\Python37\lib\multiprocessing\context.py", line 322, in _Popen
    return Popen(process_obj)
  File "C:\Program Files\Python37\lib\multiprocessing\popen_spawn_win32.py", line 89, in __init__
    reduction.dump(process_obj, to_child)
  File "C:\Program Files\Python37\lib\multiprocessing\reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
_pickle.PicklingError: Can't pickle <function BaseManager._run_server at 0x000001AEF8ED1D90>: it's not the same object as multiprocessing.managers.BaseManager._run_server
>>> Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Program Files\Python37\lib\multiprocessing\spawn.py", line 105, in spawn_main
    exitcode = _main(fd)
  File "C:\Program Files\Python37\lib\multiprocessing\spawn.py", line 115, in _main
    self = reduction.pickle.load(from_parent)
EOFError: Ran out of input

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:32:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 15:32:35 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560785555.09.0.421958852206.issue37297@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:33:23 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 15:33:23 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560785603.96.0.0704598046926.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

The canonical source of versions used on Windows is in PCbuild/python.props

I'll pull the 1.1.1c sources into cpython-source-deps and run a build. If all goes smoothly, we can consider it, but I don't have a huge amount of time for CPython this week I'm afraid.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:45:21 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 15:45:21 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560786321.37.0.130085466377.issue34631@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14003
pull_request: https://github.com/python/cpython/pull/14161

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:48:02 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 15:48:02 +0000
Subject: [issue37288] Fix Windows build when --no-tkinter is specified
In-Reply-To: <1560555377.03.0.131397449861.issue37288@roundup.psfhosted.org>
Message-ID: <1560786482.98.0.219695050256.issue37288@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 79d8204c4f02d02b3c6570de94c85863c27ddecb by Miss Islington (bot) in branch '3.8':
bpo-37288: Fix Windows build when --no-tkinter is specified (GH-14096)
https://github.com/python/cpython/commit/79d8204c4f02d02b3c6570de94c85863c27ddecb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37288>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:49:05 2019
From: report at bugs.python.org (Matthew Cowles)
Date: Mon, 17 Jun 2019 15:49:05 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560786545.98.0.434321875145.issue37299@roundup.psfhosted.org>


Matthew Cowles <mdcowles at users.sourceforge.net> added the comment:

I disagree with the decision not to fix this bug. If a RuntimeWarning is warranted when a temporary variable is used, it's warranted when the value is used directly, without a temporary variable.

----------
nosy: +mdcowles

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:52:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 15:52:09 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560786729.64.0.112878526419.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> A look through `git log -p` looks like bpo-34646 is likely to be related.

New changeset e5024517811ee990b770fca0ba7058742d00e032 by Benjamin Peterson in branch 'master':
closes bpo-34646: Remove PyAPI_* macros from declarations. (GH-9218)
https://github.com/python/cpython/commit/e5024517811ee990b770fca0ba7058742d00e032

Extract of this change:

 
 #undef PyRun_String
-PyAPI_FUNC(PyObject *)
+PyObject *
 PyRun_String(const char *str, int s, PyObject *g, PyObject *l)
 {
     return PyRun_StringFlags(str, s, g, l, NULL);
 }
 

On Windows, this change removed dllexport from PyRun_String(). My PR 14142 adds it back, to pythonrun.h.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 11:53:53 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Mon, 17 Jun 2019 15:53:53 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560786833.95.0.779768685606.issue37297@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

The previous `_pickle.PicklingError` seems to only affect Windows.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:15:00 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 16:15:00 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560788100.56.0.471042974026.issue37189@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I haven't fully tested this, but a suitable test using ctypes might look like:

py = ctypes.PyDLL("", handle=sys.dllhandle)
missing = {name for name in EXPECTED_NAMES if not hasattr(py, name)}
# assert 'missing' is empty

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:15:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 16:15:07 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560788107.06.0.325490187294.issue33529@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14004
pull_request: https://github.com/python/cpython/pull/14162

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:22:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 16:22:02 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560788522.22.0.206882053688.issue33529@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

It's unclear to me if Python 3.5 is affected or not.

The fix changes the function _fold_as_ew(), Python 3.5 doesn't have this function *but* there is a call a _fold_as_ew() method!?

Lib/email/_header_value_parser.py:427: in _fold() method

            ...
            if is_ew or last_ew:
                # It's too big to fit on the line, but since we've
                # got encoded words we can use encoded word folding.
                part._fold_as_ew(folded)
                continue
            ...

If I backport the 2 tests, they fail *but* they don't hang forever (they complete in less than 1 second).

======================================================================
FAIL: test_fold_overlong_words_using_RFC2047 (test.test_email.test_headerregistry.TestFolding)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/vstinner/prog/python/3.5/Lib/test/test_email/test_headerregistry.py", line 1601, in test_fold_overlong_words_using_RFC2047
    'X-Report-Abuse: =?utf-8?q?=3Chttps=3A//www=2Emailitapp=2E'
AssertionError: 'X-Report-Abuse: <https://www.mailitapp.com/report_abuse.p[50 chars]x>\n' != 'X-Report-Abuse: =?utf-8?q?=3Chttps=3A//www=2Emailitapp=2E[114 chars]?=\n'
- X-Report-Abuse: <https://www.mailitapp.com/report_abuse.php?mid=xxx-xxx-xxxxxxxxxxxxxxxxxxxxxxxx==-xxx-xx-xx>
+ X-Report-Abuse: =?utf-8?q?=3Chttps=3A//www=2Emailitapp=2Ecom/report=5Fabuse?=
+  =?utf-8?q?=2Ephp=3Fmid=3Dxxx-xxx-xxxxxxxxxxxxxxxxxxxxxxxx=3D=3D-xxx-xx-xx?=
+  =?utf-8?q?=3E?=


======================================================================
FAIL: test_non_ascii_chars_do_not_cause_inf_loop (test.test_email.test_policy.PolicyAPITests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/vstinner/prog/python/3.5/Lib/test/test_email/test_policy.py", line 241, in test_non_ascii_chars_do_not_cause_inf_loop
    12 * ' =?utf-8?q?=C4=85?=\n')
AssertionError: 'Subject: =?utf-8?b?xIXEhcSFxIXEhcSFxIXEhcSFxIXEhcSF?=\n' != 'Subject: \n =?utf-8?q?=C4=85?=\n =?utf-8?q?=C4=85?[209 chars]?=\n'
- Subject: =?utf-8?b?xIXEhcSFxIXEhcSFxIXEhcSFxIXEhcSF?=
+ Subject: 
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=
+  =?utf-8?q?=C4=85?=

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:33:29 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 16:33:29 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560789209.84.0.381020118635.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset d8e3a8af775d683c606f3618d04f2be4e97ac3c0 by Steve Dower in branch '2.7':
bpo-34631: Updated OpenSSL to 1.0.2s in Windows installer (GH-14161)
https://github.com/python/cpython/commit/d8e3a8af775d683c606f3618d04f2be4e97ac3c0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:36:05 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 16:36:05 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560789365.03.0.874063925645.issue34631@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14005
pull_request: https://github.com/python/cpython/pull/14163

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:40:12 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 17 Jun 2019 16:40:12 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560789612.81.0.0599003218145.issue37295@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

FWIW, here's a rough implementation of (3).  It is limited to a specific range to avoid excess memory usage.  For comb(50_000, 25_000), it gives a three-fold speedup:

    if (k_long > 20 && k_long > n_long / 3 && n_long <= 100000) {
        PyObject *den = math_factorial(module, k);                 /* den = k! */
        temp = PyNumber_Subtract(n, k);
        Py_SETREF(temp, math_factorial(module, temp));
        Py_SETREF(den, PyNumber_Multiply(den, temp));              /* den *= (n - k)! */
        Py_DECREF(temp);
        Py_SETREF(result, math_factorial(module, n));              /* result = n! */
        Py_SETREF(result, PyNumber_FloorDivide(result, den));      /* result //= (n-k)! */
        Py_DECREF(den);
        return result;
    }

> Can the suggested performance improvements go into 3.8, or should they wait for 3.9?
> It's not clear to me whether a performance improvement after feature freeze is okay or not.

Historically, we've used the beta phase for optimizations, tweaking APIs, and improving docs.  However, I'm in no rush and this can easily wait for 3.9.

My only concern is that the other math functions, except for factorial(), have bounded running times and memory usage, so performance is more of a concern for this function which could end-up being an unexpected bottleneck or being a vector for a DOS attack.  That said, we haven't had any negative reports regarding factorial(), so this may be a low priority.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:40:56 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 17 Jun 2019 16:40:56 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560789656.16.0.777042418328.issue37111@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset ca7b504a4d4c3a5fde1ee4607b9501c2bab6e743 by Vinay Sajip in branch 'master':
bpo-37111: Add 'encoding' and 'errors' parameters to logging.basicCon? (GH-14008)
https://github.com/python/cpython/commit/ca7b504a4d4c3a5fde1ee4607b9501c2bab6e743


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:43:59 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 17 Jun 2019 16:43:59 +0000
Subject: [issue37111] Logging - Inconsistent behaviour when handling unicode
In-Reply-To: <1559296654.15.0.378802674413.issue37111@roundup.psfhosted.org>
Message-ID: <1560789839.8.0.970784732674.issue37111@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9 -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37111>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:46:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 16:46:31 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560789991.67.0.254788269876.issue33529@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 3.5 is not vulnerable, it doesn't hang on the following code:

import email.policy
policy = email.policy.default.clone(max_line_length=20)
actual = policy.fold('Subject', '\u0105' * 12)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:50:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 16:50:46 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560790246.63.0.88379697841.issue33529@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Python 2.7 doesn't have email.policy module.

For Python 2.7, I wrote this code:
---
import email.header
import email.message

msg = email.message.Message()
msg.set_charset("UTF-8")
msg['Subject'] = email.header.Header(u'\u0105' * 12, maxlinelen=20, charset="UTF-8")
print(msg.as_string())
---

I get this output:
---
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
Subject: =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=
 =?utf-8?b?xIU=?=


---

I have no idea if this example says that Python 2.7 is vulnerable or not. I get a different output on the master branch:
---
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
Subject: =?utf-8?b?xIXEhcSFxIXEhcSFxIXEhcSFxIXEhcSF?=


---

But I don't know if I use the email API properly. "Subject: =?utf-8?b?xIXEhcSFxIXEhcSFxIXEhcSFxIXEhcSF?=" is longer than 20 characters.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 12:56:10 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 17 Jun 2019 16:56:10 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560790570.24.0.404444206859.issue33529@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 13:02:13 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Mon, 17 Jun 2019 17:02:13 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560790933.37.0.0804351421166.issue37299@roundup.psfhosted.org>


YoSTEALTH <ritesh at stealthcentral.com> added the comment:

As far as i can tell "static analyzers" like flake8 and "type hints" like mypy does not detect this problem

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 13:23:43 2019
From: report at bugs.python.org (wim glenn)
Date: Mon, 17 Jun 2019 17:23:43 +0000
Subject: [issue30052] URL Quoting page links to function Bytes instead of
 defintion
In-Reply-To: <1492001374.68.0.411275444037.issue30052@psf.upfronthosting.co.za>
Message-ID: <1560792223.62.0.845141239898.issue30052@roundup.psfhosted.org>


wim glenn <wim.glenn at gmail.com> added the comment:

https://docs.python.org/3/library/functions.html

Usually the little paragraph icon appears when you hover over a function name, giving an anchor link. It's not doing it for bytes or bytearray. 

Was that an unintended consequence of disambiguation from the stdtypes html?

----------
nosy: +wim.glenn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30052>
_______________________________________

From report at bugs.python.org  Mon Jun 17 13:25:28 2019
From: report at bugs.python.org (wim glenn)
Date: Mon, 17 Jun 2019 17:25:28 +0000
Subject: [issue30052] URL Quoting page links to function Bytes instead of
 defintion
In-Reply-To: <1492001374.68.0.411275444037.issue30052@psf.upfronthosting.co.za>
Message-ID: <1560792328.89.0.635037340147.issue30052@roundup.psfhosted.org>


wim glenn <wim.glenn at gmail.com> added the comment:

This anchor works, by the way: 
 https://docs.python.org/3/library/functions.html#func-bytes

Hopefully someone more fluent in the docs syntax can figure out a way to fix the anchor-link hovers

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30052>
_______________________________________

From report at bugs.python.org  Mon Jun 17 13:49:23 2019
From: report at bugs.python.org (Myles Borins)
Date: Mon, 17 Jun 2019 17:49:23 +0000
Subject: [issue34875] Change .js mime to "text/javascript"
In-Reply-To: <1538519319.52.0.545547206417.issue34875@psf.upfronthosting.co.za>
Message-ID: <1560793763.75.0.861347656983.issue34875@roundup.psfhosted.org>


Myles Borins <mylesborins at google.com> added the comment:

Hey All,

I'd like to reopen this. We are almost done with the IETF standardization of .mjs, and part of this process is making obsolete application/javascript in favor of text/javascript.

--> https://datatracker.ietf.org/doc/draft-ietf-dispatch-javascript-mjs/

----------
resolution: rejected -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34875>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:18:26 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 17 Jun 2019 18:18:26 +0000
Subject: [issue37299] RuntimeWarning is NOT raised
In-Reply-To: <1560651750.57.0.52730011587.issue37299@roundup.psfhosted.org>
Message-ID: <1560795506.41.0.285059498223.issue37299@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

> If a RuntimeWarning is warranted when a temporary variable is used, it's warranted when the value is used directly, without a temporary variable.

No, it's not. If "1/0" is present in never executed code block Python don't raise an exception too. Warnings are not exceptional.

open() raises ResoucesWarning for an unclosed file only if the code is actually running.

If the code branch is not executed the Python runtime doesn't throw errors/warnings about its usage.


I'm sorry, mypy doesn't detect this. Potentially could maybe, though.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37299>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:18:28 2019
From: report at bugs.python.org (=?utf-8?q?=C5=81ukasz_Langa?=)
Date: Mon, 17 Jun 2019 18:18:28 +0000
Subject: [issue34556] Add --upgrade to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1560795508.27.0.287933614703.issue34556@roundup.psfhosted.org>


?ukasz Langa <lukasz at langa.pl> added the comment:


New changeset 4acdbf11b1fae1af24c47413a6caa593010d1b6f by ?ukasz Langa (Cooper Lees) in branch 'master':
bpo-34556: Add --upgrade-deps to venv module (#13100)
https://github.com/python/cpython/commit/4acdbf11b1fae1af24c47413a6caa593010d1b6f


----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:35:57 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 18:35:57 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560796557.15.0.600112463768.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

The tests seem to pass fine for 1.1.1c against master, so I'll merge that and see if the backport is also okay.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:36:13 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 18:36:13 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560796573.48.0.04823960971.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset a268edd6a411480281222b1fdb0f78053434d17f by Steve Dower in branch 'master':
bpo-34631: Updated OpenSSL to 1.1.1c in Windows installer (GH-14163)
https://github.com/python/cpython/commit/a268edd6a411480281222b1fdb0f78053434d17f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:36:45 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 18:36:45 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560796605.68.0.942382928225.issue34631@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14006
pull_request: https://github.com/python/cpython/pull/14164

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 14:58:04 2019
From: report at bugs.python.org (Zachary Ware)
Date: Mon, 17 Jun 2019 18:58:04 +0000
Subject: [issue37133] Erro "ffi.h: No such file" when build python 3.8 (branch
 master) on windows 10
In-Reply-To: <1559485272.43.0.308074768888.issue37133@roundup.psfhosted.org>
Message-ID: <1560797884.47.0.540250919951.issue37133@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

I'm unable to reproduce the problem.  If you're still having issues, please reopen the issue with more details about what exactly you did and the error(s) you saw (preferably copied and pasted into a message).

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37133>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:02:13 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 19:02:13 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560798133.19.0.103113944828.issue28869@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The problem is that __module__ is deduced from the caller's frame in type.__new__(). In case if type.__new__() is called directly, __module__ is set to the name of the module where type.__new__() is called. So virtually every type subclass which defines the __new__ method and calls type.__new__() inside it starves from the same issue.

It can be fixed in general if deduce __module__ in type.__call__() instead of type.__new__().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:10:31 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 19:10:31 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560798631.48.0.284928663758.issue34631@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14007
pull_request: https://github.com/python/cpython/pull/14165

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:10:42 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 19:10:42 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560798642.98.0.696610959875.issue28869@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +14008
pull_request: https://github.com/python/cpython/pull/14166

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:25:21 2019
From: report at bugs.python.org (Big Stone)
Date: Mon, 17 Jun 2019 19:25:21 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560799521.37.0.295740882118.issue35360@roundup.psfhosted.org>


Big Stone <stonebig34 at gmail.com> added the comment:

on my test cases, sqlite_bro and baresql, db.py , it works without problems.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:41:21 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 19:41:21 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560800481.11.0.891414702498.issue37039@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 5bff3c86ab77e9d831b3cd19b45654c7eef22931 by Terry Jan Reedy (Tal Einat) in branch 'master':
bpo-37039: Make IDLE's Zoom Height adjust to users' screens (GH-13678)
https://github.com/python/cpython/commit/5bff3c86ab77e9d831b3cd19b45654c7eef22931


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:49:04 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 19:49:04 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560800944.72.0.867400184581.issue37039@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14009
pull_request: https://github.com/python/cpython/pull/14167

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:52:07 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 19:52:07 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560801127.71.0.344066062958.issue37039@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14010
pull_request: https://github.com/python/cpython/pull/14168

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:52:35 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 17 Jun 2019 19:52:35 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
Message-ID: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>


New submission from Serhiy Storchaka <storchaka+cpython at gmail.com>:

Unlike other range()-like functions random.randrange() accepts not only integers and integer-like objects (implementing __index__), but any numbers with integral values, like 3.0 or Decimal(3). In 3.8 using __int__ for implicit converting to C integers were deprecated, and likely will be forbidden in 3.9. __index__ is now preferable.

I propose to deprecate accepting non-integer arguments in random.randrange() and use __index__ instead of __int__ for converting values. At end it will lead to simpler and faster code. Instead of

        istart = _int(start)
        if istart != start:
            raise ValueError("non-integer arg 1 for randrange()")

we could use just

        start = _index(start)

It will help also in converting the randrange() implementation to C.

See also issue37315.

----------
components: Library (Lib)
messages: 345892
nosy: mark.dickinson, rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Deprecate using random.randrange() with non-integers
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:54:28 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 19:54:28 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560801268.84.0.186844081072.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset c28c1358245b9fe42e9559c34eae01befce73a1f by Steve Dower (Miss Islington (bot)) in branch '3.8':
bpo-34631: Updated OpenSSL to 1.1.1c in Windows installer (GH-14163)
https://github.com/python/cpython/commit/c28c1358245b9fe42e9559c34eae01befce73a1f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 15:54:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 19:54:46 +0000
Subject: [issue37320] aifc, sunau, wave: remove deprecated openfp() function
Message-ID: <1560801286.41.0.0905607754393.issue37320@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The openfp() function of aifc, sunau, wave is an alias to the open() function of each module and is deprecated since Python 3.7.

Attached PR removes it.

----------
components: Library (Lib)
messages: 345894
nosy: vstinner
priority: normal
severity: normal
status: open
title: aifc, sunau, wave: remove deprecated openfp() function
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37320>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:06:43 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 20:06:43 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560802003.94.0.352116773716.issue37039@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0f31a2d3e85d3644de30626a00439ab3c7424105 by Miss Islington (bot) in branch '3.7':
bpo-37039: Make IDLE's Zoom Height adjust to users' screens (GH-13678)
https://github.com/python/cpython/commit/0f31a2d3e85d3644de30626a00439ab3c7424105


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:11:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:11:27 +0000
Subject: [issue37320] aifc, sunau, wave: remove deprecated openfp() function
In-Reply-To: <1560801286.41.0.0905607754393.issue37320@roundup.psfhosted.org>
Message-ID: <1560802287.0.0.756023263537.issue37320@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14011
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14169

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37320>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:12:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:12:59 +0000
Subject: [issue31985] Deprecate openfp() in aifc, sunau and wave
In-Reply-To: <1510178196.39.0.213398074469.issue31985@psf.upfronthosting.co.za>
Message-ID: <1560802379.76.0.147323442195.issue31985@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created bpo-37320: "aifc, sunau, wave: remove deprecated openfp() function".

----------
nosy: +vstinner
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31985>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:13:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:13:34 +0000
Subject: [issue37320] aifc, sunau, wave: remove deprecated openfp() function
In-Reply-To: <1560801286.41.0.0905607754393.issue37320@roundup.psfhosted.org>
Message-ID: <1560802414.57.0.223138807009.issue37320@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

openfp() functions were deprecated by bpo-31985.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37320>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:14:20 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 20:14:20 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
Message-ID: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

A Subprocess Connection Error (new consistent name) can be displayed by either the user or IDLE process (run and pyshell modules). The latter is much more common.  Only the former was updated to refer to the newish doc section.  Update the latter also.  Otherwise, make more consistent.  (May someday combine into one function.)

----------
assignee: terry.reedy
components: IDLE
messages: 345898
nosy: terry.reedy
priority: normal
severity: normal
stage: needs patch
status: open
title: IDLE: Make Subprocess Connection Errors consistent.
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:15:57 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 20:15:57 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560802557.05.0.554328727063.issue37039@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 4b68a8eb0df7317d6c57b021d40cc0b31e3f1cd3 by Terry Jan Reedy (Miss Islington (bot)) in branch '3.8':
bpo-37039: Make IDLE's Zoom Height adjust to users' screens (GH-13678) (GH-14168)
https://github.com/python/cpython/commit/4b68a8eb0df7317d6c57b021d40cc0b31e3f1cd3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:17:35 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 20:17:35 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560802655.12.0.782271263622.issue37039@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Thank you Andre for the reports and followup and Tal for the research.  I can start using this now.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:30:57 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 20:30:57 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560803457.75.0.681218687542.issue35360@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I just pushed sources with tag sqlite-3.28.0.0, so now anybody should be able to submit a CPython PR for it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:32:18 2019
From: report at bugs.python.org (Tal Einat)
Date: Mon, 17 Jun 2019 20:32:18 +0000
Subject: [issue37039] IDLE: Improve zoomheight doc and behavior.
In-Reply-To: <1558749886.9.0.817731232242.issue37039@roundup.psfhosted.org>
Message-ID: <1560803538.34.0.344627400586.issue37039@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

Hey, I did the implementation too! :)

I'm really happy to see this fixed in time for 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37039>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:35:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:35:34 +0000
Subject: [issue37322] test_ssl: test_pha_required_nocert() emits a
 ResourceWarning
Message-ID: <1560803734.85.0.206698450732.issue37322@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

vstinner at apu$ ./python -X tracemalloc=10 -m test --fail-env-changed -v test_ssl -m test_pha_required_nocert
== CPython 3.9.0a0 (heads/master-dirty:00f6493084, Jun 17 2019, 21:50:32) [GCC 9.1.1 20190503 (Red Hat 9.1.1-1)]
== Linux-5.1.6-300.fc30.x86_64-x86_64-with-glibc2.29 little-endian
== cwd: /home/vstinner/prog/python/master/build/test_python_23407
== CPU count: 8
== encodings: locale=UTF-8, FS=utf-8
Run tests sequentially
0:00:00 load avg: 0.58 [1/1] test_ssl
test_ssl: testing with 'OpenSSL 1.1.1c FIPS  28 May 2019' (1, 1, 1, 3, 15)
          under 'Linux-5.1.6-300.fc30.x86_64-x86_64-with-glibc2.29'
          HAS_SNI = True
          OP_ALL = 0x80000054
          OP_NO_TLSv1_1 = 0x10000000
test_pha_required_nocert (test.test_ssl.TestPostHandshakeAuth) ... Exception in thread Thread-2:
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_ssl.py", line 2287, in run
    msg = self.read()
  File "/home/vstinner/prog/python/master/Lib/test/test_ssl.py", line 2264, in read
    return self.sslconn.read()
  File "/home/vstinner/prog/python/master/Lib/ssl.py", line 1090, in read
    return self._sslobj.read(len)
ssl.SSLError: [SSL: PEER_DID_NOT_RETURN_A_CERTIFICATE] peer did not return a certificate (_ssl.c:2540)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/threading.py", line 938, in _bootstrap_inner
    self.run()
  File "/home/vstinner/prog/python/master/Lib/test/test_ssl.py", line 2373, in run
    raise ssl.SSLError('tlsv13 alert certificate required')
ssl.SSLError: ('tlsv13 alert certificate required',)
/home/vstinner/prog/python/master/Lib/threading.py:938: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 53571), raddr=('127.0.0.1', 34676)>
  self.run()
Object allocated at (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/threading.py", lineno 896
    self._bootstrap_inner()
  File "/home/vstinner/prog/python/master/Lib/threading.py", lineno 938
    self.run().
  File "/home/vstinner/prog/python/master/Lib/test/test_ssl.py", lineno 2283
    if not self.wrap_conn():
  File "/home/vstinner/prog/python/master/Lib/test/test_ssl.py", lineno 2207
    self.sslconn = self.server.context.wrap_socket(
  File "/home/vstinner/prog/python/master/Lib/ssl.py", lineno 489
    return self.sslsocket_class._create(
  File "/home/vstinner/prog/python/master/Lib/ssl.py", lineno 992
    self = cls.__new__(cls, **kwargs)
ok

----------------------------------------------------------------------

Ran 1 test in 0.100s

OK

== Tests result: SUCCESS ==

1 test OK.

Total duration: 1 sec 430 ms
Tests result: SUCCESS


The test fails using -Werror.

----------
components: Tests
messages: 345903
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_ssl: test_pha_required_nocert() emits a ResourceWarning
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37322>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:37:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:37:03 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
Message-ID: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

vstinner at apu$ PYTHONWARNINGS=error ./python -Werror -m test -v test_asyncio -m test_debug_mode_interop
== CPython 3.9.0a0 (heads/master-dirty:00f6493084, Jun 17 2019, 21:50:32) [GCC 9.1.1 20190503 (Red Hat 9.1.1-1)]
== Linux-5.1.6-300.fc30.x86_64-x86_64-with-glibc2.29 little-endian
== cwd: /home/vstinner/prog/python/master/build/test_python_23510
== CPU count: 8
== encodings: locale=UTF-8, FS=utf-8
Run tests sequentially
0:00:00 load avg: 0.73 [1/1] test_asyncio
test_debug_mode_interop (test.test_asyncio.test_tasks.CompatibilityTests) ... FAIL

======================================================================
FAIL: test_debug_mode_interop (test.test_asyncio.test_tasks.CompatibilityTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_asyncio/test_tasks.py", line 3355, in test_debug_mode_interop
    assert_python_ok("-c", code, PYTHONASYNCIODEBUG="1")
  File "/home/vstinner/prog/python/master/Lib/test/support/script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "/home/vstinner/prog/python/master/Lib/test/support/script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "/home/vstinner/prog/python/master/Lib/test/support/script_helper.py", line 70, in fail
    raise AssertionError("Process return code is %d\n"
AssertionError: Process return code is 1
command line: ['/home/vstinner/prog/python/master/python', '-X', 'faulthandler', '-c', '\nimport asyncio\n\nasync def native_coro():\n    pass\n\n at asyncio.coroutine\ndef old_style_coro():\n    yield from native_coro()\n\nasyncio.run(old_style_coro())\n']

stdout:
---

---

stderr:
---
Traceback (most recent call last):
  File "<string>", line 8, in <module>
  File "/home/vstinner/prog/python/master/Lib/asyncio/coroutines.py", line 111, in coroutine
    warnings.warn('"@coroutine" decorator is deprecated since Python 3.8, use "async def" instead',
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
---

----------------------------------------------------------------------

Ran 1 test in 0.210s

FAILED (failures=1)
test test_asyncio failed
test_asyncio failed

== Tests result: FAILURE ==

1 test failed:
    test_asyncio

Total duration: 598 ms
Tests result: FAILURE

----------
components: Tests
messages: 345904
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_asyncio: test_debug_mode_interop() fails using -Werror
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:38:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:38:32 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
Message-ID: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Extract of collections documentation:
https://docs.python.org/dev/library/collections.html

"Deprecated since version 3.3, will be removed in version 3.9: Moved Collections Abstract Base Classes to the collections.abc module. For backwards compatibility, they continue to be visible in this module through Python 3.8."

Attached PR removes these aliases.

----------
components: Library (Lib)
messages: 345905
nosy: vstinner
priority: normal
severity: normal
status: open
title: collections: remove deprecated aliases to ABC classes
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:42:24 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 20:42:24 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560804144.37.0.0228895207958.issue37321@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +14012
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14170

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:44:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:44:53 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
In-Reply-To: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>
Message-ID: <1560804293.81.0.39696229765.issue37324@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14013
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14171

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:47:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:47:06 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
In-Reply-To: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>
Message-ID: <1560804426.85.0.0358435124123.issue37324@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

pip is broken by this change, causing test_venv to fail: html5lib still uses collections to get ABC.

FAIL: test_with_pip (test.test_venv.EnsurePipTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_venv.py", line 407, in do_test_with_pip
    self.run_with_capture(venv.create, self.env_dir,
  File "/home/vstinner/prog/python/master/Lib/test/test_venv.py", line 69, in run_with_capture
    func(*args, **kwargs)
subprocess.CalledProcessError: Command '['/tmp/tmpkxga42lx/bin/python', '-Im', 'ensurepip', '--upgrade', '--default-pip']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/test/test_venv.py", line 466, in test_with_pip
    self.do_test_with_pip(False)
  File "/home/vstinner/prog/python/master/Lib/test/test_venv.py", line 415, in do_test_with_pip
    self.fail(msg.format(exc, details))
AssertionError: Command '['/tmp/tmpkxga42lx/bin/python', '-Im', 'ensurepip', '--upgrade', '--default-pip']' returned non-zero exit status 1.

**Subprocess Output**
/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/pyparsing.py:3068: SyntaxWarning: invalid escape sequence \w
Traceback (most recent call last):
  File "/home/vstinner/prog/python/master/Lib/runpy.py", line 192, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/vstinner/prog/python/master/Lib/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/vstinner/prog/python/master/Lib/ensurepip/__main__.py", line 5, in <module>
    sys.exit(ensurepip._main())
  File "/home/vstinner/prog/python/master/Lib/ensurepip/__init__.py", line 198, in _main
    return _bootstrap(
  File "/home/vstinner/prog/python/master/Lib/ensurepip/__init__.py", line 117, in _bootstrap
    return _run_pip(args + [p[0] for p in _PROJECTS], additional_paths)
  File "/home/vstinner/prog/python/master/Lib/ensurepip/__init__.py", line 27, in _run_pip
    import pip._internal
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/__init__.py", line 40, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/cli/autocompletion.py", line 8, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/cli/main_parser.py", line 12, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/commands/__init__.py", line 6, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/commands/completion.py", line 6, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/cli/base_command.py", line 25, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_internal/index.py", line 14, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/__init__.py", line 25, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/html5parser.py", line 8, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_tokenizer.py", line 16, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_trie/__init__.py", line 3, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_trie/py.py", line 6, in <module>
  File "<frozen zipimport>", line 259, in load_module
  File "/tmp/tmpwhk_ss_e/pip-19.0.3-py2.py3-none-any.whl/pip/_vendor/html5lib/_trie/_base.py", line 3, in <module>
ImportError: cannot import name 'Mapping' from 'collections' (/home/vstinner/prog/python/master/Lib/collections/__init__.py)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:50:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:50:02 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1560804602.3.0.641265473536.issue37323@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

def test_debug_mode_interop(self):
        # https://bugs.python.org/issue32636
        code = textwrap.dedent("""
            import asyncio

            async def native_coro():
                pass

            @asyncio.coroutine
            def old_style_coro():
                yield from native_coro()

            asyncio.run(old_style_coro())
        """)
        assert_python_ok("-c", code, PYTHONASYNCIODEBUG="1")

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Mon Jun 17 16:54:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 20:54:20 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
In-Reply-To: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>
Message-ID: <1560804860.88.0.0046498750457.issue37324@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

html5lib has already been fixed:
https://github.com/vstinner/html5lib-python/commit/4f9235752cea29c5a31721440578b430823a1e69

But latest html5lib release was version 1.0.1 at... Dec 7, 2017 :-(

Paul Ganssle requested a new html5lib release... to fix the collections warning :-)
https://github.com/html5lib/html5lib-python/issues/419

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:00:10 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 17 Jun 2019 21:00:10 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560805210.22.0.5068392306.issue35360@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:01:20 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 17 Jun 2019 21:01:20 +0000
Subject: [issue37297] function changed when pickle bound method object
In-Reply-To: <1560649257.15.0.526142047149.issue37297@roundup.psfhosted.org>
Message-ID: <1560805280.92.0.530008333613.issue37297@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37297>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:07:03 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 17 Jun 2019 21:07:03 +0000
Subject: [issue37287] picke cannot dump Exception subclasses with different
 super() args
In-Reply-To: <1560555045.5.0.822054090592.issue37287@roundup.psfhosted.org>
Message-ID: <1560805623.74.0.338943439312.issue37287@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

possibly related to https://bugs.python.org/issue32696 and https://bugs.python.org/issue1692335.

----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37287>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:17:27 2019
From: report at bugs.python.org (Brett Cannon)
Date: Mon, 17 Jun 2019 21:17:27 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1560806247.42.0.0719017297857.issue19696@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Anything zipimport-related should stay separate as zipimport is not a part of importlib. The other three will have to be looked at to see what exactly they are testing to know whether they relate to importlib and the implementation of import or not (my guess is yes).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:21:07 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 21:21:07 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560806467.55.0.778637154388.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Ned - the 3.7 backport seems to be okay (PR 14165). Do we want it?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:23:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 21:23:38 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560806618.52.0.583357954676.issue37321@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 8fac1221097aaf6ac37ed9ea727ee7892085e183 by Terry Jan Reedy in branch 'master':
 bpo-37321: Edit IDLE subprocess connection error messages. (#14170)
https://github.com/python/cpython/commit/8fac1221097aaf6ac37ed9ea727ee7892085e183


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:24:05 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 21:24:05 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560806645.22.0.842358357432.issue37321@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14014
pull_request: https://github.com/python/cpython/pull/14173

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:24:14 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 21:24:14 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560806654.04.0.211673312129.issue37321@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14015
pull_request: https://github.com/python/cpython/pull/14174

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:24:52 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 17 Jun 2019 21:24:52 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1560806692.09.0.426590251381.issue37323@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

It affects 3.8 as well since https://github.com/python/cpython/pull/13346 was merged and I guess the fix would be to wrap it with assertWarns(DeprecationWarning) context manager like other tests. Interesting, does PYTHONWARNINGS=error affects the interpreter spawn by assert_python_ok to change warnings level which -Werror doesn't do by itself?

----------
components: +asyncio
nosy: +asvetlov, xtreak, yselivanov
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:29:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 21:29:28 +0000
Subject: [issue37120] Provide knobs to disable session ticket generation on
 TLS 1.3
In-Reply-To: <1559365529.23.0.311490427939.issue37120@roundup.psfhosted.org>
Message-ID: <1560806968.91.0.381503682557.issue37120@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

New changeset 78c7d527799dacca91b9ed67057cb996efe526b0 by Christian Heimes in branch 'master':
bpo-37120: Add SSLContext.num_tickets (GH-13719)
https://github.com/python/cpython/commit/78c7d527799dacca91b9ed67057cb996efe526b0


This change introduced this warning on Windows:

c:\vstinner\python\master\modules\_ssl.c(3624): warning C4267: 'function': conv 
ersion from 'size_t' to 'long', possible loss of data [C:\vstinner\python\maste 
r\PCbuild\_ssl.vcxproj]


SSL_CTX_get_num_tickets() return type is size_t. I suggest this change:


diff --git a/Modules/_ssl.c b/Modules/_ssl.c
index 2331c58ad7..3ffb6380d3 100644
--- a/Modules/_ssl.c
+++ b/Modules/_ssl.c
@@ -3621,7 +3621,7 @@ set_maximum_version(PySSLContext *self, PyObject *arg, void *c)
 static PyObject *
 get_num_tickets(PySSLContext *self, void *c)
 {
-    return PyLong_FromLong(SSL_CTX_get_num_tickets(self->ctx));
+    return PyLong_FromSize_t(SSL_CTX_get_num_tickets(self->ctx));
 }
 
 static int

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37120>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:29:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 21:29:53 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560806993.35.0.710998456313.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I tested the following code:
---
import ctypes, sys 
names = """
PyRun_String
PyRun_AnyFile
PyRun_AnyFileEx
PyRun_AnyFileFlags
PyRun_SimpleString
PyRun_SimpleFile
PyRun_SimpleFileEx
PyRun_InteractiveOne
PyRun_InteractiveLoop
PyRun_File
PyRun_FileEx
PyRun_FileFlags
"""
api = ctypes.pythonapi
api2 = ctypes.PyDLL("", handle=sys.dllhandle)
for name in names.split():
    if not hasattr(api, name) or not hasattr(api2, name):
        print("MISSING NAME", name)
---

Current output:

Missing names ['PyRun_AnyFile', 'PyRun_AnyFileEx', 'PyRun_File', 'PyRun_FileEx',
 'PyRun_FileFlags', 'PyRun_InteractiveLoop', 'PyRun_InteractiveOne', 'PyRun_Simp
leFile', 'PyRun_SimpleFileEx', 'PyRun_SimpleString', 'PyRun_String']

With my PR 14142:

Missing names []

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:31:09 2019
From: report at bugs.python.org (Michael Blahay)
Date: Mon, 17 Jun 2019 21:31:09 +0000
Subject: [issue35495] argparse does not honor default argument for
 nargs=argparse.REMAINDER argument
In-Reply-To: <1544803180.32.0.788709270274.issue35495@psf.upfronthosting.co.za>
Message-ID: <1560807069.54.0.537398021095.issue35495@roundup.psfhosted.org>


Michael Blahay <mblahay at gmail.com> added the comment:

Need some help searching github to determine the blast radius of the proposed changes. How does one look for instances of argparse.REMAINDER that are used with a default value?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35495>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:50:52 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 21:50:52 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560808252.33.0.284404047616.issue37321@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 336cf399546f3362033f9d2b475feae050373ef8 by Miss Islington (bot) in branch '3.7':
bpo-37321: Edit IDLE subprocess connection error messages. (GH-14170)
https://github.com/python/cpython/commit/336cf399546f3362033f9d2b475feae050373ef8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:51:12 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 21:51:12 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560808272.0.0.473382199626.issue37321@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 02f7f741e83c018015eb8fcb95bd592c1787fe5f by Miss Islington (bot) in branch '3.8':
bpo-37321: Edit IDLE subprocess connection error messages. (GH-14170)
https://github.com/python/cpython/commit/02f7f741e83c018015eb8fcb95bd592c1787fe5f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:51:30 2019
From: report at bugs.python.org (Eryk Sun)
Date: Mon, 17 Jun 2019 21:51:30 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560808290.38.0.501633872532.issue37189@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> api = ctypes.pythonapi
> api2 = ctypes.PyDLL("", handle=sys.dllhandle)

Those should be the same. In Windows, pythonapi is defined as PyDLL("python dll", None, sys.dllhandle). 

Wouldn't it be better to add a function to _testcapi that checks GetProcAddress(PyWin_DLLhModule, name)?

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:53:04 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Mon, 17 Jun 2019 21:53:04 +0000
Subject: [issue37321] IDLE: Make Subprocess Connection Errors consistent.
In-Reply-To: <1560802460.36.0.0153945253902.issue37321@roundup.psfhosted.org>
Message-ID: <1560808384.3.0.224291772455.issue37321@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

New code tested by copying into a temporary test fixture.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37321>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:53:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 21:53:39 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1560808419.07.0.514458584791.issue37166@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

inspect.getsource() starts with linecache.checkcache(file) which if the file modification time changed or if the file size changed. Using regular files on disk, I don't see how this bug is possible:


$ cat x.py 
import inspect
import os
import linecache






def foo(): pass

filename = __file__
linecache.getlines(filename)

if 1:
    stat = os.stat(filename)
    atime = stat.st_atime
    mtime = stat.st_mtime
    with open(filename, "w+") as fp:
        lines = [line for line in fp if line.strip()]
        fp.seek(0)
        fp.writelines(lines)
    os.utime(filename, (atime, mtime))

print(inspect.getsource(foo))

vstinner at apu$ /bin/cp x.py y.py; ./python y.py
Traceback (most recent call last):
  File "y.py", line 25, in <module>
  File "/home/vstinner/prog/python/master/Lib/inspect.py", line 985, in getsource
    lines, lnum = getsourcelines(object)
  File "/home/vstinner/prog/python/master/Lib/inspect.py", line 967, in getsourcelines
    lines, lnum = findsource(object)
  File "/home/vstinner/prog/python/master/Lib/inspect.py", line 798, in findsource
    raise OSError('could not get source code')
OSError: could not get source code


Does this bug only affect Facebook who use "compile the application into an executable package (.par)"?
https://github.com/python/cpython/pull/13850#pullrequestreview-249815779

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:55:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 21:55:26 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1560808526.32.0.689179371321.issue37166@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If the file content changed, I'm not sure that the folloing heuristic will always find the expected function:

        lnum = object.co_firstlineno - 1
        pat = re.compile(r'^(\s*def\s)|(\s*async\s+def\s)|(.*(?<!\w)lambda(:|\s))|^(\s*@)')
        while lnum > 0:
            if pat.match(lines[lnum]): break
            lnum = lnum - 1
        return lines, lnum

The regex doesn't search for the function name.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Mon Jun 17 17:58:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 21:58:35 +0000
Subject: [issue37324] collections: remove deprecated aliases to ABC classes
In-Reply-To: <1560803912.16.0.0813723259969.issue37324@roundup.psfhosted.org>
Message-ID: <1560808715.16.0.969414128454.issue37324@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh. I wasn't aware of the previous attempt: https://github.com/python/cpython/pull/10596 there is a long discussion there. The blocker issue was also html5lib.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37324>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:00:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:00:29 +0000
Subject: [issue37320] aifc, sunau, wave: remove deprecated openfp() function
In-Reply-To: <1560801286.41.0.0905607754393.issue37320@roundup.psfhosted.org>
Message-ID: <1560808829.61.0.499062362193.issue37320@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ac7b1a3f32cc81520e8962352294006d65744028 by Victor Stinner in branch 'master':
bpo-37320: Remove openfp() of aifc, sunau and wave (GH-14169)
https://github.com/python/cpython/commit/ac7b1a3f32cc81520e8962352294006d65744028


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37320>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:01:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:01:18 +0000
Subject: [issue37320] aifc, sunau, wave: remove deprecated openfp() function
In-Reply-To: <1560801286.41.0.0905607754393.issue37320@roundup.psfhosted.org>
Message-ID: <1560808878.74.0.407956759593.issue37320@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If your code uses openfp(): just use open() instead ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37320>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:02:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:02:26 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560808946.71.0.72196626254.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

"Those should be the same."

Well, I wasn't 100% sure so I tested both. At least, I can now confirm that missing symbols are now exposed in both :-D

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:07:56 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 17 Jun 2019 22:07:56 +0000
Subject: [issue37318] builtins.True exists but can't be accessed
In-Reply-To: <1560784622.94.0.240402132833.issue37318@roundup.psfhosted.org>
Message-ID: <1560809276.92.0.542204311391.issue37318@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Depending on your mental model of the language, this may not seem odd at all.

>>> # We can set any key/value pair in any dictionary
>>> d = {'x': 10, 'True': 20, 'for': 30}

>>> # We can do regular string lookups at any time
>>> d['x']
10
>>> d['True']
20
>>> d['for']
30

>>> # globals() isn't special in this regard
>>> globals().update(d)
>>> globals()['x']
10
>>> globals()['True']
20
>>> globals()['for']
30

>>> # Globals is special though in that it provides
>>> # a fast way to do lookups for keys that are
>>> # valid identifiers and are not keywords
>>> x              # Fast lookup equivalent to globals['x']
10
>>> True           # This is a keyword, so there is no lookup
True
>>> for            # This is a keyword, so there is no lookup
SyntaxError: invalid syntax
    
At any rate, this isn't a bug.  It is just the way the language works.

Thank you for the report.

----------
nosy: +rhettinger
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37318>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:10:24 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 22:10:24 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560809424.17.0.0529256904058.issue37189@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Ah, that's what ctypes.pythonapi is :) I looked at PyDLL first and figured it out from there.

Should we add a regression test to avoid this happening in the future?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:15:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:15:16 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560809716.55.0.469639145958.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 343ed0ffe0d5ddd4f17c31e14a656a04ac7dfc19 by Victor Stinner in branch 'master':
bpo-37189: Export old PyRun_XXX() functions (#14142)
https://github.com/python/cpython/commit/343ed0ffe0d5ddd4f17c31e14a656a04ac7dfc19


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:15:24 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 22:15:24 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560809724.74.0.0297299864593.issue37189@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14016
pull_request: https://github.com/python/cpython/pull/14177

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:18:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:18:19 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560809899.24.0.483438456559.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Should we add a regression test to avoid this happening in the future?

I'm not sure where to add such test, nor which kind of test is needed. I mean, should we only test that the symbol is present? Or should we also test the ABI? Or even write a functional test?

Since I didn't know, I just merged my fix, to make sure that it lands before 3.8beta2.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:19:00 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 17 Jun 2019 22:19:00 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560809940.87.0.721776265515.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My notes on checking an ABI:
https://pythoncapi.readthedocs.io/stable_abi.html#check-for-abi-changes

I didn't check if https://abi-laboratory.pro/tracker/timeline/python/ supports Windows or not.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:22:05 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 17 Jun 2019 22:22:05 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560810125.23.0.835841097784.issue34631@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Might as well, thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:26:46 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 22:26:46 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560810406.37.0.956581223655.issue34631@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 14bac0088271d0a5c428e3468ef94fe7c73e93f7 by Steve Dower in branch '3.7':
bpo-34631: Updated OpenSSL to 1.1.1c in Windows installer (GH-14163)
https://github.com/python/cpython/commit/14bac0088271d0a5c428e3468ef94fe7c73e93f7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:42:33 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 17 Jun 2019 22:42:33 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560811353.31.0.677533757082.issue37189@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8cb8d5de4bcc587b35d1b2f4166dad98c202805c by Miss Islington (bot) in branch '3.8':
bpo-37189: Export old PyRun_XXX() functions (GH-14142)
https://github.com/python/cpython/commit/8cb8d5de4bcc587b35d1b2f4166dad98c202805c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Mon Jun 17 18:50:46 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 17 Jun 2019 22:50:46 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1560811846.91.0.649239678128.issue37319@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

While there isn't anything intrinsically wrong with using index(), the premise of this issue is essentially a claim that most Python code that uses int() is wrong.  That seems rather bold and flies in the face of common practices.  I don't really like the trend of constantly rearranging code in awkward ways to solve problems that no one actually has.

Also, I disagree with the notion that the downstream functions in the random module should be written in C.  That makes them more bug prone and opaque (like when Victor broken seeding for 3.6.0).  The trend for rewriting in C should be restricted to core building blocks like the underlying Mersenne Twister.  Otherwise, we have to do dual maintenance for years and essentially advertise to people that we don't think our own language is good enough to use.  Over time, I am less and less able to show people standard library code as it has become complexified with coding strategies well beyond the norms of day to day Python programmers.  ISTM that most proposals to rewrite something in C come from folks who like rewriting things in C rather than from users or from people who do long term maintenance of the modules.  Sidenote: we're now getting new core devs who don't read or write C, so each transformation like them excludes their ability to participate).

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Mon Jun 17 19:00:25 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 17 Jun 2019 23:00:25 +0000
Subject: [issue37245] Azure Pipeline 3.8 CI: multiple tests hung and timed out
 on macOS 10.13
In-Reply-To: <1560340622.3.0.842050597369.issue37245@roundup.psfhosted.org>
Message-ID: <1560812425.03.0.475731507024.issue37245@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I'm still seeing this, maybe 1 in 20 builds, so it's semi-random. A new deadlock, maybe?

----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37245>
_______________________________________

From report at bugs.python.org  Mon Jun 17 19:06:33 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Mon, 17 Jun 2019 23:06:33 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1560812793.07.0.358321509665.issue37319@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

We probably should not do this until we're willing to give PEP 8 guidance recommending operator.index() as preferable to int() for all cases needing integer offsets.  Maybe we do want to go down that path or maybe we just stick with "practicality beats purity" and not create any new learning issues.  The int() function is popular and understandable, but it is rare to find a user who knows and cares about index().  ISTM that randrange(3.0) isn't a problem in real life.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Mon Jun 17 20:14:04 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 00:14:04 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560816844.77.0.471671015224.issue33529@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 516a6a254814d2bc6a90290dfc44d77fdfb4050b by Ned Deily (Victor Stinner) in branch '3.6':
bpo-33529, email: Fix infinite loop in email header encoding (GH-12020) (GH-14162)
https://github.com/python/cpython/commit/516a6a254814d2bc6a90290dfc44d77fdfb4050b


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Mon Jun 17 20:52:21 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 00:52:21 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560819141.89.0.575749784012.issue35360@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
keywords: +patch
pull_requests: +14017
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14179

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 21:01:15 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 01:01:15 +0000
Subject: [issue35360] Update SQLite to 3.26 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560819675.15.0.283980354231.issue35360@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
pull_requests: +14018
pull_request: https://github.com/python/cpython/pull/14180

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 21:29:18 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 01:29:18 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560821358.22.0.229529240205.issue35360@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

PR 14179 is for Windows build
PR 14180 is for Mac OS X build

Both update to Sqlite 3.28.0

----------
title: Update SQLite to 3.26 in Windows and macOS installer builds -> Update SQLite to 3.28 in Windows and macOS installer builds

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 21:56:26 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 01:56:26 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560822986.01.0.938980794027.issue35360@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
pull_requests: +14019
pull_request: https://github.com/python/cpython/pull/14182

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:04:59 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 02:04:59 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560823499.57.0.442057471869.issue35360@roundup.psfhosted.org>


Change by Ma Lin <malincns at 163.com>:


----------
pull_requests: +14020
pull_request: https://github.com/python/cpython/pull/14183

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:07:12 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 02:07:12 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
Message-ID: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>


New submission from Terry J. Reedy <tjreedy at udel.edu>:

query.Query creates a popup with entry and ok/cancel buttons, in that order.  Tabbing moves from the entry in that order.  Currently, subclasses that add widgets add them after the 3 above, so they follow Cancel in the tab order.  They do this by overriding create_widgets and initially calling super.create_widgets.

Added widgets should follow the entry box and precede the exit buttons.  To do this, they should be created in between.  Proposed solution: create_widgets calls 'extra_widgets' (pass for Query) after creating the Entry.  Subclasses override to add widgets.

----------
assignee: terry.reedy
components: IDLE
messages: 345940
nosy: terry.reedy
priority: normal
severity: normal
stage: test needed
status: open
title: IDLE: fix Query subclass tab focus traversal order
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:07:16 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 02:07:16 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560823636.05.0.0321046357115.issue35360@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

2.7 branch:

PR 14182 is for Windows build
PR 14183 is for Mac OS X build

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:24:27 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 02:24:27 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560824667.65.0.226073907348.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 201bc2d18b60adb05810d2a6ab396047bc527088 by Terry Jan Reedy (Cheryl Sabella) in branch 'master':
bpo-5680: IDLE: Customize running a module (GH-13763)
https://github.com/python/cpython/commit/201bc2d18b60adb05810d2a6ab396047bc527088


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:24:56 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 02:24:56 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560824696.31.0.870986756754.issue5680@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14021
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14184

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:25:22 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 02:25:22 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560824722.24.0.794286893879.issue5680@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14022
pull_request: https://github.com/python/cpython/pull/14185

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:33:43 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 02:33:43 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560825223.96.0.0509626162698.issue5680@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

A more than minimal patch has been merged.  Further work will be on new issues.  Remaining problems not previously discussed:

1. Tab focus traversal is wrong.  This is generic to Query subclasses that add widgets.  See #37325.

2. When the customize box is cancelled, focus goes to the Shell, even when I add 'event.widget.focus_set/force()'.  When the parent of the box was the editor, 'self.shell.text.focus_set' did not work to shift it to the Shell text.

Does anyone else have any idea how to put the focus back on the editor after cancel?

----------
nosy: +taleinat
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:36:56 2019
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 18 Jun 2019 02:36:56 +0000
Subject: [issue37326] Python distributions do not contain libffi license
Message-ID: <1560825416.41.0.74258395972.issue37326@roundup.psfhosted.org>


New submission from Gregory Szorc <gregory.szorc at gmail.com>:

The Modules/_ctypes/libffi_msvc/ffi.h and Modules/_ctypes/libffi_osx/include/ffi.h files in the CPython repository contain copies of libffi.

On at least the official Windows distributions, the LICENSE.txt does not contain libffi's license text from these files. This is seemingly in violation of libffi's license agreement, which clearly says "The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software."

----------
components: Build
messages: 345944
nosy: indygreg
priority: normal
severity: normal
status: open
title: Python distributions do not contain libffi license
type: enhancement
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37326>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:41:46 2019
From: report at bugs.python.org (Alejandro Gonzalez)
Date: Tue, 18 Jun 2019 02:41:46 +0000
Subject: [issue28869] __module__ attribute is not set correctly for a class
 created by direct metaclass call
In-Reply-To: <1480885774.84.0.670239959771.issue28869@psf.upfronthosting.co.za>
Message-ID: <1560825706.4.0.31233420813.issue28869@roundup.psfhosted.org>


Alejandro Gonzalez <alejandrojgt at gmail.com> added the comment:

>It can be fixed in general if deduce __module__ in type.__call__() instead of type.__new__().

But wouldn't we have the same problem if a metaclass overrides type.__call__ instead?
Also, wouldn't that reset the __module__ value anytime the class is called and an object is instantiated?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28869>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:47:58 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 02:47:58 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560826078.34.0.132371102349.issue5680@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 81f7899f517f18a45ab111598f9dd6d7210956a8 by Miss Islington (bot) in branch '3.7':
bpo-5680: IDLE: Customize running a module (GH-13763)
https://github.com/python/cpython/commit/81f7899f517f18a45ab111598f9dd6d7210956a8


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:47:58 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 02:47:58 +0000
Subject: [issue5680] Simulate command-line arguments for program run in IDLE
In-Reply-To: <1238798556.38.0.28468201552.issue5680@psf.upfronthosting.co.za>
Message-ID: <1560826078.83.0.60479469565.issue5680@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ae526ee320d3feabba0aa4dffa9d52e39f8941dc by Miss Islington (bot) in branch '3.8':
bpo-5680: IDLE: Customize running a module (GH-13763)
https://github.com/python/cpython/commit/ae526ee320d3feabba0aa4dffa9d52e39f8941dc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5680>
_______________________________________

From report at bugs.python.org  Mon Jun 17 22:56:16 2019
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 18 Jun 2019 02:56:16 +0000
Subject: [issue37326] Python distributions do not contain libffi license
In-Reply-To: <1560825416.41.0.74258395972.issue37326@roundup.psfhosted.org>
Message-ID: <1560826576.58.0.968612847101.issue37326@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

LICENSE.txt only contains Python's licensing information. You can find all the external licenses in https://docs.python.org/3/license.html?highlight=libffi#libffi

On Windows, this is also distributed as part of Doc/pythonXXX.chm

If you don't think this is sufficient, feel free to re-open.

----------
nosy: +ammar2
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37326>
_______________________________________

From report at bugs.python.org  Mon Jun 17 23:09:12 2019
From: report at bugs.python.org (Gregory Szorc)
Date: Tue, 18 Jun 2019 03:09:12 +0000
Subject: [issue37326] Python distributions do not contain libffi license
In-Reply-To: <1560825416.41.0.74258395972.issue37326@roundup.psfhosted.org>
Message-ID: <1560827352.7.0.762404255145.issue37326@roundup.psfhosted.org>


Gregory Szorc <gregory.szorc at gmail.com> added the comment:

FWIW LICENSE.txt on Windows contains licenses for additional projects starting on line 258 (at least in CPython 3.7.3), which contains the section header "Additional Conditions for this Windows binary build".

But, the Doc/pythonXXX.chm does indeed contain libffi's license text. So we're all good here. I'm not sure why LICENSE.txt on Windows is incomplete. *shrugs*

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37326>
_______________________________________

From report at bugs.python.org  Mon Jun 17 23:22:08 2019
From: report at bugs.python.org (Ammar Askar)
Date: Tue, 18 Jun 2019 03:22:08 +0000
Subject: [issue37326] Windows LICENSE.txt do not contain libffi license
In-Reply-To: <1560825416.41.0.74258395972.issue37326@roundup.psfhosted.org>
Message-ID: <1560828128.55.0.84521875437.issue37326@roundup.psfhosted.org>


Ammar Askar <ammar at ammaraskar.com> added the comment:

Oh whoops, I was looking at my py2 folder. Let's reopen in that case.

----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware
resolution: not a bug -> 
stage: resolved -> 
status: closed -> open
title: Python distributions do not contain libffi license -> Windows LICENSE.txt do not contain libffi license
versions:  -Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37326>
_______________________________________

From report at bugs.python.org  Mon Jun 17 23:53:36 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 18 Jun 2019 03:53:36 +0000
Subject: [issue37317] asyncio gather doesn't handle custom exceptions that
 inherit from BaseException
In-Reply-To: <1560780641.84.0.00364750397427.issue37317@roundup.psfhosted.org>
Message-ID: <1560830016.16.0.133056402942.issue37317@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

On master this returns the below output. Maybe this change in master was due to 431b540bf79f0982559b1b0e420b1b085f667bb7 (issue32528) that is available with 3.8+ ?

./python.exe ../backups/bpo37317.py
BEGIN
THIS DONE: 1
THIS DONE: 2
THIS DONE: 3
THIS DONE: 4
THIS DONE: 6
THIS DONE: 7
THIS DONE: 8
THIS DONE: 9
THIS DONE: 10
Result: [None, None, None, None, CustomException(), None, None, None, None, None]
END

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37317>
_______________________________________

From report at bugs.python.org  Tue Jun 18 01:24:59 2019
From: report at bugs.python.org (Tim Peters)
Date: Tue, 18 Jun 2019 05:24:59 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560835499.79.0.778532632837.issue37295@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

In real life, I expect 99.999%+ of calls will be made with small arguments, so (1) is worth it.  I like Mark's suggestion to use uint64_t so the acceptable range doesn't depend on platform.  At least in the world I live in, 32-bit boxes are all but extinct anyway.

I honestly wouldn't bother with more than that.  It's fun to optimize giant-integer algorithms with an ever-ballooning number of different clever approaches, but Python is an odd place for that.  People looking for blazing fast giant-int facilities generally want lots & lots of them, so are better steered toward, e.g., gmp.  That's its reason for existing.

For example, their implementation of binomial coefficients uses special division algorithms exploiting that the quotient is exact (no remainder):

https://gmplib.org/manual/Exact-Division.html#Exact-Division

There's just no end to potential speedups.  But in Python, I expect a vast majority of users will be happy if they get the right answer for the number of possible poker hands ;-)

Oh ya - some smart kid will file a bug report about the inability to interrupt the calculation of a billion-bit result, so (4) is inevitable.  Me, I'd wait for them to complain, and encourage _them_ to learn something useful by writing a patch to fix it :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Tue Jun 18 02:17:11 2019
From: report at bugs.python.org (aixian le)
Date: Tue, 18 Jun 2019 06:17:11 +0000
Subject: [issue37327] python re bug
Message-ID: <1560838631.6.0.225714277918.issue37327@roundup.psfhosted.org>


New submission from aixian le <goxushunchao2 at gmail.com>:

the code is:
banner = "HTTP/1.0 404 Not Found\r\nDate: Mon, 17 Jun 2019 13:15:44 GMT\r\nServer:                \r\nConnection: close\r\nContent-Type: text/html\r\n\r\n<HTML><HEAD><TITLE>404 Not Found</TITLE></HEAD>\r\n<BODY><H1>404 Not Found</H1>\r\nThe requested URL /PSIA/index was not found on this server.\r\n</BODY></HTML>\r\n"
        regex = "^HTTP/1\\.0 404 Not Found\\r\\n(?:[^<]+|<(?!/head>))*?<style>"
        print("start")
        regex_re = re.compile(regex)
        print("start1")
        regex_re.search(banner)
        print("end")
when I execute this code ,python cannot finished.

----------
components: Regular Expressions
messages: 345953
nosy: aixian le, ezio.melotti, mrabarnett
priority: normal
severity: normal
status: open
title: python re bug
type: crash
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37327>
_______________________________________

From report at bugs.python.org  Tue Jun 18 02:30:10 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 06:30:10 +0000
Subject: [issue37328] remove deprecated HTMLParser.unescape
Message-ID: <1560839410.8.0.633433607628.issue37328@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

HTMLParser.unescape was removed once but resurrected because of distlib depended on it.  (see https://bugs.python.org/issue19688 )

Since it is deprecated from 3.4, it's safe to remove.

----------
components: Library (Lib)
messages: 345954
nosy: inada.naoki
priority: normal
severity: normal
status: open
title: remove deprecated HTMLParser.unescape
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37328>
_______________________________________

From report at bugs.python.org  Tue Jun 18 02:31:14 2019
From: report at bugs.python.org (aixian le)
Date: Tue, 18 Jun 2019 06:31:14 +0000
Subject: [issue37327] python re bug
In-Reply-To: <1560838631.6.0.225714277918.issue37327@roundup.psfhosted.org>
Message-ID: <1560839474.01.0.793283929819.issue37327@roundup.psfhosted.org>


aixian le <goxushunchao2 at gmail.com> added the comment:

the code is:
banner = "HTTP/1.0 404 Not Found\r\nDate: Mon, 17 Jun 2019 13:15:44 GMT\r\nServer:                \r\nConnection: close\r\nContent-Type: text/html\r\n\r\n<HTML><HEAD><TITLE>404 Not Found</TITLE></HEAD>\r\n<BODY><H1>404 Not Found</H1>\r\nThe requested URL /PSIA/index was not found on this server.\r\n</BODY></HTML>\r\n"
        regex = "^HTTP/1\\.0 404 Not Found\\r\\n(?:[^<]+|<(?!/head>))*?<style>"
        print("start")
        regex_re = re.compile(regex)
        print("start1")
        regex_re.search(banner)
        print("end")
when I execute this code ,python cannot finished.

----------
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37327>
_______________________________________

From report at bugs.python.org  Tue Jun 18 02:34:08 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 06:34:08 +0000
Subject: [issue37328] remove deprecated HTMLParser.unescape
In-Reply-To: <1560839410.8.0.633433607628.issue37328@roundup.psfhosted.org>
Message-ID: <1560839648.28.0.929328190908.issue37328@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +14023
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14186

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37328>
_______________________________________

From report at bugs.python.org  Tue Jun 18 02:59:12 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 18 Jun 2019 06:59:12 +0000
Subject: [issue37295] Possible optimizations for math.comb()
In-Reply-To: <1560626260.31.0.393863097125.issue37295@roundup.psfhosted.org>
Message-ID: <1560841152.53.0.433743327806.issue37295@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

> Me, I'd wait for them to complain, and encourage _them_ to learn something useful by writing a patch to fix it :-)

+1!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37295>
_______________________________________

From report at bugs.python.org  Tue Jun 18 03:36:51 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 18 Jun 2019 07:36:51 +0000
Subject: [issue37327] python re bug
In-Reply-To: <1560838631.6.0.225714277918.issue37327@roundup.psfhosted.org>
Message-ID: <1560843411.76.0.934729410638.issue37327@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

When I run the regex on https://regex101.com/, after some small adjustments ("HTTP\/1\.0" and "\/head"), it mentions 'Catastrophic backtracking has been detected and the execution of your expression has been halted.' I don't know much about regex, but it seems there is some eternal loop or something.

I'd suggest to try to make the regex work first on other regex compiler, before calling it a python bug.

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37327>
_______________________________________

From report at bugs.python.org  Tue Jun 18 03:43:16 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Tue, 18 Jun 2019 07:43:16 +0000
Subject: [issue37327] python re bug
In-Reply-To: <1560838631.6.0.225714277918.issue37327@roundup.psfhosted.org>
Message-ID: <1560843796.43.0.374188196738.issue37327@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

neither the banner contains "<style>"

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37327>
_______________________________________

From report at bugs.python.org  Tue Jun 18 03:58:18 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 07:58:18 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560844698.22.0.309113706316.issue34631@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14024
pull_request: https://github.com/python/cpython/pull/14187

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:16:55 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 08:16:55 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560845815.41.0.592710824414.issue35031@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14025
pull_request: https://github.com/python/cpython/pull/14188

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:17:39 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 08:17:39 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560845859.75.0.829191639158.issue34631@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset f3fb8393e3cbbdc0ec79e0fdefaadec6977e1491 by Ned Deily in branch 'master':
bpo-34631: Updated OpenSSL to 1.1.1c in macOS installer (GH-14187)
https://github.com/python/cpython/commit/f3fb8393e3cbbdc0ec79e0fdefaadec6977e1491


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:18:10 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:18:10 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560845890.14.0.190879931242.issue34631@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14026
pull_request: https://github.com/python/cpython/pull/14189

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:18:20 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:18:20 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560845900.21.0.882056995002.issue34631@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14027
pull_request: https://github.com/python/cpython/pull/14190

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:31:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 08:31:25 +0000
Subject: [issue33529] [security] Infinite loop on folding email
 (_fold_as_ew()) if an header has no spaces
In-Reply-To: <1526429548.63.0.682650639539.issue33529@psf.upfronthosting.co.za>
Message-ID: <1560846685.57.0.322334107487.issue33529@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Using git bisect, I found which commit introduced the regression, bpo-27240:

commit a87ba60fe56ae2ebe80ab9ada6d280a6a1f3d552
Author: Miss Islington (bot) <31488909+miss-islington at users.noreply.github.com>
Date:   Sun Dec 3 16:46:23 2017 -0800

    bpo-27240 Rewrite the email header folding algorithm. (GH-3488) (#4693)
    
    The original algorithm tried to delegate the folding to the tokens so
    that those tokens whose folding rules differed could specify the
    differences.  However, this resulted in a lot of duplicated code because
    most of the rules were the same.
    
    The new algorithm moves all folding logic into a set of functions
    external to the token classes, but puts the information about which
    tokens can be folded in which ways on the tokens...with the exception of
    mime-parameters, which are a special case (which was not even
    implemented in the old folder).
    
    This algorithm can still probably be improved and hopefully simplified
    somewhat.
    
    Note that some of the test expectations are changed.  I believe the
    changes are toward more desirable and consistent behavior: in general
    when (re) folding a line the canonical version of the tokens is
    generated, rather than preserving errors or extra whitespace.
    (cherry picked from commit 85d5c18c9d83a1d54eecc4c2ad4dce63194107c6)

The first vulnerable release is Python 3.6.4: Python 3.6.3 and older are not affected by this vulnerability. So yes, I confirm that Python 2.7 and 3.5 are not vulnerable. By the way, a backport to 3.5 was requested but rejected :-)
https://bugs.python.org/issue27240#msg330030

I close the issue. Thanks Rad164 for the report and thanks Krzysztof Wojcik fo the fix!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33529>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:37:26 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:37:26 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560847046.92.0.639631388673.issue35031@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14028
pull_request: https://github.com/python/cpython/pull/14191

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:37:34 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:37:34 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560847054.44.0.456439325531.issue35031@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14029
pull_request: https://github.com/python/cpython/pull/14192

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:37:39 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 08:37:39 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560847059.22.0.93975628101.issue35031@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset a514f782b822bd7bca7c8d78be7bd53bc25c1908 by Ned Deily in branch 'master':
bpo-35031: also disable TLS 1.3 for test_start_tls_server_1 on macOS (GH-14188)
https://github.com/python/cpython/commit/a514f782b822bd7bca7c8d78be7bd53bc25c1908


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:39:56 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:39:56 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560847196.92.0.0232359643703.issue34631@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bd75abfefed31316fc627069597cc3c5087a885b by Miss Islington (bot) in branch '3.8':
bpo-34631: Updated OpenSSL to 1.1.1c in macOS installer (GH-14187)
https://github.com/python/cpython/commit/bd75abfefed31316fc627069597cc3c5087a885b


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:40:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 08:40:05 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560847205.36.0.309591012177.issue35360@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:40:08 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:40:08 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560847208.82.0.969469609995.issue34631@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0f3abbc29f5750706be1a255784eea5003c25901 by Miss Islington (bot) in branch '3.7':
bpo-34631: Updated OpenSSL to 1.1.1c in macOS installer (GH-14187)
https://github.com/python/cpython/commit/0f3abbc29f5750706be1a255784eea5003c25901


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:50:26 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 08:50:26 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560847826.82.0.213180034425.issue37250@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14030
pull_request: https://github.com/python/cpython/pull/14193

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:50:31 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 08:50:31 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560847831.89.0.662361824858.issue37151@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset c78fe320dbb0da3412d640797eb850753d45c07b by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37151: use PyVectorcall_Call for all calls of "method" (GH-13972)
https://github.com/python/cpython/commit/c78fe320dbb0da3412d640797eb850753d45c07b


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:51:03 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 08:51:03 +0000
Subject: [issue37250] C files generated by Cython set tp_print to NULL:
 PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560847863.09.0.546862607476.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> IMHO the simplest and safest option for this issue is to revert tp_print removal and move tp_vectorcall_offset at the end of PyTypeObject.

I just realized that there is a much simpler solution: add back tp_print at the *end* of the PyTypeObject structure. This will fix the Cython problem and is even less likely to break stuff. I'm doing that in PR 14193.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:51:20 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 08:51:20 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560847880.89.0.488517335324.issue37250@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
title: C files generated by Cython set tp_print to NULL: PyTypeObject.tp_print removed, replaced with tp_vectorcall_offset -> C files generated by Cython set tp_print to 0: PyTypeObject.tp_print removed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:52:45 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 08:52:45 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560847965.9.0.765462993017.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I just realized that there is a much simpler solution: add back tp_print at the *end* of the PyTypeObject structure. This will fix the Cython problem and is even less likely to break stuff. I'm doing that in PR 14193.

If we reintroduce it, why not put it back at its previous place, to provide ABI compatibility?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:56:57 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 08:56:57 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560848217.11.0.439125040508.issue35031@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset f49c85d0cb098ba75191a9e272d149ed6466dfb7 by Miss Islington (bot) in branch '3.8':
bpo-35031: also disable TLS 1.3 for test_start_tls_server_1 on macOS (GH-14188)
https://github.com/python/cpython/commit/f49c85d0cb098ba75191a9e272d149ed6466dfb7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 04:56:57 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 08:56:57 +0000
Subject: [issue37233] Use _PY_FASTCALL_SMALL_STACK for method_vectorcall
In-Reply-To: <1560264211.71.0.0575753966343.issue37233@roundup.psfhosted.org>
Message-ID: <1560848217.26.0.585624360001.issue37233@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 988e6aa322fb61651812fa5a61ec73316c71b041 by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37233: use _PY_FASTCALL_SMALL_STACK in method_vectorcall (GH-13974)
https://github.com/python/cpython/commit/988e6aa322fb61651812fa5a61ec73316c71b041


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37233>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:07:26 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 09:07:26 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560848846.93.0.624633964187.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If we reintroduce it, why not put it back at its previous place, to provide ABI compatibility?

First of all, we longer care about ABI compatibility of PyTypeObject.

Second, it is extremely unlikely that the class will use vectorcall: the only way would be to inherit from a base class that uses vectorcall, but there aren't any subclassable classes using vectorcall in CPython. If the class doesn't use vectorcall, then it really doesn't matter: tp_vectorcall_offset is unused in that case, just like tp_print.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:19:00 2019
From: report at bugs.python.org (Michael Felt)
Date: Tue, 18 Jun 2019 09:19:00 +0000
Subject: [issue35704] On AIX,
 test_unpack_archive_xztar fails with default MAXDATA settings
In-Reply-To: <1547111571.31.0.315459583294.issue35704@roundup.psfhosted.org>
Message-ID: <1560849540.64.0.204850634565.issue35704@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14031
pull_request: https://github.com/python/cpython/pull/14194

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35704>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:25:26 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 09:25:26 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560849926.87.0.747213637784.issue35360@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset d8f336fdc10decdd82d3bc81a63aea8be149c0c8 by Ned Deily (animalize) in branch 'master':
bpo-35360: Update macOS installer to use SQLite 3.28.0 (GH-14180)
https://github.com/python/cpython/commit/d8f336fdc10decdd82d3bc81a63aea8be149c0c8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:25:46 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 09:25:46 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560849946.71.0.484862339209.issue35360@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14032
pull_request: https://github.com/python/cpython/pull/14195

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:25:53 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 09:25:53 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560849953.66.0.215350973248.issue35360@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14033
pull_request: https://github.com/python/cpython/pull/14196

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:33:12 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 09:33:12 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1560850392.81.0.108591927419.issue21872@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

I investigated this problem.

Here is the toggle conditions:

- The format is FORMAT_ALONE, this is the legacy .lzma container format.
- The file's header recorded "Uncompressed Size".
- The file doesn't have "End of Payload Marker" or "End of Stream Marker".

Otherwise, liblzma's internal state doesn't hold any bytes that can be output. 

Good news is:

- lzma module's default compressing format is FORMAT_XZ, not FORMAT_ALONE.
- Even FORMAT_ALONE files generated by lzma module (underlying xz library), always have "End of Payload Marker".
- Maybe FORMAT_ALONE format is being outdated in the world.

Attached file test_bad_files.py, test `DecompressReader.read(size=-1)` function [1] with different max_length values (from -1 to 1000, exclude 0), can ensure that the needs_input mechanism works properly.
Usage: modify `DIR` variable to bad files' folder.

[1] https://github.com/python/cpython/blob/v3.8.0b1/Lib/_compression.py#L72-L111

----------
Added file: https://bugs.python.org/file48425/test_bad_files.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:34:31 2019
From: report at bugs.python.org (Ma Lin)
Date: Tue, 18 Jun 2019 09:34:31 +0000
Subject: [issue21872] LZMA library sometimes fails to decompress a file
In-Reply-To: <1403720935.87.0.990494824612.issue21872@psf.upfronthosting.co.za>
Message-ID: <1560850471.39.0.713833978543.issue21872@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

toggle conditions -> trigger conditions

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21872>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:45:14 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 09:45:14 +0000
Subject: [issue35031] test_asyncio test_start_tls_server_1 fails in AMD64
 FreeBSD CURRENT buildbots
In-Reply-To: <1540044407.71.0.788709270274.issue35031@psf.upfronthosting.co.za>
Message-ID: <1560851114.39.0.777549920355.issue35031@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset c101d1a88a8e0b0cec479307b4e0ae6866958a49 by Ned Deily (Miss Islington (bot)) in branch '3.7':
bpo-35031: also disable TLS 1.3 for test_start_tls_server_1 on macOS (GH-14188) (GH-14192)
https://github.com/python/cpython/commit/c101d1a88a8e0b0cec479307b4e0ae6866958a49


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35031>
_______________________________________

From report at bugs.python.org  Tue Jun 18 05:47:44 2019
From: report at bugs.python.org (Michael Felt)
Date: Tue, 18 Jun 2019 09:47:44 +0000
Subject: [issue34711] Lib/http/server.py: Return HTTPStatus.NOT_FOUND if
 path.endswith(/) and not a directory
In-Reply-To: <1537179798.31.0.956365154283.issue34711@psf.upfronthosting.co.za>
Message-ID: <1560851264.6.0.497800029166.issue34711@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14034
pull_request: https://github.com/python/cpython/pull/14197

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34711>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:00:02 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 10:00:02 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560852002.16.0.12265487732.issue35360@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 373dace8d7ee5107cb38cd2e4fa5fd67dcad42dd by Ned Deily (animalize) in branch '2.7':
[2.7] bpo-35360: Update macOS installer to use SQLite 3.28.0 (GH-14183)
https://github.com/python/cpython/commit/373dace8d7ee5107cb38cd2e4fa5fd67dcad42dd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:06:56 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 10:06:56 +0000
Subject: [issue37189] PyRun_String not exported in python38.dll
In-Reply-To: <1559894123.98.0.3282613922.issue37189@roundup.psfhosted.org>
Message-ID: <1560852416.46.0.674232090709.issue37189@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I close the issue. The initial issue has been fixed (PyRun_String is now exported again in the Python DLL).

Eryk Sun:
> Wouldn't it be better to add a function to _testcapi that checks GetProcAddress(PyWin_DLLhModule, name)?

I have no idea.

Steve Dower:
> Should we add a regression test to avoid this happening in the future?

As I explained, I'm not sure where to put such test, I'm not sure what should be tested. If someone wants to work on that, I suggest to open a separated issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37189>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:09:34 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 10:09:34 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560852574.23.0.120376301804.issue34631@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14035
pull_request: https://github.com/python/cpython/pull/14198

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:13:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 10:13:54 +0000
Subject: [issue37214] Add new EncodingWarning warning category: emitted when
 the locale encoding is used implicitly
In-Reply-To: <1560163177.73.0.639513289421.issue37214@roundup.psfhosted.org>
Message-ID: <1560852834.28.0.925037642437.issue37214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I reject this issue: see PEP 597 for the follow-up.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37214>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:15:59 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 10:15:59 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560852959.14.0.084039470614.issue35360@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset a7072ff56e216683f949b353255cce099f5cdb24 by Miss Islington (bot) in branch '3.8':
bpo-35360: Update macOS installer to use SQLite 3.28.0 (GH-14180)
https://github.com/python/cpython/commit/a7072ff56e216683f949b353255cce099f5cdb24


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:19:49 2019
From: report at bugs.python.org (Matthew Barnett)
Date: Tue, 18 Jun 2019 10:19:49 +0000
Subject: [issue37327] python re bug
In-Reply-To: <1560838631.6.0.225714277918.issue37327@roundup.psfhosted.org>
Message-ID: <1560853189.69.0.679194174299.issue37327@roundup.psfhosted.org>


Matthew Barnett <python at mrabarnett.plus.com> added the comment:

The problem is the "(?:[^<]+|<(?!/head>))*?".

If I simplify it a little I get "(?:[^<]+)*?", which is a repeat within a repeat.

There are many ways in which it could match, and if what follows fails to match (it doesn't because there's no "<style>" in the target string, as  Aldwin pointed out), it'll try them all, which can take a long time.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37327>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:24:25 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 10:24:25 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1560853465.2.0.285332176066.issue35360@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 624c9a27b10df4355eb2caf04654c730dfa412dd by Miss Islington (bot) in branch '3.7':
bpo-35360: Update macOS installer to use SQLite 3.28.0 (GH-14180)
https://github.com/python/cpython/commit/624c9a27b10df4355eb2caf04654c730dfa412dd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:48:57 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 10:48:57 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560854937.93.0.848461728476.issue34631@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset a5b1b222077870f194ca7c8c0326eeda014f0452 by Ned Deily in branch '2.7':
bpo-34631: Updated OpenSSL to 1.0.2s in macOS installer. (GH-14198)
https://github.com/python/cpython/commit/a5b1b222077870f194ca7c8c0326eeda014f0452


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 06:50:43 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 10:50:43 +0000
Subject: [issue34631] Upgrade to OpenSSL 1.1.1c, 1.1.0k, and/or 1.0.2s
In-Reply-To: <1536686026.27.0.0269046726804.issue34631@psf.upfronthosting.co.za>
Message-ID: <1560855043.76.0.613303020166.issue34631@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34631>
_______________________________________

From report at bugs.python.org  Tue Jun 18 07:06:00 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 11:06:00 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560855960.16.0.573704881744.issue37151@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 59543347d12a7717235f941e7fd363d4df92984a by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37151: remove _PyFunction_FastCallDict (GH-13864)
https://github.com/python/cpython/commit/59543347d12a7717235f941e7fd363d4df92984a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun 18 07:12:08 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 11:12:08 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1560856328.08.0.181073348702.issue37151@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

All PRs currently on this issue have been merged, but this is not finished yet. I'm mainly waiting for a resolution on PR 13781 because that's a big change which needs to be done before further cleanup.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Tue Jun 18 08:09:44 2019
From: report at bugs.python.org (=?utf-8?q?Filip_=C5=A0?=)
Date: Tue, 18 Jun 2019 12:09:44 +0000
Subject: [issue37305] Add MIME type for Web App Manifest
In-Reply-To: <1560681661.87.0.393263592015.issue37305@roundup.psfhosted.org>
Message-ID: <1560859784.02.0.241877916541.issue37305@roundup.psfhosted.org>


Change by Filip ? <filip.stamcar at hotmail.com>:


----------
keywords: +patch
pull_requests: +14036
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14199

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37305>
_______________________________________

From report at bugs.python.org  Tue Jun 18 08:16:41 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 12:16:41 +0000
Subject: [issue27860] Improvements to ipaddress module
In-Reply-To: <1472138068.64.0.756560879111.issue27860@psf.upfronthosting.co.za>
Message-ID: <1560860201.71.0.842844702578.issue27860@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

OK, I thought I improved only undocumented behavior, but it was documented and previous behavior didn't follow the document.
I'll backport PR 12836.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27860>
_______________________________________

From report at bugs.python.org  Tue Jun 18 08:20:55 2019
From: report at bugs.python.org (Inada Naoki)
Date: Tue, 18 Jun 2019 12:20:55 +0000
Subject: [issue27860] Improvements to ipaddress module
In-Reply-To: <1472138068.64.0.756560879111.issue27860@psf.upfronthosting.co.za>
Message-ID: <1560860455.72.0.387757408138.issue27860@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +14038
pull_request: https://github.com/python/cpython/pull/14200

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27860>
_______________________________________

From report at bugs.python.org  Tue Jun 18 08:27:10 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 18 Jun 2019 12:27:10 +0000
Subject: [issue20183] Derby #14: Convert 41 sites to Argument Clinic across 5
 files
In-Reply-To: <1389140289.9.0.366061884326.issue20183@psf.upfronthosting.co.za>
Message-ID: <1560860830.45.0.286253397165.issue20183@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +14039
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14201

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20183>
_______________________________________

From report at bugs.python.org  Tue Jun 18 08:29:46 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 18 Jun 2019 12:29:46 +0000
Subject: [issue20183] Derby #14: Convert 41 sites to Argument Clinic across 5
 files
In-Reply-To: <1389140289.9.0.366061884326.issue20183@psf.upfronthosting.co.za>
Message-ID: <1560860986.29.0.211286462282.issue20183@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

PR 14201 converts Modules/_localemodule.c.

----------
nosy: +ZackerySpytz
versions: +Python 3.9 -Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20183>
_______________________________________

From report at bugs.python.org  Tue Jun 18 09:05:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 13:05:21 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
Message-ID: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

$ ./configure -C --enable-unicode=ucs4 --with-valgrind
$ make
$ valgrind --suppressions=Misc/valgrind-python.supp ./python -m test.regrtest test___all__
(...)
==18497== LEAK SUMMARY:
==18497==    definitely lost: 324 bytes in 2 blocks
==18497==    indirectly lost: 0 bytes in 0 blocks
==18497==      possibly lost: 5,665,418 bytes in 27,453 blocks
==18497==    still reachable: 8,530,840 bytes in 57,856 blocks
==18497==         suppressed: 32 bytes in 1 blocks
==18497== Reachable blocks (those to which a pointer was found) are not shown.
==18497== To see them, rerun with: --leak-check=full --show-leak-kinds=all
==18497== 
==18497== For lists of detected and suppressed errors, rerun with: -s
==18497== ERROR SUMMARY: 4082 errors from 4082 contexts (suppressed: 0 from 0)

I'm concerned by "324 bytes in 2 blocks". Attached PR fix it.

Downstream issue: https://bugzilla.redhat.com/show_bug.cgi?id=1696322


Fixing "definitely lost" false alarm should help to catch real memory leaks.

----------
components: Extension Modules
messages: 345985
nosy: vstinner
priority: normal
severity: normal
status: open
title: [2.7] valgrind python2 -m test.regrtest test___all__: definitely lost: 324 bytes in 2 blocks
type: resource usage
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Tue Jun 18 09:08:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 13:08:52 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
In-Reply-To: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>
Message-ID: <1560863332.36.0.66195064399.issue37329@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14040
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14202

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Tue Jun 18 09:10:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 13:10:18 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
In-Reply-To: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>
Message-ID: <1560863418.34.0.0526233908999.issue37329@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The best would be to explicitly release all memory at exit, but I don't think that it's worth it in Python 2.7 since this version is now stable. More work in done in the master branch to cleanup things at exit (ex: bpo-36724).

----------
nosy: +inada.naoki, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Tue Jun 18 09:12:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 13:12:10 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
In-Reply-To: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>
Message-ID: <1560863530.02.0.403023527376.issue37329@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> The best would be to explicitly release all memory at exit, but I don't think that it's worth it in Python 2.7 (...)

Python 2.7 "leaks" a lot of memory at exit...

==18497==      possibly lost: 5,665,418 bytes in 27,453 blocks
==18497==    still reachable: 8,530,840 bytes in 57,856 blocks

... but the operating system releases the memory anyway when the process exit. Technically, it's not a major issue unless you embed Python into an application. But again, it's Python 2.7: I suggest to focus efforts in the master branch.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Tue Jun 18 09:41:51 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 13:41:51 +0000
Subject: [issue37233] Use _PY_FASTCALL_SMALL_STACK for method_vectorcall
In-Reply-To: <1560264211.71.0.0575753966343.issue37233@roundup.psfhosted.org>
Message-ID: <1560865311.03.0.0254178830373.issue37233@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37233>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:16:44 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 18 Jun 2019 15:16:44 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560871004.95.0.147034496885.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> If we reintroduce it, why not put it back at its previous place, to provide ABI compatibility?

I agree. If compatibility matters here, then we should add new elements at the end.

> First of all, we longer care about ABI compatibility of PyTypeObject.

Oh? In that case, let's just remove the reserved/deprecated field :)

> Second, it is extremely unlikely ...

As a rule, "extremely unlikely" isn't unlikely enough for a product with as much reach as Python has. Even if something only happens to 0.1% of users, that's still thousands of people. You have to be prepared to justify hurting those people - potentially to their faces - to back up ideas like this. (And FWIW, yes, I'm happy to explain to people that their pre-generated Cython code broke because Cython had a bug that has since been fixed.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:22:43 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 15:22:43 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560871363.59.0.921408003333.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Oh? In that case, let's just remove the reserved/deprecated field :)

Don't confuse *ABI* and *API* compatibility. For *API* compatibility, it doesn't matter where we put tp_print.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:44:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 18 Jun 2019 15:44:04 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560872644.22.0.596455778202.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Don't confuse *ABI* and *API* compatibility. For *API* compatibility, it doesn't matter where we put tp_print.

Don't worry, I'm not. (Though I did blur the lines for the sake of a tongue-in-cheek reply to your comment. Probably shouldn't do that in text with people I haven't spent time with in real life :) )

We're not making any progress here, so perhaps it's time to escalate the decision to the steering council. My read of it:

* Python 3.8 removed a deprecated struct member
* Cython prior to 0.29.10 was writing directly to this member to clear it
* any sdists that include pregenerated Cython modules will fail to build against 3.8

Things to decide (beyond this one-off case):
* are deprecated struct members allowed to be removed in new major version?
* should Cython (using non-stable API) be expected to make updates for new major CPython versions?
* should we treat pre-generated Cython .c files with the same compatibility constraints we use for hand-written C code

My view is yes, yes and no.
* If a field has been deprecated for the normal amount of time and is not in the stable API, it can be removed.
* Cython does not use the stable API, and so should expect to make changes when a new major version of CPython is released
* Pre-generated Cython .c files can be easily regenerated, and given their use of low-level and internal APIs would cause undue compatibility burden on CPython if we were to treat everything it uses as public stable API

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:48:02 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 18 Jun 2019 15:48:02 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1560872882.39.0.699029721605.issue36889@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +14041
pull_request: https://github.com/python/cpython/pull/14203

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:48:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 15:48:25 +0000
Subject: [issue37330] open(): remove 'U' mode, deprecated since Python 3.3
Message-ID: <1560872905.7.0.609892598407.issue37330@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The builtin open() function accepts 'U' in the file mode, but it emits a DeprecationWarning since Python 3.4, change made in bpo-15204:

commit 6787a3806ee6a85a6f21ede70c10e15a6df267c4
Author: Serhiy Storchaka <storchaka at gmail.com>
Date:   Sat Nov 23 22:12:06 2013 +0200

    Issue #15204: Deprecated the 'U' mode in file-like objects.

$ cat x.py 
f = open(__file__, 'U')
line = f.readline()
print(type(line))
f.close()

$ python3.7 x.py 
x.py:1: DeprecationWarning: 'U' mode is deprecated
  f = open(__file__, 'U')
<class 'str'>

The 'U' mode is documented as deprecated since Python 3.3

The flag is basically only there for backward compatibility with Python 2. Python 3.9.0 final release is currently scheduled at 2020-06-08: 6 months after Python 2 end-of-life (2020-01-01).

Currently, the 'U' mode is documented as it will be removed from Python 4.0. But I dislike having a bunch of backward incompatible changes in Python 4.0. I would prefer Python 4.0 to be simply the version after Python 3.X.

Deprecation warnings are now displayed in the __main__ module by default, thanks to the PEP 565 -- Show DeprecationWarning in __main__.
https://www.python.org/dev/peps/pep-0565/

More and more projects run their test suite using -Werror and so have to fix deprecation warnings.

----------
components: Library (Lib)
messages: 345991
nosy: serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: open(): remove 'U' mode, deprecated since Python 3.3
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37330>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:55:12 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 15:55:12 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560873312.78.0.971245626455.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

I would argue for the pragmatic solution: PR 14193 fixes that old Cython-generated code. More generally, it fixes API compatibility and doesn't make ABI compatibility worse than the status quo (the proposal of putting back tp_print in place of tp_vectorcall_offset does).

Of course, it may not fix every single use case, but even if we can't fix that hypothetical 0.1%, we can still fix the 99.9%.

The proposed fix is very small and only applied to 3.8, so there is no long-term maintenance burden. So the obvious question: why not? What's wrong with PR 14193?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 11:59:27 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Tue, 18 Jun 2019 15:59:27 +0000
Subject: [issue37318] builtins.True exists but can't be accessed
In-Reply-To: <1560784622.94.0.240402132833.issue37318@roundup.psfhosted.org>
Message-ID: <1560873567.09.0.577604262987.issue37318@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

[Raymond]

> It is just the way the language works.

As far as I can see, the language doesn't need these constants to be in builtins at all - the only reason for keeping them there is backwards compatibility.

As an experiment I tried removing `True`, `False` and `None` from bltinmodule.c, and recompiling, and every single test in the test suite passed just fine. So apparently we're not even testing for the existence of these constants.

It's also fun to note that it's still possible to modify these names:

>>> import builtins
>>> builtins.__dict__["True"] = False
>>> builtins.__dict__["True"] 
False

So I'm not sure what purpose having `True`, `False` and `None` in builtins serves.

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37318>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:05:00 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Tue, 18 Jun 2019 16:05:00 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560873900.2.0.768317797334.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Personally, I don't think that your "read of it" in #msg345990 is relevant to the discussion of the PR (I don't mean this in a bad way).

It's one thing to say "we're not obliged to fix this" (I agree with that) but that doesn't imply that it's forbidden to fix the issue and that we should automatically reject proposed fixes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:06:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 16:06:58 +0000
Subject: [issue37330] open(): remove 'U' mode, deprecated since Python 3.3
In-Reply-To: <1560872905.7.0.609892598407.issue37330@roundup.psfhosted.org>
Message-ID: <1560874018.15.0.108803590619.issue37330@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14042
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14204

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37330>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:07:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 16:07:08 +0000
Subject: [issue37330] open(): remove 'U' mode, deprecated since Python 3.3
In-Reply-To: <1560872905.7.0.609892598407.issue37330@roundup.psfhosted.org>
Message-ID: <1560874028.41.0.54342379166.issue37330@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +pitrou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37330>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:07:56 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 16:07:56 +0000
Subject: [issue37330] open(): remove 'U' mode, deprecated since Python 3.3
In-Reply-To: <1560872905.7.0.609892598407.issue37330@roundup.psfhosted.org>
Message-ID: <1560874076.75.0.97162437619.issue37330@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I prefer to push backward incompatible changes at the beginning of a dev cycle (Python 3.9), so we have room to revert it later if it causes too much trouble.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37330>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:12:31 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 18 Jun 2019 16:12:31 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560874351.08.0.691550214189.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Personally, I don't think that your "read of it" in #msg345990 is relevant to the discussion of the PR (I don't mean this in a bad way).

It's relevant to the *existence* of the PR, because when you follow through the rest of the thought process, there is no need for a PR at all, and so no need to discuss it.

There's no reason to assume that a PR is required just because an issue was opened.

If we'd broken actual functionality in CPython or Cython, then there'd be a bug to consider. But all we broke is a misuse of a reserved field, and if it were in a single project then we wouldn't have spent anywhere near this amount of time discussing it - it's *only* because Cython was putting it in all its generated code that there's any reason to even look at this, as it could have a disproportionate effect if we believe it's a fair assumption that Cython-generated code targeting 3.7 should also work on 3.8. I've stated my opinion on that, but a decision either requires consensus from those of us involved here (Victor and Stefan) or an appeal to a higher authority (steering council).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:20:27 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 18 Jun 2019 16:20:27 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1560874827.95.0.0128353693266.issue37323@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Sorry, I was wrong PYTHONWARNINGS environment variable is still passed to subprocess created by assert_python_ok so using assertWarns doesn't suppress it. Perhaps the DeprecationWarning could be ignored in assert_python_ok like below with -W :


diff --git a/Lib/test/test_asyncio/test_tasks.py b/Lib/test/test_asyncio/test_tasks.py
index 22a49077d5..d5f44b8091 100644
--- a/Lib/test/test_asyncio/test_tasks.py
+++ b/Lib/test/test_asyncio/test_tasks.py
@@ -3352,7 +3352,9 @@ class CompatibilityTests(test_utils.TestCase):

             asyncio.run(old_style_coro())
         """)
-        assert_python_ok("-c", code, PYTHONASYNCIODEBUG="1")
+
+        assert_python_ok("-Wignore::DeprecationWarning", "-c", code,
+                         PYTHONASYNCIODEBUG="1")


 if __name__ == '__main__':

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:27:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 16:27:40 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560875260.28.0.103068966186.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Steve Dower:
> * Pre-generated Cython .c files can be easily regenerated, and given their use of low-level and internal APIs would cause undue compatibility burden on CPython if we were to treat everything it uses as public stable API

It seems like you missed the whole point of this issue. No, it's not "easy" to regenerate these Cython .c files.

Let's pick a random module on PyPI... numpy.

$ python3.8 -m venv env
$ env/bin/python -m pip install numpy
...
Collecting numpy
  Downloading https://files.pythonhosted.org/packages/d3/4b/f9f4b96c0b1ba43d28a5bdc4b64f0b9d3fbcf31313a51bc766942866a7c7/numpy-1.16.4.zip (5.1MB)
...
    numpy/random/mtrand/mtrand.c:311:11: erreur: trop peu d'arguments pour la fonction ??PyCode_New??
      311 |           PyCode_New(a, k, l, s, f, code, c, n, v, fv, cell, fn, name, fline, lnos)
          |           ^~~~~~~~~~


So right now, 16 days after Cython 0.29.10 release, numpy cannot be installed on Python 3.8 because of bpo-37221. But bpo-37221 is going to revert PyCode_New() API, and then the install will fail at "tp_print = NULL".

numpy is like one of the most popular C extensions on PyPI. But there are 184k projects on PyPI: some of them of Cython.

Some old projects on PyPI will never be updated anymore, but there are likely applications in applications which rely on them. This problem is very common.

Random example: setuptools is another top module on PyPI and it vendors html5lib. But html5lib didn't get a release for 1 year 1/2. html5lib emits a deprecation warning which now blocks bpo-37324 ("collections: remove deprecated aliases to ABC classes").

--

This issue is a practical problem: tons of projects on PyPI are currently broken on Python 3.8 and it will take *years* to update all of them.

IMHO we should reintroduce tp_print just to not break all these projects. 8 bytes per PyTypeObject is nothing compared to annoyance of issues introduced by tp_print removal.

--

Yes, I know that tp_print was deprecated for 10 years and it never emitted any deprecation warning. And people don't pay attention to warnings until it becomes a hard error...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 12:41:11 2019
From: report at bugs.python.org (Morgan Ramsay)
Date: Tue, 18 Jun 2019 16:41:11 +0000
Subject: [issue6839] zipfile can't extract file
In-Reply-To: <1252094279.03.0.456295268952.issue6839@psf.upfronthosting.co.za>
Message-ID: <1560876071.97.0.937186607706.issue6839@roundup.psfhosted.org>


Morgan Ramsay <morgan.ramsay at gmail.com> added the comment:

The encoding test in ZipFile.open() is highly opinionated and has no purpose beyond itself. Testing for encoding issues should be done outside this library in the user's own code.

Using the 3.7.2 version of ZipFile, this is my proposal:

https://gist.github.com/MorganRamsay/696e89450e0f172c16ac8dfc016eb79f/revisions?diff=unified

Currently, I'm subclassing ZipFile with this patch and I've had no issues with extracting thousands of different ZIP files on Windows. I can't attest to this solution's applicability on other platforms.

----------
nosy: +MorganRamsay
versions: +Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6839>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:15:00 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 18 Jun 2019 18:15:00 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560881700.57.0.177907285617.issue34903@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:


New changeset 6b9c204ee77a0de87d6f51a3d4547a18604cef9e by Paul Ganssle (Mike Gleen) in branch 'master':
bpo-34903: Document that some strptime formats only require 1 digit (GH-14149)
https://github.com/python/cpython/commit/6b9c204ee77a0de87d6f51a3d4547a18604cef9e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:15:31 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 18:15:31 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560881731.43.0.638289649827.issue34903@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14043
pull_request: https://github.com/python/cpython/pull/14205

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:55:44 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 18:55:44 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560884144.32.0.794511002928.issue34903@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 452b417e34489614b3003b8d08148269096239d5 by Miss Islington (bot) in branch '3.7':
bpo-34903: Document that some strptime formats only require 1 digit (GH-14149)
https://github.com/python/cpython/commit/452b417e34489614b3003b8d08148269096239d5


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:56:50 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 18 Jun 2019 18:56:50 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560884210.33.0.213725409811.issue34903@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

Thanks for the PR, Mike! This is now merged and backported to Python 3.7, so I believe we can close this issue.

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:59:28 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 18:59:28 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560884368.84.0.488546684473.issue34903@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14044
pull_request: https://github.com/python/cpython/pull/14206

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 14:59:35 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 18 Jun 2019 18:59:35 +0000
Subject: [issue20183] Derby #14: Convert 41 sites to Argument Clinic across 5
 files
In-Reply-To: <1389140289.9.0.366061884326.issue20183@psf.upfronthosting.co.za>
Message-ID: <1560884375.29.0.899492701462.issue20183@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14045
pull_request: https://github.com/python/cpython/pull/14207

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20183>
_______________________________________

From report at bugs.python.org  Tue Jun 18 15:12:08 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Tue, 18 Jun 2019 19:12:08 +0000
Subject: [issue20183] Derby #14: Convert 41 sites to Argument Clinic across 5
 files
In-Reply-To: <1389140289.9.0.366061884326.issue20183@psf.upfronthosting.co.za>
Message-ID: <1560885128.03.0.438540536945.issue20183@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

PR 14207 converts Modules/mmapmodule.c.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20183>
_______________________________________

From report at bugs.python.org  Tue Jun 18 15:21:32 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 19:21:32 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560885692.26.0.407127112526.issue34903@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 35aa0b0ced91cfb48d9dcf80a2ca8683e61f9b3e by Miss Islington (bot) in branch '3.8':
bpo-34903: Document that some strptime formats only require 1 digit (GH-14149)
https://github.com/python/cpython/commit/35aa0b0ced91cfb48d9dcf80a2ca8683e61f9b3e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 15:27:22 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 19:27:22 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560886042.86.0.697265713845.issue36231@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14046
pull_request: https://github.com/python/cpython/pull/14208

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Tue Jun 18 15:37:02 2019
From: report at bugs.python.org (Yoong Hor Meng)
Date: Tue, 18 Jun 2019 19:37:02 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
Message-ID: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>


New submission from Yoong Hor Meng <yoonghm at gmail.com>:

`pysyslog.py`
- A UDP server listens at 0.0.0.0:514 for syslog messages.

`syslogmsg_gen.py`
- Send syslog message to local syslog server via 127.0.0.1:514


Error:

Exception has occurred: UnicodeDecodeError
'utf-8' codec can't decode byte 0xd7 in position 381: invalid continuation byte
  File "C:\pysyslog.py", line 21, in handle
    data = self.request[0].decode('utf-8')
  File "C:\pysyslog.py", line 28, in <module>
    server.serve_forever(poll_interval=0.5)

----------
components: Library (Lib)
files: attachment.md
messages: 346005
nosy: yoonghm
priority: normal
severity: normal
status: open
title: logging.handlers.DatagramHandler sends bad data to socketserver.DatagramRequestHandler
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48426/attachment.md

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Tue Jun 18 16:03:30 2019
From: report at bugs.python.org (Francesco Mantovani)
Date: Tue, 18 Jun 2019 20:03:30 +0000
Subject: [issue37332] Python from Windows Store cannot install pycrypto
Message-ID: <1560888210.0.0.687334859807.issue37332@roundup.psfhosted.org>


New submission from Francesco Mantovani <francesco84mantovani at gmail.com>:

Hello, 

I have installed Python 3.7 from the Windows Store, I was sure I was going to experience some trouble :)

In fact I was able to install Crypto (pip install Crypto) but I receive this error every time I run pip install pycrypto: (see log in attach).

Is evident that probably no user has access to 'C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.7_3.7.1008.0_x64__qbz5n2kfra8p0\python.exe' but why I was able to install Crypto? 

Anyway, I hope my feedback helps you

----------
components: Installation
files: log.txt
messages: 346006
nosy: Francesco Mantovani
priority: normal
severity: normal
status: open
title: Python from Windows Store cannot install pycrypto
type: compile error
versions: Python 3.7
Added file: https://bugs.python.org/file48427/log.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37332>
_______________________________________

From report at bugs.python.org  Tue Jun 18 16:18:24 2019
From: report at bugs.python.org (Zachary Ware)
Date: Tue, 18 Jun 2019 20:18:24 +0000
Subject: [issue37332] Python from Windows Store cannot install pycrypto
In-Reply-To: <1560888210.0.0.687334859807.issue37332@roundup.psfhosted.org>
Message-ID: <1560889104.51.0.563574041722.issue37332@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

I see the same thing using Python 3.7.0 from python.org on Windows 8.1; this appears to be an issue with pycrypto and not Python itself or the Windows Store distribution.  A quick look at the pycrypto issue tracker (https://github.com/dlitz/pycrypto/issues) shows that pycrypto is no longer maintained and should not be used.

----------
nosy: +zach.ware
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37332>
_______________________________________

From report at bugs.python.org  Tue Jun 18 16:28:35 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 18 Jun 2019 20:28:35 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560889715.66.0.589499327686.issue36231@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset c7302116573d853d3181133477d9d0e4d4d3abfd by Ned Deily in branch '3.7':
bpo-36231:  Support building on macOS without /usr/include (GH-13773) (GH-14208)
https://github.com/python/cpython/commit/c7302116573d853d3181133477d9d0e4d4d3abfd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Tue Jun 18 16:44:16 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 20:44:16 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560890656.04.0.204806535515.issue37325@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
keywords: +patch
pull_requests: +14047
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/14209

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 16:44:57 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Tue, 18 Jun 2019 20:44:57 +0000
Subject: [issue34903] strptime %d handling of single digit day of month
In-Reply-To: <1538724686.61.0.545547206417.issue34903@psf.upfronthosting.co.za>
Message-ID: <1560890697.7.0.323593534435.issue34903@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
resolution:  -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34903>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:08:28 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 21:08:28 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560892108.6.0.817559311652.issue37325@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:


New changeset 54cf2e0780ca137dd9abea5d3d974578ce0c18a9 by Terry Jan Reedy in branch 'master':
bpo-37325: Fix focus traversal for 2 IDLE dialogs (#14209)
https://github.com/python/cpython/commit/54cf2e0780ca137dd9abea5d3d974578ce0c18a9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:08:40 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 21:08:40 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560892120.57.0.137167577438.issue37325@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14048
pull_request: https://github.com/python/cpython/pull/14210

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:10:01 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 21:10:01 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560892201.78.0.584737418309.issue37325@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14049
pull_request: https://github.com/python/cpython/pull/14211

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:14:49 2019
From: report at bugs.python.org (Eryk Sun)
Date: Tue, 18 Jun 2019 21:14:49 +0000
Subject: [issue4198] os.path.normcase gets fooled on windows with mapped linux
 network drive
In-Reply-To: <1224885833.7.0.0397055051655.issue4198@psf.upfronthosting.co.za>
Message-ID: <1560892489.31.0.886728693543.issue4198@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> When running a VirtualBox Windows 7 guest on Linux I have found 
> that os.path.samefile() returns False when the filenames are the 
> same, e.g.,
>
> f = r'V:\pdfs\boson1.pdf'
> same = os.path.samefile(f, f)
> print(same) # expected True; got False

genericpath.samefile is unrelated to ntpath.normcase. It's based on comparing the st_dev and st_ino values from the os.stat result of each file. There are known problems with relying solely on the Windows implementation of os.stat for this. Please create a new issue to add your case to the list. Include details about the local volume or UNC share that's mounted as drive V:.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4198>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:26:23 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 21:26:23 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560893183.2.0.785385334192.issue37325@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 44d46e368e6c7cc91fa99a2bfaff544dec7fb04d by Miss Islington (bot) in branch '3.7':
bpo-37325: Fix focus traversal for 2 IDLE dialogs (GH-14209)
https://github.com/python/cpython/commit/44d46e368e6c7cc91fa99a2bfaff544dec7fb04d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:36:12 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 18 Jun 2019 21:36:12 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560893772.79.0.921806229363.issue37325@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset b626b113aee655e273b68eb1edb980f9729c0833 by Miss Islington (bot) in branch '3.8':
bpo-37325: Fix focus traversal for 2 IDLE dialogs (GH-14209)
https://github.com/python/cpython/commit/b626b113aee655e273b68eb1edb980f9729c0833


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 17:36:54 2019
From: report at bugs.python.org (Roundup Robot)
Date: Tue, 18 Jun 2019 21:36:54 +0000
Subject: [issue6839] zipfile can't extract file
In-Reply-To: <1252094279.03.0.456295268952.issue6839@psf.upfronthosting.co.za>
Message-ID: <1560893814.9.0.665754078574.issue6839@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
pull_requests: +14050
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14212

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue6839>
_______________________________________

From report at bugs.python.org  Tue Jun 18 18:27:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 22:27:53 +0000
Subject: [issue35134] Add a new Include/cpython/ subdirectory for the "CPython
 API" with implementation details
In-Reply-To: <1541076409.33.0.788709270274.issue35134@psf.upfronthosting.co.za>
Message-ID: <1560896873.67.0.943101339336.issue35134@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14051
pull_request: https://github.com/python/cpython/pull/14213

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35134>
_______________________________________

From report at bugs.python.org  Tue Jun 18 18:33:27 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Tue, 18 Jun 2019 22:33:27 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560897207.8.0.480714036783.issue37250@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

(Note: this isn't SC feedback yet, it's individual contributor feedback from me)

As others noted, the reason we treat "Incompatible with Cython generated source code" distinctly from other C API source compatibility issues is because Cython-using projects often add the generated files to their source tarballs, so install targets only need a C compiler, not Cython itself. Even when it's a case where the older Cython generated code wasn't doing the right thing, there's pragmatic value in smoothing those transitions.

That said, I still agree with PEP 590's decision to re-use the existing reserve function pointer slot, rather than adding a new one to the end of the type structure indefinitely, which would make the compatibility measure:

1. In 3.8.0b2, move tp_print to the end of the structure (rather than removing it entirely) to make the "type->tp_print" in the old Cython generated code harmless rather than a compilation error
2. In 3.9.0a1, remove it entirely again

That way we still end up in the place we were aiming to get in PEP 590, we just take an extra step in getting there.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 18 18:40:25 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 18 Jun 2019 22:40:25 +0000
Subject: [issue37325] IDLE: fix Query subclass tab focus traversal order
In-Reply-To: <1560823632.0.0.312919780261.issue37325@roundup.psfhosted.org>
Message-ID: <1560897625.45.0.0767143843412.issue37325@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37325>
_______________________________________

From report at bugs.python.org  Tue Jun 18 18:48:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 18 Jun 2019 22:48:13 +0000
Subject: [issue35134] Add a new Include/cpython/ subdirectory for the "CPython
 API" with implementation details
In-Reply-To: <1541076409.33.0.788709270274.issue35134@psf.upfronthosting.co.za>
Message-ID: <1560898093.06.0.750083543557.issue35134@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 01b63ecac66581f80ba953d9182751e591c2b2ba by Victor Stinner in branch 'master':
bpo-35134: Add Include/cpython/import.h header file (GH-14213)
https://github.com/python/cpython/commit/01b63ecac66581f80ba953d9182751e591c2b2ba


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35134>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:04:46 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 19 Jun 2019 00:04:46 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1560902686.49.0.153693493238.issue33416@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
pull_requests: +14052
pull_request: https://github.com/python/cpython/pull/14214

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:19:26 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 19 Jun 2019 00:19:26 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1560903566.21.0.338386616237.issue36985@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
keywords: +patch
pull_requests: +14053
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14216

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:19:57 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 00:19:57 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1560903597.83.0.169965500234.issue33416@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14054
pull_request: https://github.com/python/cpython/pull/14215

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:32:59 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 00:32:59 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1560904379.13.0.222723499989.issue36985@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14055
pull_request: https://github.com/python/cpython/pull/14217

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:33:37 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 00:33:37 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1560904417.9.0.0505603112242.issue33416@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 45da7437f54b4a6bdb8b4ba5a0f13f44a24eec39 by Miss Islington (bot) in branch '3.8':
[3.8] bpo-33416:  Document changes in PyNode_AddChild and PyParser_AddToken (GH-14214) (GH-14215)
https://github.com/python/cpython/commit/45da7437f54b4a6bdb8b4ba5a0f13f44a24eec39


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:34:46 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 19 Jun 2019 00:34:46 +0000
Subject: [issue33416] Add endline and endcolumn to every AST node
In-Reply-To: <1525342525.55.0.682650639539.issue33416@psf.upfronthosting.co.za>
Message-ID: <1560904486.26.0.84813844506.issue33416@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33416>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:39:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 00:39:09 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560904749.89.0.871272690741.issue36710@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14056
pull_request: https://github.com/python/cpython/pull/14218

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:43:35 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 00:43:35 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1560905015.33.0.141903312527.issue37156@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14057
pull_request: https://github.com/python/cpython/pull/14219

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:50:54 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 19 Jun 2019 00:50:54 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1560905454.15.0.842131079599.issue36985@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
pull_requests: +14058
pull_request: https://github.com/python/cpython/pull/14220

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Tue Jun 18 20:54:42 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 00:54:42 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560905682.19.0.852128427505.issue36710@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 0a28f8d379544eee897979da0ce99f0b449b49dd by Victor Stinner in branch 'master':
bpo-36710: Add tstate parameter in import.c (GH-14218)
https://github.com/python/cpython/commit/0a28f8d379544eee897979da0ce99f0b449b49dd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Tue Jun 18 21:01:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 01:01:03 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560906063.98.0.705752689912.issue36710@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14059
pull_request: https://github.com/python/cpython/pull/14221

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Tue Jun 18 21:02:18 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 01:02:18 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1560906138.23.0.514514345855.issue36985@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d0587353fe2dece91d2a9b8ddf2696fb5adc233a by Miss Islington (bot) (Ivan Levkivskyi) in branch '3.7':
[3.7] bpo-36985: Document typing.ForwardRef (GH-14216) (GH-14220)
https://github.com/python/cpython/commit/d0587353fe2dece91d2a9b8ddf2696fb5adc233a


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Tue Jun 18 21:05:36 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 01:05:36 +0000
Subject: [issue37156] Fix libssl DLL tag in Tools/msi project
In-Reply-To: <1559679658.46.0.279980896564.issue37156@roundup.psfhosted.org>
Message-ID: <1560906336.33.0.793347998029.issue37156@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 43b97ae15c8cbb8c383314bb75c867d0f2f34376 by Steve Dower in branch '3.7':
bpo-37156: Fix libssl DLL tag in MSI sources (GH-14219)
https://github.com/python/cpython/commit/43b97ae15c8cbb8c383314bb75c867d0f2f34376


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37156>
_______________________________________

From report at bugs.python.org  Tue Jun 18 21:06:01 2019
From: report at bugs.python.org (Ivan Levkivskyi)
Date: Wed, 19 Jun 2019 01:06:01 +0000
Subject: [issue36985] typing.ForwardRef is undocumented
In-Reply-To: <1558416902.0.0.868432422236.issue36985@roundup.psfhosted.org>
Message-ID: <1560906361.76.0.191742244202.issue36985@roundup.psfhosted.org>


Change by Ivan Levkivskyi <levkivskyi at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36985>
_______________________________________

From report at bugs.python.org  Tue Jun 18 22:52:17 2019
From: report at bugs.python.org (=?utf-8?b?0JDQvdC00YDQtdC5INCa0LDQt9Cw0L3RhtC10LI=?=)
Date: Wed, 19 Jun 2019 02:52:17 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
Message-ID: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>


New submission from ?????? ???????? <heckad at yandex.ru>:

Error	MSB4113	Specified condition "$(IncludeTkinter)" evaluates to "" instead of a boolean.	python	cpython\PCbuild\python.vcxproj	156

It is the master branch (id: 0a28f8d379544eee897979da0ce99f0b449b49dd)

----------
components: Build
messages: 346019
nosy: heckad
priority: normal
severity: normal
status: open
title: Fail build on windows 10(visual studio 2019)
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Tue Jun 18 23:56:13 2019
From: report at bugs.python.org (Yoong Hor Meng)
Date: Wed, 19 Jun 2019 03:56:13 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560916573.89.0.922757999915.issue37331@roundup.psfhosted.org>


Yoong Hor Meng <yoonghm at gmail.com> added the comment:

I did some checks, I discovered the following:

logging.handlers.DatagramHandler() sends data in the following format:
1. message length
2. message itself which consists of 
   a. Creation time in ASCII format
   b. Creation time in seconds, ms
   c. Filename, line no
   d. Message level
   e. Message
   f. Logger name
   etc.

Item 1. is packed using struct.pack(">L")
Item 2. is packed using pickle

The message format is not mentioned in any of the standard Python document.  Also it may not be compatible with third-party syslog message library or generator.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 00:29:01 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 19 Jun 2019 04:29:01 +0000
Subject: [issue37205] time.perf_counter() is not system-wide on Windows,
 in disagreement with documentation
In-Reply-To: <1560017700.11.0.127727162727.issue37205@roundup.psfhosted.org>
Message-ID: <1560918541.19.0.365587702851.issue37205@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37205>
_______________________________________

From report at bugs.python.org  Wed Jun 19 01:22:40 2019
From: report at bugs.python.org (shajianrui)
Date: Wed, 19 Jun 2019 05:22:40 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560921760.31.0.921351747542.issue37301@roundup.psfhosted.org>


shajianrui <shajianrui at 126.com> added the comment:

@vsbogd,Thank you for your reply. But I find another problem.

I derive a subclass from sockerserver.StreamRequestHandler, and set the rbufsize to 0(As CGIHTTPRequestHandler do), like this demo below:

    testserver.py:
                import socketserver
                class TestRequestHandler(socketserver.StreamRequestHandler):
                    rbufsize = 0  ###simulate CGIHTTPRequestHandler
                    def handle(self):
                        while True:
                            data = self.rfile.read(65536*1024) ###client should send 65536*1024 bytes.
                            print(len(data))
                            if len(data) == 0:
                                print("Connection closed.")
                                break
                s = socketserver.TCPServer(("0.0.0.0", 8001), TestRequestHandler)
                s.serve_forever()

    testclient.py:
                import socket
                data = bytearray(65536*1024)
                for i in range(65536*1024):
                    data[i] = 64        #Whatever you set.
                c = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
                c.connect(("127.0.0.1", 8001))
                c.send(data)

The testserver.py can get the whole 65536*1024 data in every "data = self.rfile.read(65536*1024)" line. The normal output of testserver.py is:

    testserver.py output:
                67108864
                0
                Connection closed.
                67108864
                0
                Connection closed.

In other words, this problem of "rfile.read(nbytes)" cannot be reproduce in this demo.

I dont know why, it seems this is not only the problem of the "rfile.read(nbytes)". I guess the CGIHTTPRequestHandler actually do something that make the "rfile.read(nbytes)" perform weirdly. However, I fail to find such a line in the code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:33:07 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 19 Jun 2019 07:33:07 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1560929587.25.0.680159099892.issue35431@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +14060
pull_request: https://github.com/python/cpython/pull/14226

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:33:32 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 19 Jun 2019 07:33:32 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1560929612.08.0.036484185463.issue37163@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset f5b89afde1196ec9f74b7dc0333cec9bc4d4c2db by Serhiy Storchaka in branch '3.8':
bpo-37163: Deprecate passing argument obj of dataclasses.replace() by keyword. (GH-13877)
https://github.com/python/cpython/commit/f5b89afde1196ec9f74b7dc0333cec9bc4d4c2db


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:41:48 2019
From: report at bugs.python.org (Martin Teichmann)
Date: Wed, 19 Jun 2019 07:41:48 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
Message-ID: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>


New submission from Martin Teichmann <martin.teichmann at gmail.com>:

When working with queues, it is not uncommon that at some point the producer stops producing data for good, or the consumer stops consuming, for example because a network connection broke down or some user simply closed the session.

In this situation it is very useful to simply cancel all the waiting getters and putters. A simple method can do that, Queue.cancel.

----------
components: asyncio
messages: 346023
nosy: Martin.Teichmann, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Add a cancel method to asyncio Queues
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:43:15 2019
From: report at bugs.python.org (Martin Teichmann)
Date: Wed, 19 Jun 2019 07:43:15 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1560930195.66.0.414763173834.issue37334@roundup.psfhosted.org>


Change by Martin Teichmann <martin.teichmann at gmail.com>:


----------
keywords: +patch
pull_requests: +14061
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14227

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:43:59 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 19 Jun 2019 07:43:59 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560930239.03.0.635948420699.issue37333@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Probably related issue where the flag was added to python.vcxproj : issue37288

----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, xtreak, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:57:30 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 19 Jun 2019 07:57:30 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
Message-ID: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>


New submission from Jakub Kulik <kulikjak at gmail.com>:

Locale coercion tests on Solaris are failing because 646 ASCII alias is not recognized. Its addition into the _handle_output_variations function fixes this problem.

This was changed/fixed in Python 3.8 and later, where aliases are correctly translated to their canonical Python codec name so no patch is needed there.

----------
components: Tests
messages: 346025
nosy: kulikjak
priority: normal
severity: normal
status: open
title: Add 646 ASCII alias to locale coercion tests.
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Wed Jun 19 03:57:51 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 19 Jun 2019 07:57:51 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1560931071.02.0.387194174029.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
keywords: +patch
pull_requests: +14063
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/11195

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:13:09 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 19 Jun 2019 08:13:09 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1560931989.8.0.12458447769.issue37334@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Sounds like `.close()` is better name for described behavior.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:16:11 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 19 Jun 2019 08:16:11 +0000
Subject: [issue35455] Solaris thread_time doesn't work with current
 implementation
In-Reply-To: <1544452341.93.0.788709270274.issue35455@psf.upfronthosting.co.za>
Message-ID: <1560932171.36.0.352590726309.issue35455@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

Since I created this pull request, clock_gettime(CLOCK_THREAD_CPUTIME_ID, ..) was implemented into the Solaris kernel, so I guess that this is no longer relevant.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35455>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:17:38 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 08:17:38 +0000
Subject: [issue37243] test_sendfile in asyncio crashes when os.sendfile() is
 not supported
In-Reply-To: <1560333934.74.0.973153336061.issue37243@roundup.psfhosted.org>
Message-ID: <1560932258.14.0.0993958968781.issue37243@roundup.psfhosted.org>


Michael Felt <aixtools at felt.demon.nl> added the comment:

Closed. Not a bug in test_sendfile.

----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37243>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:36:09 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 08:36:09 +0000
Subject: [issue37336] os.sendfile() support missing for AIX platform
Message-ID: <1560933369.42.0.72033951597.issue37336@roundup.psfhosted.org>


New submission from Michael Felt <aixtools at felt.demon.nl>:

In AIX "sendfile()" is named send_file().

During testing I learned, unexpectedly, that AIX platform has never provided support of os.sendfile(). This is correct that oversight.

>From this (and older) documentation - it seems all the bits needed are available. See https://www.ibm.com/support/knowledgecenter/en/ssw_aix_71/com.ibm.aix.commtrf2/send_file.htm

At this point - I am assuming that os.sendfile() is for the "socket sendfile() - but would like feedback in case "there is more". As to compareable concerns in the past see: https://lists.gnu.org/archive/html/bug-gnulib/2011-01/msg00506.html

----------
components: IO
messages: 346029
nosy: Michael.Felt
priority: normal
severity: normal
status: open
title: os.sendfile() support missing for AIX platform
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37336>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:36:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 08:36:25 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560933385.56.0.181641147102.issue36710@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 987a0dcfa1302df6c1ed8cf14762dc18628e3f33 by Victor Stinner in branch 'master':
bpo-36710: Remove PyImport_Cleanup() function (GH-14221)
https://github.com/python/cpython/commit/987a0dcfa1302df6c1ed8cf14762dc18628e3f33


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Wed Jun 19 04:49:36 2019
From: report at bugs.python.org (vsbogd)
Date: Wed, 19 Jun 2019 08:49:36 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560934176.59.0.0543443690082.issue37301@roundup.psfhosted.org>


vsbogd <vsbogd at gmail.com> added the comment:

Hmm, seems strange I will try to reproduce and look at it.

Have you run my demo which is attached to the bug? Does it reproduce problem on your machine?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Wed Jun 19 05:35:31 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 09:35:31 +0000
Subject: [issue37337] Add _PyObject_VectorcallMethod() function
Message-ID: <1560936931.61.0.893195452608.issue37337@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

To augment the various PyObject_CallMethod...() functions, we add _PyObject_VectorcallMethod() which uses the vectorcall calling convention. To be consistent with the other vectorcall functions, this function is provisional for now.

For efficiency, the "self" argument is NOT passed as separate argument but as part of the usual args array. In other words, the call looks like an unbound method call.

I am also adding _PyObject_VectorcallMethodId() taking a _Py_Identifier* as argument and convenience functions PyObject_CallMethodNoArgs() and _PyObject_CallMethodIdNoArgs(), analogous to the recently added PyObject_CallNoArgs().

----------
messages: 346032
nosy: Mark.Shannon, inada.naoki, jdemeyer, petr.viktorin, vstinner
priority: normal
severity: normal
status: open
title: Add _PyObject_VectorcallMethod() function

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37337>
_______________________________________

From report at bugs.python.org  Wed Jun 19 05:57:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 09:57:40 +0000
Subject: [issue37338] test_multiprocessing_forkserver: test_thousand() logged
 on AMD64 Ubuntu Shared 3.x: Exception ignored in: <Finalize object,
 dead>
Message-ID: <1560938260.28.0.194629990204.issue37338@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Oh, I'm happy! My regrtest change (bpo-37069) to detect unraisable exception detected its first issue :-)

AMD64 Ubuntu Shared 3.x:
https://buildbot.python.org/all/#/builders/141/builds/2029

test_thousand (test.test_multiprocessing_forkserver.WithProcessesTestBarrier) ... Warning -- Unraisable exception
Exception ignored in: <Finalize object, dead>
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/util.py", line 189, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/synchronize.py", line 87, in _cleanup
    sem_unlink(name)
FileNotFoundError: [Errno 2] No such file or directory
Warning -- Unraisable exception
Exception ignored in: <Finalize object, dead>
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/util.py", line 189, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/synchronize.py", line 87, in _cleanup
    sem_unlink(name)
FileNotFoundError: [Errno 2] No such file or directory
Warning -- Unraisable exception
Exception ignored in: <Finalize object, dead>
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/util.py", line 189, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/synchronize.py", line 87, in _cleanup
    sem_unlink(name)
FileNotFoundError: [Errno 2] No such file or directory
Warning -- Unraisable exception
Exception ignored in: <Finalize object, dead>
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/util.py", line 189, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/synchronize.py", line 87, in _cleanup
    sem_unlink(name)
FileNotFoundError: [Errno 2] No such file or directory
Warning -- Unraisable exception
Exception ignored in: <Finalize object, dead>
Traceback (most recent call last):
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/util.py", line 189, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/srv/buildbot/buildarea/3.x.bolen-ubuntu/build/Lib/multiprocessing/synchronize.py", line 87, in _cleanup
    sem_unlink(name)
FileNotFoundError: [Errno 2] No such file or directory
ok

--

I'm unable to reproduce the issue, it looks like a race condition.

I ran the following commands 4 times in parallel and I stressed my laptop:

./python -m test --fail-env-changed test_multiprocessing_forkserver -m test_thousand -v -F

----------
components: Tests
messages: 346033
nosy: pablogsal, pitrou, vstinner
priority: normal
severity: normal
status: open
title: test_multiprocessing_forkserver: test_thousand() logged on AMD64 Ubuntu Shared 3.x: Exception ignored in: <Finalize object, dead>
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37338>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:00:25 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 19 Jun 2019 10:00:25 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560938425.99.0.0730874960089.issue37331@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:00:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 10:00:46 +0000
Subject: [issue37338] test_multiprocessing_forkserver: test_thousand() logged
 on AMD64 Ubuntu Shared 3.x: Exception ignored in: <Finalize object,
 dead>
In-Reply-To: <1560938260.28.0.194629990204.issue37338@roundup.psfhosted.org>
Message-ID: <1560938446.97.0.83771557767.issue37338@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Currently, SemLock does not provide a way to explicitly delete it. Maybe a new close() method should be added, similar to Process.close() and Pool.terminate(), to make resource management more deterministic (more reliable).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37338>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:02:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 10:02:57 +0000
Subject: [issue37338] test_multiprocessing_forkserver: test_thousand() logged
 on AMD64 Ubuntu Shared 3.x: Exception ignored in: <Finalize object,
 dead>
In-Reply-To: <1560938260.28.0.194629990204.issue37338@roundup.psfhosted.org>
Message-ID: <1560938577.2.0.155039732906.issue37338@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +davin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37338>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:10:42 2019
From: report at bugs.python.org (Eike Fokken)
Date: Wed, 19 Jun 2019 10:10:42 +0000
Subject: [issue37339] os.path.ismount returns true on nested btrfs subvolumes
Message-ID: <1560939042.69.0.683071795623.issue37339@roundup.psfhosted.org>


New submission from Eike Fokken <e.fokken+pythontracker at posteo.de>:

Lets say, we have a btrfs partion with subvolumes @, mounted at /
and home, which was created directly inside @, such that after mounting @, it can be found at /home.

Then 
os.path.ismount("/home") returns True
I would not have expected that, because the program findmnt from the util-linux software package doesn't list it if I run
findmnt -A

I think that the two programs should agree on whether it's a mount point or not but am unsure whether findmnt or os.path.ismount should be altered because I don't know a definite definition of a mountpoint.


Note that I agree with the current behaviour for explicitely mounted subvolumes. An example would be if I have the subvolume @ mounted at / and a subvolume @home created at the toplevel of the btrfs filesystem which is then mounted at /home.
Here findmnt and os.path.ismount agree that this is a mount point.

----------
components: Library (Lib)
messages: 346035
nosy: eike
priority: normal
severity: normal
status: open
title: os.path.ismount returns true on nested btrfs subvolumes
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37339>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:12:42 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 10:12:42 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560939162.91.0.333326507329.issue37258@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

This is not actually a bug, but happens because the logger is instantiated directly, rather than through logging.getLogger(...). Because of the direct instantiation, the logger cache isn't tracked via setLevel() - because the logger doesn't end up in logging.manager.loggerDict.

However, I will incorporate Karthikeyan's test (modified to avoid direct instantiation), and update the documentation to strengthen the information to avoid direct instantiation of loggers.

----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:15:37 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 10:15:37 +0000
Subject: [issue37337] Add _PyObject_VectorcallMethod() function
In-Reply-To: <1560936931.61.0.893195452608.issue37337@roundup.psfhosted.org>
Message-ID: <1560939337.27.0.389297443251.issue37337@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +14064
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14228

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37337>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:26:07 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 10:26:07 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560939967.57.0.490733819111.issue37258@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
keywords: +patch
pull_requests: +14065
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14229

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:47:17 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 10:47:17 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560941237.12.0.22814025781.issue37258@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 015000165373f8db263ef5bc682f02d74e5782ac by Vinay Sajip in branch 'master':
bpo-37258: Not a bug, but added a unit test and updated documentation. (GH-14229)
https://github.com/python/cpython/commit/015000165373f8db263ef5bc682f02d74e5782ac


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:47:20 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 10:47:20 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560941240.74.0.915475678324.issue37258@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14066
pull_request: https://github.com/python/cpython/pull/14230

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 06:47:33 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 10:47:33 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560941253.67.0.916994336051.issue37258@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14067
pull_request: https://github.com/python/cpython/pull/14231

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 07:04:14 2019
From: report at bugs.python.org (Crusader Ky)
Date: Wed, 19 Jun 2019 11:04:14 +0000
Subject: [issue22239] asyncio: nested event loop
In-Reply-To: <1408557830.66.0.604610139339.issue22239@psf.upfronthosting.co.za>
Message-ID: <1560942254.91.0.544420366971.issue22239@roundup.psfhosted.org>


Change by Crusader Ky <crusaderky at gmail.com>:


----------
nosy: +Crusader Ky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue22239>
_______________________________________

From report at bugs.python.org  Wed Jun 19 07:47:45 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 11:47:45 +0000
Subject: [issue27860] Improvements to ipaddress module
In-Reply-To: <1472138068.64.0.756560879111.issue27860@psf.upfronthosting.co.za>
Message-ID: <1560944865.56.0.895123101913.issue27860@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset f532fe5583d29d21e12aa22d8fca13e3bca94fb3 by Inada Naoki in branch '3.7':
bpo-27860: ipaddress: fix Interface constructor (GH-14200)
https://github.com/python/cpython/commit/f532fe5583d29d21e12aa22d8fca13e3bca94fb3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27860>
_______________________________________

From report at bugs.python.org  Wed Jun 19 07:48:12 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 11:48:12 +0000
Subject: [issue27860] Improvements to ipaddress module
In-Reply-To: <1472138068.64.0.756560879111.issue27860@psf.upfronthosting.co.za>
Message-ID: <1560944892.77.0.275327153478.issue27860@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27860>
_______________________________________

From report at bugs.python.org  Wed Jun 19 08:39:06 2019
From: report at bugs.python.org (Caleb Hattingh)
Date: Wed, 19 Jun 2019 12:39:06 +0000
Subject: [issue34831] Asyncio Tutorial
In-Reply-To: <1538134577.09.0.545547206417.issue34831@psf.upfronthosting.co.za>
Message-ID: <1560947946.2.0.837492679379.issue34831@roundup.psfhosted.org>


Caleb Hattingh <caleb.hattingh at gmail.com> added the comment:

I'm removing the GUI section of the chat case study. Yury was right, it's not going to add anything useful. The CLI chat client will work well because prompt-toolkit has actual support for asyncio.  Tkinter does not, and I think it'll be better to add a GUI section to this tutorial only once Tkinter gets first-class support for asyncio.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34831>
_______________________________________

From report at bugs.python.org  Wed Jun 19 08:54:21 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 12:54:21 +0000
Subject: [issue37340] remove free_list for bound method objects
Message-ID: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

LOAD_METHOD avoids temporary bound method object.
PyObject_CallMethodObjArgs now use same optimization.

Now I think there is not enough performance benefit from free_list.
When free_list is not used often enough, it may bother obmalloc reuse memory pool.

This is performance diff of removing free_list (with LTO, without PGO, patched=removed free_list):

```
$ ./python -m pyperf compare_to master.json patched.json -G --min-speed=1
Slower (19):
- sqlite_synth: 4.03 us +- 0.10 us -> 4.20 us +- 0.08 us: 1.04x slower (+4%)
- genshi_text: 41.2 ms +- 0.4 ms -> 42.6 ms +- 0.4 ms: 1.03x slower (+3%)
- scimark_sparse_mat_mult: 6.29 ms +- 0.03 ms -> 6.50 ms +- 0.50 ms: 1.03x slower (+3%)
- mako: 26.5 ms +- 0.1 ms -> 27.4 ms +- 0.3 ms: 1.03x slower (+3%)
- html5lib: 130 ms +- 4 ms -> 134 ms +- 5 ms: 1.03x slower (+3%)
- genshi_xml: 83.4 ms +- 1.1 ms -> 85.6 ms +- 1.2 ms: 1.03x slower (+3%)
- pickle: 15.1 us +- 0.5 us -> 15.5 us +- 0.5 us: 1.03x slower (+3%)
- float: 161 ms +- 1 ms -> 165 ms +- 1 ms: 1.02x slower (+2%)
- logging_simple: 13.9 us +- 0.2 us -> 14.2 us +- 0.2 us: 1.02x slower (+2%)
- xml_etree_process: 108 ms +- 1 ms -> 110 ms +- 1 ms: 1.02x slower (+2%)
- pathlib: 28.0 ms +- 0.2 ms -> 28.5 ms +- 0.3 ms: 1.02x slower (+2%)
- pickle_pure_python: 703 us +- 8 us -> 715 us +- 7 us: 1.02x slower (+2%)
- sympy_expand: 553 ms +- 5 ms -> 563 ms +- 12 ms: 1.02x slower (+2%)
- xml_etree_generate: 136 ms +- 2 ms -> 138 ms +- 1 ms: 1.02x slower (+2%)
- logging_format: 15.3 us +- 0.2 us -> 15.5 us +- 0.2 us: 1.01x slower (+1%)
- json_dumps: 17.4 ms +- 0.1 ms -> 17.7 ms +- 0.2 ms: 1.01x slower (+1%)
- logging_silent: 266 ns +- 5 ns -> 269 ns +- 9 ns: 1.01x slower (+1%)
- django_template: 163 ms +- 1 ms -> 165 ms +- 2 ms: 1.01x slower (+1%)
- sympy_sum: 219 ms +- 2 ms -> 222 ms +- 2 ms: 1.01x slower (+1%)

Faster (6):
- regex_effbot: 4.51 ms +- 0.04 ms -> 4.44 ms +- 0.03 ms: 1.02x faster (-2%)
- pickle_list: 5.21 us +- 0.04 us -> 5.13 us +- 0.04 us: 1.01x faster (-1%)
- crypto_pyaes: 164 ms +- 1 ms -> 162 ms +- 1 ms: 1.01x faster (-1%)
- xml_etree_parse: 202 ms +- 7 ms -> 200 ms +- 3 ms: 1.01x faster (-1%)
- scimark_sor: 287 ms +- 6 ms -> 284 ms +- 6 ms: 1.01x faster (-1%)
- raytrace: 758 ms +- 26 ms -> 750 ms +- 11 ms: 1.01x faster (-1%)

Benchmark hidden because not significant (35)
```

I think free_list is useful only when several benchmarks in pyperformance shows more than 5% speedup.
The benefit is smaller than my threshold.  I will run pyperformance again after bpo-37337 is merged.

FWIW, In case of sqlite_synth, I think performance difference came from here:
https://github.com/python/cpython/blob/015000165373f8db263ef5bc682f02d74e5782ac/Modules/_sqlite/connection.c#L662
If performance of user-defined aggregate feature is really important, we can optimize it further.

----------
components: Interpreter Core
messages: 346040
nosy: inada.naoki, jdemeyer
priority: normal
severity: normal
status: open
title: remove free_list for bound method objects
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 08:56:44 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 12:56:44 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560949004.44.0.797013366687.issue37340@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

PyCFunction has similar free_list.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:11:26 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 13:11:26 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560949886.12.0.141775384689.issue37340@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> I will run pyperformance again after bpo-37337 is merged.

Good idea. bpo-37337 removes many calls of _PyObject_CallMethodId() which does NOT use the LOAD_METHOD optimization.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:14:11 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 13:14:11 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560950051.11.0.932747356259.issue37340@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +14068
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14232

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:15:14 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 13:15:14 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560950114.68.0.43912647367.issue37340@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

GH-14232 uses only one free object instead of at most 256 free list.

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:17:35 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 13:17:35 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560950255.77.0.808912515338.issue37340@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> GH-14232 uses only one free object instead of at most 256 free list.

That sounds like a compromise which is worse than either extreme: it's worse than no free list because you still have the overhead of dealing with the one object. And it's worse than a free list of 256 because it won't for nested calls.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:35:52 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 13:35:52 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560951352.6.0.34105990436.issue37340@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Are the benchmark results that you posted above for removing the free list completely or for the one-element free list as in PR 14232?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:46:43 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 13:46:43 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560952003.37.0.696659880707.issue37258@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 9eb4b2c8a3387ea901dad793e8d5586880a5968e by Vinay Sajip (Miss Islington (bot)) in branch '3.7':
bpo-37258: Not a bug, but added a unit test and updated documentation. (GH-14229) (GH-14231)
https://github.com/python/cpython/commit/9eb4b2c8a3387ea901dad793e8d5586880a5968e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:46:59 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 13:46:59 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560952019.16.0.348624743476.issue37258@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset 95ff622028b4f5d2eefbff557eadbb08fbcd42b1 by Vinay Sajip (Miss Islington (bot)) in branch '3.8':
bpo-37258: Not a bug, but added a unit test and updated documentation. (GH-14229) (GH-14230)
https://github.com/python/cpython/commit/95ff622028b4f5d2eefbff557eadbb08fbcd42b1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:47:45 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 13:47:45 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560952065.77.0.129676530421.issue37258@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 09:57:38 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 13:57:38 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560952658.64.0.9373736963.issue37331@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

It is mentioned here:

https://docs.python.org/3/library/logging.handlers.html?highlight=datagramhandler#logging.handlers.SocketHandler.makePickle

although that doesn't go into the detail of the struct.pack format. I'll update the documentation to rectify this.

----------
assignee:  -> docs at python
components: +Documentation -Library (Lib)
nosy: +docs at python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:03:28 2019
From: report at bugs.python.org (Dmitrii Pasechnik)
Date: Wed, 19 Jun 2019 14:03:28 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560953008.78.0.573610959784.issue36231@roundup.psfhosted.org>


Dmitrii Pasechnik <dimpase at gmail.com> added the comment:

I find it puzzling that a relatively clean and short solution using autotools and the Apple-approved way to get the location of the headers is rejected, and a hacky, longer way that scrapes output of the compiler is being pushed instead.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:04:17 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 14:04:17 +0000
Subject: [issue34347] AIX: test_utf8_mode.test_cmd_line fails
In-Reply-To: <1533571610.9.0.56676864532.issue34347@psf.upfronthosting.co.za>
Message-ID: <1560953057.28.0.714633156111.issue34347@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14069
pull_request: https://github.com/python/cpython/pull/14233

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34347>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:11:41 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:11:41 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560953501.08.0.227216983417.issue37331@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
keywords: +patch
pull_requests: +14070
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14234

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:14:40 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 14:14:40 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560953680.99.0.107267248475.issue36231@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:30:22 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:30:22 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560954622.57.0.892379243014.issue37331@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset f06b569305cf604f070776ea3f800ed61fdd7d61 by Vinay Sajip in branch 'master':
bpo-37331: Clarify format of socket handler messages in the documentation. (GH-14234)
https://github.com/python/cpython/commit/f06b569305cf604f070776ea3f800ed61fdd7d61


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:30:39 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 14:30:39 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560954639.18.0.251101442241.issue37331@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14071
pull_request: https://github.com/python/cpython/pull/14235

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:30:45 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 14:30:45 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560954645.18.0.0592946900417.issue37331@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14072
pull_request: https://github.com/python/cpython/pull/14236

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:34:27 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:34:27 +0000
Subject: [issue28595] shlex.shlex should not augment wordchars
In-Reply-To: <1478166136.94.0.995190174918.issue28595@psf.upfronthosting.co.za>
Message-ID: <1560954867.15.0.85687016857.issue28595@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed
versions: +Python 3.8 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28595>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:37:11 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:37:11 +0000
Subject: [issue36704] logging.FileHandler currently hardcodes errors='strict'
In-Reply-To: <1556019517.33.0.109747791974.issue36704@roundup.psfhosted.org>
Message-ID: <1560955031.99.0.931403426154.issue36704@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Fixed as part of the fix for bpo-37111.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36704>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:41:57 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:41:57 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560955317.86.0.257040460793.issue37331@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset b64e42e931a3598d6f0605ec78673772f97ecd4c by Vinay Sajip (Miss Islington (bot)) in branch '3.7':
bpo-37331: Clarify format of socket handler messages in the documentation. (GH-14234) (GH-14236)
https://github.com/python/cpython/commit/b64e42e931a3598d6f0605ec78673772f97ecd4c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:42:38 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:42:38 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560955358.76.0.338894797622.issue37331@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:


New changeset d7232f0e4646803f0bbaede6e1fa124156135512 by Vinay Sajip (Miss Islington (bot)) in branch '3.8':
bpo-37331: Clarify format of socket handler messages in the documentation. (GH-14234) (GH-14235)
https://github.com/python/cpython/commit/d7232f0e4646803f0bbaede6e1fa124156135512


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:43:45 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:43:45 +0000
Subject: [issue37331] logging.handlers.DatagramHandler sends bad data to
 socketserver.DatagramRequestHandler
In-Reply-To: <1560886622.42.0.564297699997.issue37331@roundup.psfhosted.org>
Message-ID: <1560955425.93.0.467620770243.issue37331@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37331>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:46:58 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 14:46:58 +0000
Subject: [issue11192] test_socket error on AIX
In-Reply-To: <1297436751.32.0.492226695457.issue11192@psf.upfronthosting.co.za>
Message-ID: <1560955618.68.0.264894087185.issue11192@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14073
pull_request: https://github.com/python/cpython/pull/14237

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue11192>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:47:45 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:47:45 +0000
Subject: [issue35995] logging.handlers.SMTPHandler
In-Reply-To: <1550133946.82.0.233218933413.issue35995@roundup.psfhosted.org>
Message-ID: <1560955665.76.0.691115372618.issue35995@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Closing, as no answer has been received to the last question.

----------
resolution:  -> not a bug
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35995>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:53:30 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:53:30 +0000
Subject: [issue36033] logging.makeLogRecord should update "rv" using a dict
 defined with bytes instead of strings
In-Reply-To: <1550573160.5.0.804221686367.issue36033@roundup.psfhosted.org>
Message-ID: <1560956010.07.0.594820012645.issue36033@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Closing, as no further feedback from issue reporter. Feel free to reopen if you have a good response to my last comment.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36033>
_______________________________________

From report at bugs.python.org  Wed Jun 19 10:59:55 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 14:59:55 +0000
Subject: [issue28890] logging.handlers: Document that QueueListener is a
 daemon thread
Message-ID: <1560956395.72.0.816862676452.issue28890@roundup.psfhosted.org>


New submission from Vinay Sajip <vinay_sajip at yahoo.co.uk>:

Why does that particularly need documenting? If it were a non-daemon thread, that might need documenting as the program would have to join() it or else seem to hang, but what does it matter if it's a daemon thread?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28890>
_______________________________________

From report at bugs.python.org  Wed Jun 19 11:11:22 2019
From: report at bugs.python.org (Inada Naoki)
Date: Wed, 19 Jun 2019 15:11:22 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1560957082.26.0.23471465456.issue37340@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Sorry, I just pushed another idea before I leave my office.
I will benchmark both ideas after bpo-37337 is finished.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Wed Jun 19 11:14:29 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 15:14:29 +0000
Subject: [issue34720] Fix test_importlib.test_bad_traverse for AIX
In-Reply-To: <1537272185.7.0.956365154283.issue34720@psf.upfronthosting.co.za>
Message-ID: <1560957269.28.0.328119781063.issue34720@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14074
pull_request: https://github.com/python/cpython/pull/14238

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34720>
_______________________________________

From report at bugs.python.org  Wed Jun 19 11:35:08 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 15:35:08 +0000
Subject: [issue35185] Logger race condition - loses lines if removeHandler
 called from another thread while logging
In-Reply-To: <1541612637.38.0.788709270274.issue35185@psf.upfronthosting.co.za>
Message-ID: <1560958508.34.0.0175824051294.issue35185@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

The other alternative would be to lock around callHandlers(). With the change you propose to addHandler/removeHandler, there are no errors, but the output of your test program is (with the lock acquisition/release in place):

Thread finished after 468 iterations
Thread finished after 488 iterations
Thread finished after 476 iterations
Thread finished after 462 iterations

If the lock acquisition/release is removed from addHandler/removeHandler, then there are still no errors, and the output is:

Thread finished after 479 iterations
Thread finished after 453 iterations
Thread finished after 468 iterations
Thread finished after 469 iterations

If I leave addHandler/removeHandler as they were and add locking around callHandlers(), there are no errors and the output is:

Thread finished after 566 iterations
Thread finished after 608 iterations
Thread finished after 612 iterations
Thread finished after 605 iterations

This seems to suggest that locking around callHandlers() is better (more performant) than the copying of handler lists involved in your suggestion. Any comments on that? Also it will work in non-GIL environments like Jython/IronPython.

The callHandlers() locking will of course add a cost even for those situations where handlers aren't added and removed in multi-threading scenarios, but I haven't benchmarked it yet. It's generally not good practice to add/remove handlers willy-nilly in threads, though of course it's not forbidden (e.g. the configuration functionality allows a thread to listen for configuration changes at runtime and then reconfigure logging, which adds/removes handlers in the thread. However, loggers are disabled while the reconfiguration is in progress, and some loss of messages would be expected to be tolerable in such a case).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35185>
_______________________________________

From report at bugs.python.org  Wed Jun 19 11:38:59 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 15:38:59 +0000
Subject: [issue29001] logging.handlers.RotatingFileHandler rotation broken
 under gunicorn
In-Reply-To: <1482004859.28.0.622019934032.issue29001@psf.upfronthosting.co.za>
Message-ID: <1560958739.48.0.922132029648.issue29001@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Closing, as per last comment.

----------
resolution:  -> not a bug
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29001>
_______________________________________

From report at bugs.python.org  Wed Jun 19 11:57:40 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 19 Jun 2019 15:57:40 +0000
Subject: [issue37339] os.path.ismount returns true on nested btrfs subvolumes
In-Reply-To: <1560939042.69.0.683071795623.issue37339@roundup.psfhosted.org>
Message-ID: <1560959860.97.0.836155539814.issue37339@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

What does the mountpoint command returns?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37339>
_______________________________________

From report at bugs.python.org  Wed Jun 19 12:04:36 2019
From: report at bugs.python.org (shajianrui)
Date: Wed, 19 Jun 2019 16:04:36 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1560960276.62.0.146687755948.issue37301@roundup.psfhosted.org>


shajianrui <shajianrui at 126.com> added the comment:

Yes I reproduce this problem with a slight modification to your demo. 

Using your origianl version I fail to reproduce, maybe 2*65536 bytes size is too small.

I just change the size of data (in test_cgi_client.py ) to 8*65536, 16*65536 and 32*65536, and the result is shown on the image I attach.

>From the image you can see
    - From 1 to 7 the length received doesn't change: always
      195540 bytes.And the process of sending are really slow.
    - At 8th test the server receive complete data. And the 
      sending is finished in a flash.(Maybe the socket suddenly
      enlarge the buffer?)
    - From 9 to 10 seems the "buffer" become smaller and smaller.

However, in my demo(Post in my last message), the data can be up to 65536*1024 bytes and ?seldom? produce this problem.

I use "seldom" because I now confirm: If too many (more than 10) testclient.py are executed at the same time, the testserver.py will produce the problem too. Like this:

    testserver.py output:
                Connection closed.
                67108864
                0
                Connection closed.
                67108864
                0
                Connection closed.
                67108864
                0
                Connection closed.
                195640               # From here the problem show up.
                42440740
                2035240
                9327940
                13074300
                35004
                0
                Connection closed.
                67108864
                0
                Connection closed.

Seems this is a normal behavior of rfile.read() that it may not return as many bytes as we tell it to read.

Now I have a problem: Why the bytes returned from "rfile.read()" is so few when the rfile is in CGIHTTPRequestHandler?

----------
Added file: https://bugs.python.org/file48428/image.PNG

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Wed Jun 19 12:05:48 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 16:05:48 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560960348.06.0.0916799437604.issue37258@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
stage: resolved -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 12:06:11 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Wed, 19 Jun 2019 16:06:11 +0000
Subject: [issue37258] Logging cache not cleared properly when setting level
In-Reply-To: <1560376108.37.0.126278550075.issue37258@roundup.psfhosted.org>
Message-ID: <1560960371.02.0.515186374069.issue37258@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
stage:  -> resolved

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37258>
_______________________________________

From report at bugs.python.org  Wed Jun 19 12:59:53 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 19 Jun 2019 16:59:53 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560963593.94.0.991226674362.issue36231@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thank you again for the suggested PR. Using "xcrun --show-sdk-path" at configure time *is* appealing.  Unfortunately, it does not cover all of the necessary use cases.

One, the --show-sdk-path option is not available on old versions of xcrun, versions we still build with to support older releases of macOS.  Second, some users build Python for macOS with compiler tool chains other than the Apple-supplied ones (for example, current gcc) that do not necessarily support the transparent selection of header and library files location via xcrun and friends.  Third, capturing the selected SDK path at configure time is no guarantee that the same SDK path will be used for extension module builds when setup.py runs.  With the Apple-supplied tools, the actual SDK path used is determined each time the compiler front-end is invoked and depends on the then-current selected values (e.g. the most recent value set by 'xcode-select --switch') and the current value of environment variables (e.g. like DEVELOPER_DIR and SDKROOT). Or a different or non-Apple compiler could now be in use by overriding CC.  In other words, lots of edge cases largely due to the inherent flexibility of Apple's compiler frontend.

The other issue here is the behavior of setup.py in trying to make reasonable default choices for finding header and library files for the extension modules it is building; to do so, it tries to guess what the compiler frontend is going to do and that's the real hack.  Life would be much simpler if Python relied on a modern autotools build setup - although some of the same issues of dynamic SDK locations would still apply but at least they would apply consistently - and not the legacy mixture of build tools we have today.  Unfortunately, it would be a big deal to replace the current build system and, while it would be desirable, that's a very big project.

One other point: while scraping the output of the compiler is hacky, it is a well-known and widely-used technique and is already in use elsewhere in setup.py; this code was adapted from that in add_multiarch_paths().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:00:11 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 19 Jun 2019 17:00:11 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1560963611.65.0.490731693409.issue36231@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
versions: +Python 2.7, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:12:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 17:12:23 +0000
Subject: [issue36753] Python modules not linking to libpython causes issues
 for RTLD_LOCAL system-wide
In-Reply-To: <1556554560.81.0.844742203447.issue36753@roundup.psfhosted.org>
Message-ID: <1560964343.01.0.808186213161.issue36753@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36753>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:22:24 2019
From: report at bugs.python.org (Eike Fokken)
Date: Wed, 19 Jun 2019 17:22:24 +0000
Subject: [issue37339] os.path.ismount returns true on nested btrfs subvolumes
In-Reply-To: <1560939042.69.0.683071795623.issue37339@roundup.psfhosted.org>
Message-ID: <1560964944.02.0.790679024574.issue37339@roundup.psfhosted.org>


Eike Fokken <e.fokken+pythontracker at posteo.de> added the comment:

mountpoint /nested_subvolume returns
/nested_subvolume is not a mountpoint

mountpoint /explicitely_mounted_subvolume returns
/explicitely_mounted_subvolume is a mountpoint

so agrees with findmnt.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37339>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:24:48 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 17:24:48 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560965088.83.0.927066489316.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

If we should put in the workaround for 3.8, how does that make it okay to remove in 3.9? It's been deprecated since 3.0 already, so if we can't remove it after eight releases, I don't see how it's consistent to remove it after a ninth. Once we put it back, it basically has to stay.

The middle ground doesn't make sense. We should either replace it with the new field, or put the new field at the end and leave the deprecated one exactly as it was.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:36:46 2019
From: report at bugs.python.org (Tim Hatch)
Date: Wed, 19 Jun 2019 17:36:46 +0000
Subject: [issue37341] str.format and f-string divergence
Message-ID: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>


New submission from Tim Hatch <tim at timhatch.com>:

TL;DR

f"{x+2}" and f"{x=}" do something sensible.
"{x+2}".format(x=1) and "{x=}".format(x=1) raise KeyError.
f"{0.1}" and "{0.1}".format(...) are different.

Having had a feature request to be able to codemod f-strings[1] and just learning about issue36817[2] last night, I went digging into how these are parsed in the standard library to be able to reuse that.

str.format, string.Formatter, and the _string module can only parse literal keys, not expressions, despite appearing to take the same syntax as f-strings.  I'm happy to contribute code to change this, but unsure if it's considered a bug or feature (now that we're past feature freeze for 3.8).  I would love to see these converge to prevent confusion and let us document in just one place.

The {} and {1} style are still exceptional.

We already parse expressions and the "=" suffix acceptably,

>>> list(_string.formatter_parser("{1+1}"))
[('', '1+1', '', None)]
>>> list(_string.formatter_parser("{(x)}"))
[('', '(x)', '', None)]
>>> list(_string.formatter_parser("{x=!r:1}"))
[('', 'x=', '1', 'r')]
>>> list(_string.formatter_parser("{ x = }"))
[('', ' x = ', '', None)]

But the consumers would need to check for /=\s*$/ and call eval on the items in formatter_field_name_split.  (I lack a good heuristic, maybe we eval every time unless it's strictly numeric?)

It would also break unusual uses like these in the name of unification

>>> "{1+1}".format(**{"1+1": "zzz"})
'zzz'

and

>>> class T:
...   pass
... 
>>> setattr(T, "0", "zero")
>>> f"{T.0}"
  File "<fstring>", line 1
    (T.0)
       ^
SyntaxError: invalid syntax
>>> "{0.0}".format(T)
'zero'

[1] https://github.com/facebookincubator/Bowler/issues/87
[2] incorrectly listed in Misc/NEWS.d/3.8.0b1.rst as issue36774 btw

----------
components: Library (Lib)
messages: 346065
nosy: barry, eric.smith, larry, lisroach, lukasz.langa, serhiy.storchaka, thatch
priority: normal
severity: normal
status: open
title: str.format and f-string divergence
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:46:59 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 19 Jun 2019 17:46:59 +0000
Subject: [issue37341] str.format and f-string divergence
In-Reply-To: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>
Message-ID: <1560966419.34.0.631399164766.issue37341@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

> str.format, string.Formatter, and the _string module can only
> parse literal keys, not expressions, despite appearing to take the
> same syntax as f-strings.  I'm happy to contribute code to change
> this, but unsure if it's considered a bug or feature (now that we're
> past feature freeze for 3.8).  I would love to see these converge to
> prevent confusion and let us document in just one place.

It's a feature that str.format does not accept expressions. If it did, it would:
1: require compiler support (eval isn't good enough)
2: be a security hole magnet

I think both of these are sufficiently strong arguments that I won't support making expressions work in str.format().

For the security hole, you don't want:

user_provided_string.format()

to be able to execute arbitrary code. You're basically eval-ing (parts of) strings, and everyone would suddenly have to audit all of their code to make sure there are no security holes exposed.

----------
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:55:53 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 17:55:53 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560966953.73.0.738146242038.issue37333@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
assignee:  -> steve.dower
type:  -> compile error
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 13:56:10 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 17:56:10 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560966970.48.0.505220991563.issue37333@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14075
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14240

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:02:45 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 18:02:45 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560967365.44.0.390890687406.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If we should put in the workaround for 3.8, how does that make it okay to remove in 3.9?

I can easily change my PR to keep it in 3.9, no problem. Nick, what do you think?

> put the new field at the end and leave the deprecated one exactly as it was.

Can you give a least an argument of why that's better than putting back tp_print at the end? I gave 3 why that's NOT a good idea: msg345357

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:14:33 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 19 Jun 2019 18:14:33 +0000
Subject: [issue37339] os.path.ismount returns true on nested btrfs subvolumes
In-Reply-To: <1560939042.69.0.683071795623.issue37339@roundup.psfhosted.org>
Message-ID: <1560968073.18.0.429891338499.issue37339@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

os.path.ismount() uses the same simple algorithm as a portable version of mountpoint. But mountpoint (and findmnt) from util-linux uses Linux specific methods (reads /proc/mounts or something like). See also issue29707.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37339>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:25:09 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 18:25:09 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560968709.42.0.927864886632.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Can you give a least an argument of why that's better than putting back tp_print at the end?

Minimal change, that's why. If there are compatibility issues with the current change that we need to fix, then we should make the least incompatible change possible, which is adding the new field at the end of the struct.

> I gave 3 why that's NOT a good idea: msg345357

Those are equally good reasons for putting tp_print back where it was, so I'm not sure what your point is?

Compatibility has to be measured against the 3.7 release, not previous 3.8 prereleases. If compatibility is the concern here, then we should be aiming for the smallest diff between 3.7 and 3.8, even if that means we change things significantly between 3.8.0b1 and b2.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:37:43 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 19 Jun 2019 18:37:43 +0000
Subject: [issue37341] str.format and f-string divergence
In-Reply-To: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>
Message-ID: <1560969463.44.0.845448576129.issue37341@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I concur with Eric.  This differences are there by design.  The technical and security reasons are both compelling.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:43:37 2019
From: report at bugs.python.org (hai shi)
Date: Wed, 19 Jun 2019 18:43:37 +0000
Subject: [issue37342] A type error in typeobj.rst
Message-ID: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

nb_index's type is unaryfunc

----------
assignee: docs at python
components: Documentation
messages: 346071
nosy: docs at python, shihai1991
priority: normal
severity: normal
status: open
title: A type error in typeobj.rst

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:46:14 2019
From: report at bugs.python.org (hai shi)
Date: Wed, 19 Jun 2019 18:46:14 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1560969974.56.0.0717751296421.issue37342@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +14076
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14241

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 14:50:21 2019
From: report at bugs.python.org (Andrew Pennebaker)
Date: Wed, 19 Jun 2019 18:50:21 +0000
Subject: [issue37343] pip: Warn on vulnerable packages
Message-ID: <1560970221.06.0.898012626205.issue37343@roundup.psfhosted.org>


New submission from Andrew Pennebaker <andrew.pennebaker at gmail.com>:

Compared to pip, NPM warns users when a dependency subtree about to be installed, includes known vulnerabilities. This helps devs catch security issues earlier, so they can update or replace critical dependencies.

Similarly, the dependency-check pip package offers the ability to detect pip dependencies with known vulnerabilities.

https://pypi.org/project/dependency-check/

Now that we have a workaround for warning on vulnerable pip packages, let's move this logic into the default pip install code, so that all Python devs are alerted on vulnerable dependencies.

----------
messages: 346072
nosy: Andrew Pennebaker
priority: normal
severity: normal
status: open
title: pip: Warn on vulnerable packages
type: security

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37343>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:01:44 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 19 Jun 2019 19:01:44 +0000
Subject: [issue37341] str.format and f-string divergence
In-Reply-To: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>
Message-ID: <1560970904.75.0.877530085261.issue37341@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

I also agree with Eric's assessment.

Thanks for the idea, Tim, but I'm closing this as rejected.

----------
nosy: +brett.cannon
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:02:24 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 19 Jun 2019 19:02:24 +0000
Subject: [issue37343] pip: Warn on vulnerable packages
In-Reply-To: <1560970221.06.0.898012626205.issue37343@roundup.psfhosted.org>
Message-ID: <1560970944.17.0.881527854092.issue37343@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks for the report. pip development happens at https://github.com/pypa/pip/ where this could get better attention since CPython just vendors latest pip. pipenv does similar check with "pipenv check" command [0]. Similar issue on GitHub : https://github.com/pypa/pip/issues/6087 . I think this can be closed as third party issue.

[0] https://docs.pipenv.org/en/latest/#pipenv-check

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37343>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:03:00 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 19:03:00 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560970980.46.0.576602552036.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If compatibility is the concern here, then we should be aiming for the smallest diff between 3.7 and 3.8

I challenge that assertion.

The smallest diff may superficially look like the best solution, but on closer inspection, it is not. It will break ABI compatibility in any case where vectorcall is used, while my proposal of putting tp_print at the end does not.

What you propose is *worse* than the status quo.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:03:18 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 19 Jun 2019 19:03:18 +0000
Subject: [issue37343] pip: Warn on vulnerable packages
In-Reply-To: <1560970221.06.0.898012626205.issue37343@roundup.psfhosted.org>
Message-ID: <1560970998.2.0.632970845433.issue37343@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37343>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:09:09 2019
From: report at bugs.python.org (Michael Felt)
Date: Wed, 19 Jun 2019 19:09:09 +0000
Subject: [issue34373] test_time errors on AIX
In-Reply-To: <1533917751.88.0.56676864532.issue34373@psf.upfronthosting.co.za>
Message-ID: <1560971349.24.0.607468285983.issue34373@roundup.psfhosted.org>


Change by Michael Felt <aixtools at felt.demon.nl>:


----------
pull_requests: +14077
pull_request: https://github.com/python/cpython/pull/14242

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34373>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:20:04 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 19 Jun 2019 19:20:04 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1560972004.88.0.516481671188.issue37342@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This was added with 9e7c92193cc98fd3c2d4751c87851460a33b9118 so adding Eric.

----------
nosy: +eric.snow, xtreak
type:  -> behavior
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 15:23:52 2019
From: report at bugs.python.org (Tim Hatch)
Date: Wed, 19 Jun 2019 19:23:52 +0000
Subject: [issue37341] str.format and f-string divergence
In-Reply-To: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>
Message-ID: <1560972232.08.0.177255928283.issue37341@roundup.psfhosted.org>


Tim Hatch <tim at timhatch.com> added the comment:

ok, I suppose it's just documentation then.

----------
assignee:  -> docs at python
components: +Documentation -Library (Lib)
nosy: +docs at python

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:07:50 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 20:07:50 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560974870.31.0.888949168093.issue37333@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 12f1c726d8328e5e096c35c36901f6d19bc942d3 by Steve Dower in branch 'master':
bpo-37333: Ensure IncludeTkinter has a value (GH-14240)
https://github.com/python/cpython/commit/12f1c726d8328e5e096c35c36901f6d19bc942d3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:07:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 20:07:50 +0000
Subject: [issue34347] AIX: test_utf8_mode.test_cmd_line fails
In-Reply-To: <1533571610.9.0.56676864532.issue34347@psf.upfronthosting.co.za>
Message-ID: <1560974870.33.0.905403088506.issue34347@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 15e7d2432294ec46f1ad84ce958fdeb9d4ca78b1 by Victor Stinner (Michael Felt) in branch '3.7':
[3.7] bpo-34347: Fix test_utf8_mode.test_cmd_line for AIX (GH-8923) (GH-14233)
https://github.com/python/cpython/commit/15e7d2432294ec46f1ad84ce958fdeb9d4ca78b1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34347>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:07:53 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 20:07:53 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560974873.88.0.463894823093.issue37333@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14078
pull_request: https://github.com/python/cpython/pull/14243

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:09:05 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 20:09:05 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560974945.52.0.977018630082.issue37333@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Backport will automerge when it's done.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:09:58 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 20:09:58 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1560974998.92.0.167136145839.issue36511@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f355069a3337711642c3403429afb9faef93f512 by Steve Dower (Paul Monson) in branch 'master':
bpo-36511: Add buildbot scripts and fix tests for Windows ARM32 buildbot (GH-13454)
https://github.com/python/cpython/commit/f355069a3337711642c3403429afb9faef93f512


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:10:09 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 20:10:09 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1560975009.17.0.444524525961.issue36511@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14079
pull_request: https://github.com/python/cpython/pull/14244

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:26:10 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 19 Jun 2019 20:26:10 +0000
Subject: [issue37333] Fail build on windows 10(visual studio 2019)
In-Reply-To: <1560912737.2.0.798167904495.issue37333@roundup.psfhosted.org>
Message-ID: <1560975970.02.0.524392074698.issue37333@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 389abd37ba50a327ae7388c6b016604cbd980e4b by Miss Islington (bot) in branch '3.8':
bpo-37333: Ensure IncludeTkinter has a value (GH-14240)
https://github.com/python/cpython/commit/389abd37ba50a327ae7388c6b016604cbd980e4b


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37333>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:30:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 20:30:04 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560976204.13.0.955706274118.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> It will break ABI compatibility in any case where vectorcall is used, while my proposal of putting tp_print at the end does not.

ABI compatibility with what? We haven't released vectorcall yet, so it has no compatibility baseline.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:34:15 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 19 Jun 2019 20:34:15 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560976455.11.0.271911034189.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> We haven't released vectorcall yet, so it has no compatibility baseline.

I'm talking about the "extremely unlikely" scenario mentioned earlier: a class compiled with 3.7 could subclass a class compiled with 3.8 which uses vectorcall.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:39:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 20:39:03 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560976743.09.0.59961367906.issue37250@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> If we should put in the workaround for 3.8, how does that make it okay to remove in 3.9?

Cython has been modified to no longer set tp_print. The idea is just to give more time (one Python major release) to maintainers of C extensions to regenerate their Cython .c files.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:44:12 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 19 Jun 2019 20:44:12 +0000
Subject: [issue20175] Derby #6: Convert 50 sites to Argument Clinic across 8
 files
In-Reply-To: <1389138499.96.0.517173661563.issue20175@psf.upfronthosting.co.za>
Message-ID: <1560977052.44.0.148680188267.issue20175@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14080
pull_request: https://github.com/python/cpython/pull/14245

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20175>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:49:12 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 19 Jun 2019 20:49:12 +0000
Subject: [issue20175] Derby #6: Convert 50 sites to Argument Clinic across 8
 files
In-Reply-To: <1389138499.96.0.517173661563.issue20175@psf.upfronthosting.co.za>
Message-ID: <1560977352.6.0.344980679481.issue20175@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

PR 14245 converts Modules/_multiprocessing/semaphore.c and Modules/_multiprocessing/multiprocessing.c.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20175>
_______________________________________

From report at bugs.python.org  Wed Jun 19 16:50:41 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 19 Jun 2019 20:50:41 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1560977441.44.0.54199906749.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> a class compiled with 3.7 could subclass a class compiled with 3.8 which uses vectorcall.

This isn't a supported scenario though. The only way to mix extension modules compiled against different Python versions is to use the limited ABI, which does not include PyTypeObject. And PyType_FromSpec is going to allocate a PyTypeObject according to the version of Python that is running, not the one it was compiled against. So even if someone could force this scenario, it's not one we have to worry about.

> The idea is just to give more time (one Python major release) to maintainers of C extensions to regenerate their Cython .c files.

If the beta cycle isn't long enough for this, then we need a longer beta cycle, since that's the whole point of it. Projects that can't make at least one new release with update Cython in time for Python 3.8 are presumably completely unmaintained - it's not like the 3.8 release is a huge surprise - and if completely unmaintained they aren't going to get a new release for 3.9 either. So either we fix them permanently by not removing tp_print ever, or we give them an entire beta release period to update their code for the new version of Python.

There's a discussion at https://discuss.python.org/t/pep-596-python-3-9-release-schedule-doubling-the-release-cadence/1828 about updating the release cycle, and a couple of PEPs being written. That would be a good place to suggest that our current beta release is not long enough for packages to adapt to new releases.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Wed Jun 19 17:16:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 21:16:04 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560978964.75.0.585670588044.issue36710@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14081
pull_request: https://github.com/python/cpython/pull/14249

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Wed Jun 19 17:57:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 21:57:31 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560981451.65.0.688096597826.issue36710@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14082
pull_request: https://github.com/python/cpython/pull/14250

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Wed Jun 19 18:01:43 2019
From: report at bugs.python.org (Paul Monson)
Date: Wed, 19 Jun 2019 22:01:43 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1560981703.94.0.27818197628.issue36511@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
pull_requests: +14083
pull_request: https://github.com/python/cpython/pull/14251

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Wed Jun 19 18:05:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 19 Jun 2019 22:05:27 +0000
Subject: [issue36710] Pass _PyRuntimeState as an argument rather than using
 the _PyRuntime global variable
In-Reply-To: <1556110680.79.0.127639989845.issue36710@roundup.psfhosted.org>
Message-ID: <1560981927.15.0.987739099471.issue36710@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset b45d259bdda1de2b2d369458a9ad2e4d6f750687 by Victor Stinner in branch 'master':
bpo-36710: Use tstate in pylifecycle.c (GH-14249)
https://github.com/python/cpython/commit/b45d259bdda1de2b2d369458a9ad2e4d6f750687


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36710>
_______________________________________

From report at bugs.python.org  Wed Jun 19 19:18:35 2019
From: report at bugs.python.org (Shane G)
Date: Wed, 19 Jun 2019 23:18:35 +0000
Subject: [issue37344] plistlib doesn't skip whitespace in XML format detection
Message-ID: <1560986315.2.0.263815565154.issue37344@roundup.psfhosted.org>


New submission from Shane G <pachoo at gmail.com>:

plistlib in Python 3.7.3 (and earlier) does not autodetect plist data as XML if it contains whitespace before the "<?xml" tag.  Apple tools (and code) however, do.

Suggestion:  lstrip() the header bytes before comparison

Source Link: https://github.com/python/cpython/blob/3.7/Lib/plistlib.py#L493

----------
messages: 346089
nosy: shaneg
priority: normal
severity: normal
status: open
title: plistlib doesn't skip whitespace in XML format detection
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37344>
_______________________________________

From report at bugs.python.org  Wed Jun 19 19:59:55 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 19 Jun 2019 23:59:55 +0000
Subject: [issue37344] plistlib doesn't skip whitespace in XML format detection
In-Reply-To: <1560986315.2.0.263815565154.issue37344@roundup.psfhosted.org>
Message-ID: <1560988795.46.0.813050420955.issue37344@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks for the report.  Would you be interested in providing a pull request with a fix?

----------
nosy: +ned.deily, ronaldoussoren
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37344>
_______________________________________

From report at bugs.python.org  Wed Jun 19 20:19:49 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Thu, 20 Jun 2019 00:19:49 +0000
Subject: [issue31122] SSLContext.wrap_socket() throws OSError with errno == 0
In-Reply-To: <1501874201.48.0.0126792321555.issue31122@psf.upfronthosting.co.za>
Message-ID: <1560989989.04.0.114945188306.issue31122@roundup.psfhosted.org>


Change by Dima Tisnek <dimaqq at gmail.com>:


----------
nosy: +Dima.Tisnek

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31122>
_______________________________________

From report at bugs.python.org  Wed Jun 19 20:21:24 2019
From: report at bugs.python.org (Lisa Roach)
Date: Thu, 20 Jun 2019 00:21:24 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1560990084.47.0.957303514917.issue37251@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:

Thanks for the patch!

To answer your question, I do not think we can remove _is_async_func in favor of _is_async_obj, _is_async_obj will evaluate to True in cases where _is_async_func would not. 

For example:

>>> class NewCoroutine(Awaitable):
...     def __await__():
...         pass
...
>>> c = NewCoroutine()
>>> import inspect
>>> inspect.isawaitable(c)
True
>>> inspect.iscoroutinefunction(c)
False


BUT I think removing the `if getattr(obj, '__code__', None)` from `_is_async_obj` actually makes this work correctly. It is possible for a coroutine object to not have a __code__, but I don't think it is possible for a coroutine function to be missing a __code__. 

Before removing the __code__ check:

>>> from unittest.mock import _is_async_func, _is_async_obj
>>> import asyncio
>>> _is_async_obj(asyncio.sleep(1))
<stdin>:1: RuntimeWarning: coroutine 'sleep' was never awaited
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
False
>>> _is_async_func(asyncio.sleep(1))
False

_is_async_obj evaluates to False when it should be True

After removing it:

>>> from unittest.mock import _is_async_func, _is_async_obj
>>> import asyncio
>>> _is_async_obj(asyncio.sleep(1))
<stdin>:1: RuntimeWarning: coroutine 'sleep' was never awaited
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
True
>>> _is_async_func(asyncio.sleep(1))
False

It correctly evaluates to True

All tests pass as well. What do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 19 23:32:27 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 20 Jun 2019 03:32:27 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1561001547.88.0.452287586118.issue37342@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bc5caf88ca19b4c8cb9bc912c832b4807a515a60 by Miss Islington (bot) (Hai Shi) in branch 'master':
bpo-37342: Fix the incorrect nb_index's type in typeobj documentation (GH-14241)
https://github.com/python/cpython/commit/bc5caf88ca19b4c8cb9bc912c832b4807a515a60


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 23:33:20 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 20 Jun 2019 03:33:20 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1561001600.63.0.703643037361.issue37342@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14084
pull_request: https://github.com/python/cpython/pull/14254

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 23:41:44 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 20 Jun 2019 03:41:44 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1561002104.72.0.726501460126.issue37342@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6258c1f7160c1b073a228c9fc49ad5ac894d66ad by Miss Islington (bot) in branch '3.8':
bpo-37342: Fix the incorrect nb_index's type in typeobj documentation (GH-14241)
https://github.com/python/cpython/commit/6258c1f7160c1b073a228c9fc49ad5ac894d66ad


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Wed Jun 19 23:48:57 2019
From: report at bugs.python.org (Ammar Askar)
Date: Thu, 20 Jun 2019 03:48:57 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1561002537.09.0.397198574676.issue29505@roundup.psfhosted.org>


Change by Ammar Askar <ammar at ammaraskar.com>:


----------
pull_requests: +14085
pull_request: https://github.com/python/cpython/pull/14255

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Thu Jun 20 00:15:02 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 04:15:02 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1561004102.5.0.577049356602.issue37340@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Are the benchmark results that you posted above for removing the free list completely or for the one-element free list as in PR 14232?

Yes.  I see +3% overhead in several benchmarks and I want to see how one free obj save them.

> it's worse than no free list because you still have the overhead of dealing with the one object.

Yes.  But it still helps some common simple cases.
(e.g. PyObject_CallMethod() (not CallMethodObjArg))

> And it's worse than a free list of 256 because it won't for nested calls.

256 free list may bother 256 pools are reused.  But one free obj keeps only one pool.  And we can remove the overhead of linked list too.

Of course, I prefer a simple code.  But let's wait for benchmark result.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Thu Jun 20 00:20:20 2019
From: report at bugs.python.org (Ken Healy)
Date: Thu, 20 Jun 2019 04:20:20 +0000
Subject: [issue37205] time.perf_counter() is not system-wide on Windows,
 in disagreement with documentation
In-Reply-To: <1560017700.11.0.127727162727.issue37205@roundup.psfhosted.org>
Message-ID: <1561004420.41.0.714810237492.issue37205@roundup.psfhosted.org>


Ken Healy <healykb+pythonbugs at gmail.com> added the comment:

Hi Terry,

I'm new to this so apologies in advance if this is a silly question...can you explain why you removed 3.5 and 3.6 from the versions list? I have tested that the issue is present in 3.6 and the offending code has been present since time.perf_counter() was introduced in 3.3.

It it because these versions are in maintenance-only status or similar, such that this type of bug fix would not be considered?

Thanks,
Ken

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37205>
_______________________________________

From report at bugs.python.org  Thu Jun 20 00:29:34 2019
From: report at bugs.python.org (vsbogd)
Date: Thu, 20 Jun 2019 04:29:34 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1561004974.13.0.399330118044.issue37301@roundup.psfhosted.org>


vsbogd <vsbogd at gmail.com> added the comment:

Hi @shajianrui,

Thank you for such detailed explanation of experiments.

As you mentioned it is a expected behavior of the io.RawIOBase.read() (see https://docs.python.org/3/library/io.html#io.RawIOBase), but io.BufferedIOBase.read() has different behavior (see https://docs.python.org/3/library/io.html#io.BufferedIOBase.read) and returns requested number of bytes (if stream is not interactive). So it is not surprising that this issue is being reproducible randomly and differently for Windows and Linux. 

I think it may be better reproducible in CGIHTTPRequestHandler because it reads header of the request first.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Thu Jun 20 00:36:12 2019
From: report at bugs.python.org (Mariatta Wijaya)
Date: Thu, 20 Jun 2019 04:36:12 +0000
Subject: [issue37205] time.perf_counter() is not system-wide on Windows,
 in disagreement with documentation
In-Reply-To: <1560017700.11.0.127727162727.issue37205@roundup.psfhosted.org>
Message-ID: <1561005372.73.0.464625756797.issue37205@roundup.psfhosted.org>


Mariatta Wijaya <mariatta at python.org> added the comment:

> can you explain why you removed 3.5 and 3.6 from the versions list? 

3.5 and 3.6 are closed for regular bug fix maintenance. We're only fixing issues in 3.7 and 3.8 now.

Only security fixes will be applied to 3.5 or 3.6, and this issue is not considered a security issue.

More details in https://devguide.python.org/#status-of-python-branches

----------
nosy: +Mariatta

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37205>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:12:50 2019
From: report at bugs.python.org (vsbogd)
Date: Thu, 20 Jun 2019 05:12:50 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1561007570.29.0.070197013944.issue37301@roundup.psfhosted.org>


vsbogd <vsbogd at gmail.com> added the comment:

My last comment was imprecise. Not `CGIHTTPRequestHandler` reads data from `rfile` but CGI script itself makes few reads.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:14:38 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 05:14:38 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561007678.25.0.311665456932.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> This isn't a supported scenario though.

Of course it's not! I was trying to tell you that already in msg345969 but you insisted in msg345988 that we should support that anyway.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:27:35 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 05:27:35 +0000
Subject: [issue9665] Buid issues on Cygwin - _curses, _curses_panel, and _io
In-Reply-To: <1282599121.2.0.918330648156.issue9665@psf.upfronthosting.co.za>
Message-ID: <1561008455.31.0.781117983025.issue9665@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue9665>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:34:33 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 05:34:33 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561008873.14.0.0618504065373.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

The fact that tp_vectorcall_offset replaces tp_print was a very conscious decision that we made already when designing the PEPs (both PEP 580 and PEP 590). We shouldn't just throw that away without a good reason.

So far I haven't seen any good reason, only an unsubstantiated claim that it is supposedly more backwards compatible to put tp_vectorcall_offset at the end.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:47:50 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 20 Jun 2019 05:47:50 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1561009670.34.0.903504335151.issue36231@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14086
pull_request: https://github.com/python/cpython/pull/14256

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Thu Jun 20 01:59:59 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 20 Jun 2019 05:59:59 +0000
Subject: [issue36231] no "proper" header files on macOS 10.14 Mojave
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1561010399.82.0.679122817047.issue36231@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset c421c66a58a6caae30f0679d7e61411418e67cec by Ned Deily in branch '2.7':
bpo-36231: Support building on macOS without /usr/include (GH-13773) (GH-14256)
https://github.com/python/cpython/commit/c421c66a58a6caae30f0679d7e61411418e67cec


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:08:24 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 20 Jun 2019 06:08:24 +0000
Subject: [issue19960] MacOSX: Building 2.7 without the xcode command line
 tools installed
In-Reply-To: <1386850025.77.0.292014271005.issue19960@psf.upfronthosting.co.za>
Message-ID: <1561010904.82.0.311281600459.issue19960@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
pull_requests: +14087
pull_request: https://github.com/python/cpython/pull/14257

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19960>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:34:31 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 20 Jun 2019 06:34:31 +0000
Subject: [issue19960] zlib skipped when building 2.7 on macOS without
 /usr/include installed
In-Reply-To: <1386850025.77.0.292014271005.issue19960@psf.upfronthosting.co.za>
Message-ID: <1561012471.07.0.44253473299.issue19960@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Now that Apple, as of 10.14, has removed the option to install system header files into their traditional locations (like /usr/include), thus making every build a build from an SDK, this problem is now more noticeable.  At least, I finally noticed it while fixing the more general problems that setup.py had on all branches (see Issue36231).  This issue is in addition and is specific to 2.7.  As can be seen in Ronald's patch, which I didn't find until after I had written my own, the problem is that, in 2.7's setup.py, add_dir_to_list() does not take the SDK manipulation into account and, in particular, skips adding /usr/include because that directory doen't exist in the root filesystem anymore.  On my systems, besides zlib, the dbm and nis modules were also being skipped. Curiously, some other extension modules with system library dependencies do get built properly, like _sqlite3, because their build step in setup.py explicitly added /usr/include to the SDK search paths.

Anyway, the PR I produced is somewhat more complicated that Ronald's original patch.  It's more careful about what paths it checks for and it also stores the directory name, if found, without the prepended SDK path.  That may be important in other steps in setup.py where it is doing path comparisons.  The SDK will eventually get added again, either explicitly or implicitly by the compiler tool chain.

----------
priority: normal -> high
title: MacOSX: Building 2.7 without the xcode command line  tools installed -> zlib skipped when building 2.7 on macOS without /usr/include installed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19960>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:35:47 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Thu, 20 Jun 2019 06:35:47 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
Message-ID: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>


New submission from Gabe Appleton <gabe at gabeappleton.me>:

At the moment you can definitely use UDPLITE sockets on Linux systems, but it would be good if this support were formalized such that you can detect support at runtime easily.

At the moment, to make and use a UDPLITE socket requires something like the following code:

>>> import socket
>>> a = socket.socket(socket.AF_INET, socket.SOCK_DGRAM, 136)
>>> b = socket.socket(socket.AF_INET, socket.SOCK_DGRAM, 136)
>>> a.bind(('localhost', 44444))
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.setsockopt(136, 10, 16)
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.setsockopt(136, 10, 32)
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.setsockopt(136, 10, 64)
>>> b.sendto(b'test'*256, ('localhost', 44444))

If you look at this through Wireshark, you can see that the packets are different in that the checksums and checksum coverages change.

With the pull request that I am submitting momentarily, you could do the following code instead:

>>> import socket
>>> a = socket.socket(socket.AF_INET, socket.SOCK_DGRAM, socket.IPPROTO_UDPLITE)
>>> b = socket.socket(socket.AF_INET, socket.SOCK_DGRAM, socket.IPPROTO_UDPLITE)
>>> a.bind(('localhost', 44444))
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.set_send_checksum_coverage(16)
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.set_send_checksum_coverage(32)
>>> b.sendto(b'test'*256, ('localhost', 44444))
>>> b.set_send_checksum_coverage(64)
>>> b.sendto(b'test'*256, ('localhost', 44444))

One can also detect support for UDPLITE just by checking

>>> hasattr(socket, 'IPPROTO_UDPLITE')

----------
components: Library (Lib)
messages: 346103
nosy: gappleto97
priority: normal
severity: normal
status: open
title: Add formal support for UDPLITE protococl
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:37:53 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Thu, 20 Jun 2019 06:37:53 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561012673.91.0.0208593029767.issue37345@roundup.psfhosted.org>


Change by Gabe Appleton <gabe at gabeappleton.me>:


----------
keywords: +patch
pull_requests: +14088
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14258

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:46:28 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 20 Jun 2019 06:46:28 +0000
Subject: [issue36231] Support builds on macOS without installed system header
 files
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1561013188.51.0.443322066701.issue36231@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks again everyone.  The general solution has now been merged to all active branches for release in 3.8.0, 3.7.4, and 2.7.17.

Note that Issue19960 identifies an additional problem only on 2.7 where a few extension modules, notably zlib, are still not being built when header files are not installed; a PR for that issue is currently awaiting review.

----------
components: +Build
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
title: no "proper" header files on macOS 10.14 Mojave -> Support builds on macOS without installed system header files

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Thu Jun 20 02:49:49 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 20 Jun 2019 06:49:49 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561013389.62.0.787090030227.issue37345@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Thu Jun 20 03:14:50 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Thu, 20 Jun 2019 07:14:50 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561014890.15.0.0914302697757.issue37250@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

I agree with Steve that renaming tp_print to tp_vectorcall_offset is well within our rights.

For reference, the rationale for the replacing is the first section of:
   https://mail.python.org/pipermail/python-dev/2018-June/153927.html 
I hope Cython's situation here has not changed. (In that case, we should bring tp_print back, and add tp_vectorcall_offset to the end.)


Now, I see the question of bringing tp_print back as a *practical* compatibility matter, a workaround for the combination of two unfortunate issues:
- Cython sets tp_print in Python 3 (which is a bug, but honestly, the word "reserved" could very well be interpreted as "unused" rather than "don't touch this" -- and even the post linked above, and by extension PEP 590, implies that interpretation!)
- Packages hard-code Cython-generated files (which is a workaround for a long-standing setuptools limitation that is only recently being addressed).

If we bring tp_print back, it would be because *we shouldn't punish users* even if we can. Nobody did anything wrong, apart from a quite understandable bug/misunterstanding.


Note that 3rd party projects *do not* have the whole beta cycle to adapt. Until NumPy works, its dependents can't start adapting. (Unless adapting is done without PyPI packages, like the Fedora rebuild where we now "re-Cythonize" everything.)
On the other hand, 3rd party projects don't really *need* to support 3.8.0 as soon as it's released. It's just that if they don't support the betas and RCs, we're don't get feedback for them in time.


So I think the question is: Is (the rest of) the beta cycle enough for enough of the ecosystem to release new wheels, or should we give them the whole 3.9 cycle?

I believe 3.8 beta2 is enough, and we don't need to bring tp_print back.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 03:43:34 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 20 Jun 2019 07:43:34 +0000
Subject: [issue37319] Deprecate using random.randrange() with non-integers
In-Reply-To: <1560801155.55.0.20318571261.issue37319@roundup.psfhosted.org>
Message-ID: <1561016614.29.0.603291486969.issue37319@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Why this code uses int() at all? My guess is that it was added for earlier detection of user errors, otherwise the user could get a TypeError or AttributeError with unrelated message, or even a wrong result. int() is used just for type checking. But it is not good tool for this. int() does several different actions:

1. Parses string representation of integer.

2. Converts a real number to an integer with some truncation.

3. Losslessly converts an int-like number into an instance of int.

The first two options are not applicable here, so we need an additional check

        if istart != start:
            raise ValueError("non-integer arg 1 for randrange()")

And this is not perfect: for randrange('5') we get a ValueError instead of expected TypeError.

operator.index() is better tool for this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37319>
_______________________________________

From report at bugs.python.org  Thu Jun 20 04:04:55 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 20 Jun 2019 08:04:55 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1561017895.23.0.435588102528.issue36422@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

I implemented an onerror callback for tempfile.TemporaryDirectory() and confirmed that it cannot be used to unmount a mount point.  Attempting to unmount the mount point from within the callback results in a resource busy error.  It may be related to shutil.rmtree() holding an open file descriptor to the parent directory of the mount point.

I uploaded the program I used for testing on macOS (test-mounted-image.py). The subprocess.run() calls can be modified to run it on other platforms.

----------
Added file: https://bugs.python.org/file48429/test-mounted-image.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Thu Jun 20 04:22:24 2019
From: report at bugs.python.org (Dmitrii Pasechnik)
Date: Thu, 20 Jun 2019 08:22:24 +0000
Subject: [issue36231] Support builds on macOS without installed system header
 files
In-Reply-To: <1552039427.3.0.599611853277.issue36231@roundup.psfhosted.org>
Message-ID: <1561018944.75.0.481276196582.issue36231@roundup.psfhosted.org>


Dmitrii Pasechnik <dimpase at gmail.com> added the comment:

Thanks for the review of our PR. I think not all points made there are relevant:

* on older systems, where `xcrun --show-sdk-path` is not available, one can assume that /usr/include is there, and simply set the corresponding variable to this value in ./configure

* building Python with a non-system compiler is only possible with system headers, and thus either SDK or at least command line tools, available, and all is well.

* mid-flight switching to a different SDK/compiler is dodgy, and in particular switching to a different set of headers is asking for trouble. And the gcc toolchain is not much different in this way - e.g. on Gentoo one can do gcc-config to switch from one profile to another, with provably "interesting" results if it is done mid-flight.  

* the Python 2.7 zlib issue is not a problem with our PR. 

---------

Most probably, the desired switch to autotools can only happen gradually, by moving more of setup.py to ./configure, and our PR is a step in such direction.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36231>
_______________________________________

From report at bugs.python.org  Thu Jun 20 04:24:56 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 20 Jun 2019 08:24:56 +0000
Subject: [issue37341] str.format and f-string divergence
In-Reply-To: <1560965806.8.0.169696546862.issue37341@roundup.psfhosted.org>
Message-ID: <1561019096.95.0.766053943957.issue37341@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

I've fixed the bpo number in Misc/NEWS.d/3.8.0b1.rst. Thanks for reporting that.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37341>
_______________________________________

From report at bugs.python.org  Thu Jun 20 05:07:59 2019
From: report at bugs.python.org (Ezio Melotti)
Date: Thu, 20 Jun 2019 09:07:59 +0000
Subject: [issue37328] remove deprecated HTMLParser.unescape
In-Reply-To: <1560839410.8.0.633433607628.issue37328@roundup.psfhosted.org>
Message-ID: <1561021679.06.0.142205293585.issue37328@roundup.psfhosted.org>


Change by Ezio Melotti <ezio.melotti at gmail.com>:


----------
nosy: +ezio.melotti

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37328>
_______________________________________

From report at bugs.python.org  Thu Jun 20 05:08:56 2019
From: report at bugs.python.org (Tim Hoffmann)
Date: Thu, 20 Jun 2019 09:08:56 +0000
Subject: [issue37346] Documentation of os not using OSError subclasses
Message-ID: <1561021736.27.0.454231232898.issue37346@roundup.psfhosted.org>


New submission from Tim Hoffmann <tim.hoffmann at posteo.de>:

The documentation of `os` does not use the more specific `OSError` subclasses introduced in PEP 3151.

----------
assignee: docs at python
components: Documentation
messages: 346110
nosy: docs at python, timhoffm
priority: normal
severity: normal
status: open
title: Documentation of os not using OSError subclasses

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37346>
_______________________________________

From report at bugs.python.org  Thu Jun 20 05:18:40 2019
From: report at bugs.python.org (Eike Fokken)
Date: Thu, 20 Jun 2019 09:18:40 +0000
Subject: [issue37339] os.path.ismount returns true on nested btrfs subvolumes
In-Reply-To: <1560939042.69.0.683071795623.issue37339@roundup.psfhosted.org>
Message-ID: <1561022320.22.0.475253633852.issue37339@roundup.psfhosted.org>


Eike Fokken <e.fokken+pythontracker at posteo.de> added the comment:

I read the other issue, thanks.

What do you mean by "portable version of mountpoint"? Is there a portable version of mountpoint or was it more a figure of speech?

Concerning the issue itself:

What are the priorities with the behaviour of ismount?
Is it more important to be consistent with the system it is run on or is it more important that every python instance on every system would return the same values?

I see merits for both, I'm just curious what the python developers value more.

In case it is the later I propose to change the docs on ismount again to include that it disagrees with Linux on nested btrfs subvolumes.

If you like I can make a pull request for that.
My favourite solution would be to have agreement with linux on this but at the moment I have no idea how that could be implemented without resorting to Linux native utilities.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37339>
_______________________________________

From report at bugs.python.org  Thu Jun 20 05:18:54 2019
From: report at bugs.python.org (Tim Hoffmann)
Date: Thu, 20 Jun 2019 09:18:54 +0000
Subject: [issue37346] Documentation of os not using OSError subclasses
In-Reply-To: <1561021736.27.0.454231232898.issue37346@roundup.psfhosted.org>
Message-ID: <1561022334.06.0.133818724602.issue37346@roundup.psfhosted.org>


Change by Tim Hoffmann <tim.hoffmann at posteo.de>:


----------
keywords: +patch
pull_requests: +14090
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14262

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37346>
_______________________________________

From report at bugs.python.org  Thu Jun 20 06:54:58 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Thu, 20 Jun 2019 10:54:58 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561028098.86.0.816855722789.issue37345@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Adding new constants like socket.IPPROTO_UDPLITE is fine.
The question is: why we need a new function?
There is no set_send_checksum_coverage() on C level IIRC

----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:09:37 2019
From: report at bugs.python.org (Martin Teichmann)
Date: Thu, 20 Jun 2019 11:09:37 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1561028977.52.0.234780211982.issue37334@roundup.psfhosted.org>


Martin Teichmann <martin.teichmann at gmail.com> added the comment:

I also thought about `.close()` but then found `.cancel()` more intuitive. But intuition is not universal, so I am open to any wording.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:14:59 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Thu, 20 Jun 2019 11:14:59 +0000
Subject: [issue37347] Reference-counting problem in sqlite
Message-ID: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>


New submission from Aleksandr Balezin <gescheit12 at gmail.com>:

There are a couple of bugs in sqlite bindings have been found related to reference-counting.
Short info:
sqlite connection class uses a dict to keep references to callbacks. This mechanism is not suitable for objects which equals but not the same. 
con = sqlite3.connect()
con.set_trace_callback(logger.debug) 
con.set_trace_callback(logger.debug)  # logger.debug == logger.debug is True, but logger.debug is logger.debug is False because logger.debug bound method is creating in every call
leads to segmentation fault during calling of trace_callback.
My patch fixes this behavior by using a dedicated variable for keeping references to each callback and using dict indexed by function name in case of named callbacks(e.g. create_function()).
Also, due to keeping objects in a variable or in a dict value, it is possible to use unhashable objects as callbacks. e.g. issue7478

Long version:
Sqlite under the hood use dict(called function_pinboard) to keep references to callbacks like progress_handler. 
It needs to decref callbacks objects after closing sqlite connection. 
This mechanism works tolerably(see bug with leaks) with functions but if you try to use bounded methods it causes a segmentation fault.
Let see how it works.

static PyObject *
Custom_set_callback(CustomObject *self, PyObject* args)
{
	PyObject* display_str;
	display_str = PyUnicode_FromFormat("set_callback called with cb=%R id=%i ob_refcnt=%i\n", args, args, args->ob_refcnt);
	PyObject_Print(display_str, stdout, Py_PRINT_RAW);
	if (PyDict_SetItem(self->function_pinboard, args, Py_None) == -1) return NULL;
	//sqlite3_trace(self->db, _trace_callback, trace_callback);
	self->callback_handler = args;
	display_str = PyUnicode_FromFormat("set_callback done for cb=%R id=%i ob_refcnt=%i\n", args, args, args->ob_refcnt);
	PyObject_Print(display_str, stdout, Py_PRINT_RAW);
	Py_RETURN_NONE;
}
static PyObject *
Custom_call_callback(CustomObject *self)
{
	PyObject* display_str;
	display_str = PyUnicode_FromFormat("call with id=%i ob_refcnt=%i\n", self->callback_handler ,
    self->callback_handler->ob_refcnt);
	PyObject_Print(display_str, stdout, Py_PRINT_RAW);
	Py_RETURN_NONE;
}

Python code:
>>>> class TEST:
        def log(self, msg=""):
            pass
>>>> t = TEST()
>>>> conn = Custom()
>>>> conn.set_trace_callback(t.log)
set_callback called with cb=<bound method TEST.log of <__main__.TEST object at 0x10bc60128>> id=196094408 ob_refcnt=1
set_callback done for cb=<bound method TEST.log of <__main__.TEST object at 0x10bc60128>> id=196094408 ob_refcnt=2
>>>> conn.set_trace_callback(t.log)
set_callback called with cb=<bound method TEST.log of <__main__.TEST object at 0x10bc60128>> id=196095112 ob_refcnt=1
set_callback done for cb=<bound method TEST.log of <__main__.TEST object at 0x10bc60128>> id=196095112 ob_refcnt=1
conn.call()
call with id=196095112 ob_refcnt=0

After second conn.set_trace_callback(t.log) call, object t.log reference-count is not increased because 't.log in self->function_pinboard' returns True thus self->function_pinboard[t.log] is not replaced and t.log is not increfed, but it replaces old object in self->callback_handler.
In the end, self->callback_handler keeps a pointer to t.log with ob_refcnt = 0.

Also, there is no cleaning of self->function_pinboard. This leads to leaks every object passed as callback(see test_leak() in bug.py).

----------
components: Extension Modules
messages: 346114
nosy: gescheit, ghaering
priority: normal
severity: normal
status: open
title: Reference-counting problem in sqlite
type: crash
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:17:49 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Thu, 20 Jun 2019 11:17:49 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561029469.45.0.422255670849.issue37347@roundup.psfhosted.org>


Change by Aleksandr Balezin <gescheit12 at gmail.com>:


Added file: https://bugs.python.org/file48430/bug.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:40:57 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 11:40:57 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
Message-ID: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>


New submission from Inada Naoki <songofacandy at gmail.com>:

_PyUnicode_FromASCII(s, len) is faster than PyUnicode_FromString(s) because PyUnicode_FromString() uses temporary _PyUnicodeWriter to support UTF-8.

But _PyUnicode_FromASCII("hello", strlen("hello"))` is not as easy as `PyUnicode_FromString("hello")`.

_PyUnicode_FROM_ASCII() is simple macro which wraps _PyUnicode_FromASCII which calls strlen() automatically:

```
/* Convenient wrapper for _PyUnicode_FromASCII */
#define _PyUnicode_FROM_ASCII(s) _PyUnicode_FromASCII((s), strlen(s))
```

I believe recent compilers optimize away calls of strlen().

----------
components: Interpreter Core
messages: 346115
nosy: inada.naoki
priority: normal
severity: normal
status: open
title: add _PyUnicode_FROM_ASCII macro
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:41:20 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 11:41:20 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561030880.62.0.575730696745.issue37348@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
keywords: +patch
pull_requests: +14091
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14264

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 07:58:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 20 Jun 2019 11:58:17 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561031897.52.0.583412931457.issue37348@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> #define _PyUnicode_FROM_ASCII(s) _PyUnicode_FromASCII((s), strlen(s))

LGTM.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 08:27:06 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 12:27:06 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561033626.69.0.538118805133.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I confirmed at least one measurable speedup:

./python -m pyperf timeit -s 'd={}' -- 'repr(d)'

FromString: Mean +- std dev: 157 ns +- 3 ns
FROM_ASCII: Mean +- std dev: 132 ns +- 3 ns

>>> (157-132)/157
0.1592356687898089

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 08:39:17 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 12:39:17 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561034357.38.0.683819668367.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Should we make these APIs public?

* rename `_PyUnicode_FromASCII` to `PyUnicode_FromASCIIAndSize`.
* add `PyUnicode_FromASCII` as static inline function (without ABI).
* add `#define _PyUnicode_FromASCII PyUnicode_FromASCIIAndSize` for source code compatibility.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 09:54:58 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Thu, 20 Jun 2019 13:54:58 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561038898.2.0.0372988644917.issue37347@roundup.psfhosted.org>


Change by Aleksandr Balezin <gescheit12 at gmail.com>:


----------
keywords: +patch
pull_requests: +14092
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14265

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:03:34 2019
From: report at bugs.python.org (Ben Spiller)
Date: Thu, 20 Jun 2019 14:03:34 +0000
Subject: [issue35185] Logger race condition - loses lines if removeHandler
 called from another thread while logging
In-Reply-To: <1541612637.38.0.788709270274.issue35185@psf.upfronthosting.co.za>
Message-ID: <1561039414.42.0.528306300619.issue35185@roundup.psfhosted.org>


Ben Spiller <spiller.ben at gmail.com> added the comment:

I'd definitely suggest we go for a solution that doesn't hit performance of normal logging when you're not adding/removing things, being as that's the more common case. I guess that's the reason why callHandlers was originally implemented without grabbing the mutex, and we should probably keep it that way. Logging can be a performance-critical part of some applications and I feel more comfortable about the fix (and more confident it won't get vetoed :)) if we can avoid changing callHandlers(). 

You make a good point about ensuring the solution works for non-GIL python versions. I thought about it some more... correct me if I'm wrong but as far as I can see the second idea I suggested should do that, i.e.
- self.handlers.remove(hdlr)
+ newhandlers = list(self.handlers)
+ newhandlers.remove(hdlr)
+ self.handlers = hdlr

... which effectively changes the model so that the _value_ of the self.handlers list is immutable (only which list the self.handlers reference points to changes), so without relying on any GIL locking callHandlers will still see the old list or the new list but never see an inconsistent value, since such a list never exists. That solves the read-write race condition; we'd still want to keep the existing locking in add/removeHandler which prevents write-write race conditions. 

What do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35185>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:06:21 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 14:06:21 +0000
Subject: [issue37337] Add _PyObject_VectorcallMethod() function
In-Reply-To: <1560936931.61.0.893195452608.issue37337@roundup.psfhosted.org>
Message-ID: <1561039581.62.0.423056622235.issue37337@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14093
pull_request: https://github.com/python/cpython/pull/14267

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37337>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:07:26 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Thu, 20 Jun 2019 14:07:26 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561039646.79.0.347206072556.issue37347@roundup.psfhosted.org>


Change by Aleksandr Balezin <gescheit12 at gmail.com>:


----------
pull_requests: +14094
pull_request: https://github.com/python/cpython/pull/14268

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:11:23 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Thu, 20 Jun 2019 14:11:23 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561028098.86.0.816855722789.issue37345@roundup.psfhosted.org>
Message-ID: <4B449CFA-DA4E-49B2-AF3A-1057AF59EDD7@gabeappleton.me>


Gabe Appleton <gabe at gabeappleton.me> added the comment:

Its true that this doesnt exist at the C level, however I worry that having it purely through getsockopt() and setsockopt() would make things more confusing, so I added it as a helper function.

I can remove it in lieu of documentation if that would block merging, though I dont think that is the right move here.

On June 20, 2019 10:54:58 AM UTC, Andrew Svetlov <report at bugs.python.org> wrote:
>
>Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:
>
>Adding new constants like socket.IPPROTO_UDPLITE is fine.
>The question is: why we need a new function?
>There is no set_send_checksum_coverage() on C level IIRC
>
>----------
>nosy: +asvetlov
>
>_______________________________________
>Python tracker <report at bugs.python.org>
><https://bugs.python.org/issue37345>
>_______________________________________

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:17:35 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 20 Jun 2019 14:17:35 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561040255.18.0.684895435854.issue37348@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Most of changes are in not performance sensitive code. I do not think there is a benefit of using new macro there.

If PyUnicode_FromString() is slow I prefer to optimize it instead of adding yet one esoteric private function for internal needs.

In case of dict.__repr__() we can get even more gain by using _Py_IDENTIFIER or more general API proposed by Victor.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:26:13 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 14:26:13 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1561040773.61.0.0612951420902.issue37151@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14095
pull_request: https://github.com/python/cpython/pull/14269

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Thu Jun 20 10:42:40 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 14:42:40 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
Message-ID: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>


New submission from Caleb Donovick <donovick at cs.stanford.edu>:

Currently EnvBuilder allows for a number of customizations of virtual environments, however, it does not allow for any modifications of the activate script itself (unless one wants to rewrite it completely).  Yet, it is fairly common requirement for python packages is to set some environmental variable e.g., DJANGO_SETTINGS_MODULE=<settings>.

EnvBuilder should be able extend the set of variables which are set and restored on activate / deactivate (or more generally have activate / deactivate hooks).

Originally proposed on python-ideas https://mail.python.org/archives/list/python-ideas at python.org/thread/MJNFEFT4GBVBEETJWZUQM5SS6C34PT3K/

----------
components: Interpreter Core
messages: 346122
nosy: donovick
priority: normal
severity: normal
status: open
title: venv.EnvBuilder environmental variable hooks
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:01:31 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 15:01:31 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561042891.78.0.0745006796181.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I was trying to tell you that already in msg345969 but you insisted in msg345988 that we should support that anyway.

I made a general note that "extremely unlikely" isn't unlikely enough to be an argument.

You'll notice I didn't quote any of the rest of your specific scenario, because I wasn't trying to address it. And in any case, you left out the cross-version part in that description, so you did actually describe a supported case.

(I'm not going to argue this particular point any further. If I can't help you learn the ways we do decision making on a project like CPython then I'll let someone else try.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:08:22 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 15:08:22 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561043302.68.0.322727410974.issue37349@roundup.psfhosted.org>


Change by Caleb Donovick <donovick at cs.stanford.edu>:


----------
keywords: +patch
pull_requests: +14096
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14272

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:24:48 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 15:24:48 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561044288.34.0.0123404512813.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

I have basic version working in POSIX.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:27:42 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 15:27:42 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1561044462.47.0.394020964566.issue37221@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests:  -13873

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:28:19 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 20 Jun 2019 15:28:19 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561044499.43.0.304950445345.issue37349@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Library (Lib) -Interpreter Core
nosy: +vinay.sajip
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:35:42 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 15:35:42 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561044942.13.0.872525687586.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Can we then bring back the discussion to the core of this issue: should we restore tp_print or not in PyTypeObject?

Note that the PR for the other similar issue #37221 has been accepted for merging.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:38:53 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 15:38:53 +0000
Subject: [issue37151] Calling code cleanup after PEP 590
In-Reply-To: <1559659244.35.0.514840211553.issue37151@roundup.psfhosted.org>
Message-ID: <1561045133.41.0.484187150511.issue37151@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 7e1a9aacff95c68d284f31666fe293fa2db5406d by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37151: remove _PyCFunction_FastCallDict (GH-14269)
https://github.com/python/cpython/commit/7e1a9aacff95c68d284f31666fe293fa2db5406d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37151>
_______________________________________

From report at bugs.python.org  Thu Jun 20 11:53:19 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 20 Jun 2019 15:53:19 +0000
Subject: [issue37342] A type error in typeobj.rst
In-Reply-To: <1560969817.56.0.0743434767368.issue37342@roundup.psfhosted.org>
Message-ID: <1561045999.88.0.462853563832.issue37342@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37342>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:00:33 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 16:00:33 +0000
Subject: [issue37348] add _PyUnicode_FROM_ASCII macro
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561046433.47.0.666881114703.issue37348@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +14097
pull_request: https://github.com/python/cpython/pull/14273

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:03:34 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 16:03:34 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561046614.98.0.536339793316.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> Most of changes are in not performance sensitive code. I do not think there is a benefit of using new macro there.

Because I used just sed.

> If PyUnicode_FromString() is slow I prefer to optimize it instead of adding yet one esoteric private function for internal needs.

OK.  There are some code like `PyUnicode_FromString(name)`.  Optimizing PyUnicode_FromString will be more effective.  I created PR 14273.


> In case of dict.__repr__() we can get even more gain by using _Py_IDENTIFIER or more general API proposed by Victor.

Of course, I used it just for micro benchmarking.  Optimizing it is not a goal.  In case of PR 14273:

$ ./python -m pyperf timeit -s 'd={}' -- 'repr(d)'
.....................
Mean +- std dev: 138 ns +- 2 ns

----------
title: add _PyUnicode_FROM_ASCII macro -> Optimize PyUnicode_GetString for short ASCII strings

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:05:16 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Thu, 20 Jun 2019 16:05:16 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561046716.66.0.927547577092.issue37347@roundup.psfhosted.org>


Change by Aleksandr Balezin <gescheit12 at gmail.com>:


----------
pull_requests:  -14092

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:14:32 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 16:14:32 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561047272.35.0.984346996667.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Note that the PR for the other similar issue #37221 has been accepted for merging.

I've already explained why that issue is different (it breaks a compatibility guarantee; this one changes something that was explicitly deprecated).

Petr's question seems to be the right one that we have not yet answered:

> Is (the rest of) the beta cycle enough for enough of the ecosystem to release new wheels, or should we give them the whole 3.9 cycle?

(And since the 3.8 RM has not been here to discuss release cycle stuff, let's invite him in)

----------
nosy: +lukasz.langa

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:16:27 2019
From: report at bugs.python.org (Thomas Grainger)
Date: Thu, 20 Jun 2019 16:16:27 +0000
Subject: [issue37350] print ResourceWarning object traceback when raise as
 error with -W error
Message-ID: <1561047387.04.0.201074176939.issue37350@roundup.psfhosted.org>


New submission from Thomas Grainger <tagrain at gmail.com>:

Current behaviour 

$ cat foo.py
def foo():
    open('foo', 'wb')


foo()
$ python3.8 -W all::ResourceWarning -X tracemalloc=5 foo.py
foo.py:2: ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>
  open('foo', 'wb')
Object allocated at (most recent call last):
  File "foo.py", lineno 5
    foo()
  File "foo.py", lineno 2
    open('foo', 'wb')
$ python3.8 -W error -X tracemalloc=5 foo.py
Exception ignored in: <_io.FileIO name='foo' mode='wb' closefd=True>
ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>

Expected behaviour

# Pastebin Eu0gvZ5Z
$ cat foo.py
def foo():
    open('foo', 'wb')


foo()
$ python3.8 -W all::ResourceWarning -X tracemalloc=5 foo.py
foo.py:2: ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>
  open('foo', 'wb')
Object allocated at (most recent call last):
  File "foo.py", lineno 5
    foo()
  File "foo.py", lineno 2
    open('foo', 'wb')
$ python3.8 -W error -X tracemalloc=5 foo.py
Exception ignored in: <_io.FileIO name='foo' mode='wb' closefd=True>
ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>
  open('foo', 'wb')
Object allocated at (most recent call last):
  File "foo.py", lineno 5
    foo()
  File "foo.py", lineno 2
    open('foo', 'wb')

----------
messages: 346129
nosy: graingert
priority: normal
severity: normal
status: open
title: print ResourceWarning object traceback when raise as error with -W error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37350>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:18:24 2019
From: report at bugs.python.org (Thomas Grainger)
Date: Thu, 20 Jun 2019 16:18:24 +0000
Subject: [issue37350] print ResourceWarning object traceback when raised as
 error with -W error and -X tracemalloc
In-Reply-To: <1561047387.04.0.201074176939.issue37350@roundup.psfhosted.org>
Message-ID: <1561047504.51.0.277192413543.issue37350@roundup.psfhosted.org>


Change by Thomas Grainger <tagrain at gmail.com>:


----------
title: print ResourceWarning object traceback when raise as error with -W error -> print ResourceWarning object traceback when raised as error with -W error and -X tracemalloc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37350>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:22:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 20 Jun 2019 16:22:50 +0000
Subject: [issue37350] print ResourceWarning object traceback when raised as
 error with -W error and -X tracemalloc
In-Reply-To: <1561047387.04.0.201074176939.issue37350@roundup.psfhosted.org>
Message-ID: <1561047770.59.0.569548499914.issue37350@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

You can implement this behavior using the new sys.unraisablehook (Python 3.8):
---
import sys
import tracemalloc

def foo():
    open('foo', 'wb')

def hook(unraisable):
    orig_unraisablehook(unraisable)
    if unraisable.object is not None:
        tb = tracemalloc.get_object_traceback(unraisable.object)
        if tb:
            print("Object allocated at:")
            for line in tb:
                print(line)


orig_unraisablehook = sys.unraisablehook
sys.unraisablehook = hook
tracemalloc.start(5)

foo()
---

Output:
---
Exception ignored in: <_io.FileIO name='foo' mode='wb' closefd=True>
Traceback (most recent call last):
  File "foo.py", line 5, in foo
    open('foo', 'wb')
ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>
Object allocated at:
foo.py:21
foo.py:5
---

I understand that this issue is about modifying _PyErr_WriteUnraisableDefaultHook() in Python/errors.c (it's written in C) to implement the same logic than the default implementation of warnings._formatwarnmsg() when formatting a ResourceWarning with the source object:

        try:
            import tracemalloc
        # Logging a warning should not raise a new exception:
        # catch Exception, not only ImportError and RecursionError.
        except Exception:
            # don't suggest to enable tracemalloc if it's not available
            tracing = True
            tb = None
        else:
            tracing = tracemalloc.is_tracing()
            try:
                tb = tracemalloc.get_object_traceback(msg.source)
            except Exception:
                # When a warning is logged during Python shutdown, tracemalloc
                # and the import machinery don't work anymore
                tb = None

        if tb is not None:
            s += 'Object allocated at (most recent call last):\n'
            for frame in tb:
                s += ('  File "%s", lineno %s\n'
                      % (frame.filename, frame.lineno))

                try:
                    if linecache is not None:
                        line = linecache.getline(frame.filename, frame.lineno)
                    else:
                        line = None
                except Exception:
                    line = None
                if line:
                    line = line.strip()
                    s += '    %s\n' % line
        elif not tracing:
            s += (f'{category}: Enable tracemalloc to get the object '
                  f'allocation traceback\n')


In C, _PyTraceMalloc_GetTraceback() can be used to retrieve the traceback of an object saved by tracemalloc.

See also _PyMem_DumpTraceback() used to log the tracemaltoc when Python detects a buffer overflow:
https://pythondev.readthedocs.io/debug_tools.html#debug-memory-errors

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37350>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:26:03 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Thu, 20 Jun 2019 16:26:03 +0000
Subject: [issue24772] Smaller viewport shifts the "expand left menu" character
 into the text
In-Reply-To: <1438422511.74.0.548589592521.issue24772@psf.upfronthosting.co.za>
Message-ID: <1561047963.68.0.337179421306.issue24772@roundup.psfhosted.org>


Joannah Nanjekye <nanjekyejoannah at gmail.com> added the comment:

@karl If you are still interested in solving this, open a pull request on https://github.com/python/cpython

----------
nosy: +nanjekyejoannah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24772>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:26:29 2019
From: report at bugs.python.org (Prateek Nayak)
Date: Thu, 20 Jun 2019 16:26:29 +0000
Subject: [issue37344] plistlib doesn't skip whitespace in XML format detection
In-Reply-To: <1560986315.2.0.263815565154.issue37344@roundup.psfhosted.org>
Message-ID: <1561047989.7.0.765762365661.issue37344@roundup.psfhosted.org>


Change by Prateek Nayak <lelouch.cpp at gmail.com>:


----------
keywords: +patch
pull_requests: +14098
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14266

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37344>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:32:09 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 20 Jun 2019 16:32:09 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561048329.98.0.824743995666.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Oh, wait.  Why we used _PyUnicodeWriter here?
Decoding UTF-8 must not require it.  2-pass is enough.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:33:37 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 16:33:37 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561048417.78.0.603812894241.issue36511@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset a1952122a3a20272e4db9e3c6205009a91c73ccf by Steve Dower (Paul Monson) in branch 'master':
bpo-36511: Improve ARM32 buildbot scripts (GH-14251)
https://github.com/python/cpython/commit/a1952122a3a20272e4db9e3c6205009a91c73ccf


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:33:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 20 Jun 2019 16:33:54 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561048434.41.0.67038507249.issue37348@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> _PyUnicode_FromASCII(s, len) is faster than PyUnicode_FromString(s) because PyUnicode_FromString() uses temporary _PyUnicodeWriter to support UTF-8.

I don't understand how _PyUnicodeWriter could be slow. It does not overallocate by default. It's just wrapper to implement efficient memory management.

> Oh, wait.  Why we used _PyUnicodeWriter here?

To optimize decoding errors: the error handler can use replacement string longer than 1 character. Overallocation is used in this case.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:41:32 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Thu, 20 Jun 2019 16:41:32 +0000
Subject: [issue20431] Should posix functions that accept fd also accept
 objects with .fileno()?
In-Reply-To: <1390967300.86.0.244728862469.issue20431@psf.upfronthosting.co.za>
Message-ID: <1561048892.28.0.0131287948573.issue20431@roundup.psfhosted.org>


Change by Joannah Nanjekye <nanjekyejoannah at gmail.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20431>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:49:42 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 16:49:42 +0000
Subject: [issue35185] Logger race condition - loses lines if removeHandler
 called from another thread while logging
In-Reply-To: <1541612637.38.0.788709270274.issue35185@psf.upfronthosting.co.za>
Message-ID: <1561049382.13.0.0785419189522.issue35185@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> I'd definitely suggest we go for a solution that doesn't hit performance of normal logging

I agree, but correctness is important. I'm tending to the following:

1. Introduce a lockCallHandling module-level variable, defaulting to False to maximise logging performance (and follow current behaviour) and settable to True for situations such as your example, where adding/removing handlers from threads is wanted.

2. In Logger.handle, add an extra check for lockCallHandling to decide whether to lock/release around callHandlers().

BTW a simple benchmark of performance of locking around callHanders vs. not locking, using a FileHandler and default StreamHandler, showed an average difference of ~ 480 usec per iteration (mean time of 47.310 secs unlocked vs. 47.784 locked, for a million iterations of logger.debug() - a 1% increase).

> the second idea I suggested should do that

Yes, but the copying seems to make things slower, as suggested by the output of your script (in terms of the iteration counts in a fixed amount of time).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35185>
_______________________________________

From report at bugs.python.org  Thu Jun 20 12:54:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 16:54:16 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
Message-ID: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

The step of generating a MinGW import library for Python releases is very rarely used, forces us to take extra build dependencies, and is better handled by the end-users who need it.

We will drop the libpython38.a file from the main distribution, and update the docs to contain the commands necessary (users who are using MinGW will have these tools easily available):

gendef python38.dll > tmp.def
dlltool --dllname python38.dll --def tmp.def --output-lib libpython38.a

Here is where Anaconda have been doing this themselves, rather than relying on our distributed file: https://github.com/AnacondaRecipes/aggregate/blob/master/libpython-feedstock/recipe/bld.bat

We also heard that the regex module no longer relies on this: https://mail.python.org/archives/list/python-dev at python.org/message/A7IXOTARTYJUNSCFAU3YY2VOVILC4EBY/

A few people do regularly use this file, according to https://mobile.twitter.com/zooba/status/1139661637521031168 which is why including the instructions and porting notes is important. I haven't heard from any of them that they would have trouble running the above commands themselves.

----------
assignee: steve.dower
components: Windows
messages: 346136
nosy: paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Drop libpython38.a from Windows release
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:00:42 2019
From: report at bugs.python.org (Terry Davis)
Date: Thu, 20 Jun 2019 17:00:42 +0000
Subject: [issue12782] Multiple context expressions do not support parentheses
 for continuation across lines
In-Reply-To: <1313719817.79.0.828403712604.issue12782@psf.upfronthosting.co.za>
Message-ID: <1561050042.71.0.936620842417.issue12782@roundup.psfhosted.org>


Terry Davis <terry.y.davis at gmail.com> added the comment:

I'd like to re-raise this issue. Should I cross-post to "discuss.python.org - Ideas"?

----------
nosy: +Terry Davis

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12782>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:03:42 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 17:03:42 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561050222.82.0.884790793664.issue37351@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Realising that this may have an impact on distutils.cygwincompiler.Mingw32CCompiler, but I can't tell from the source code how/whether it would pick up the pre-packaged libpython38.a. Does anyone know?

----------
components: +Distutils
nosy: +dstufft, eric.araujo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:07:09 2019
From: report at bugs.python.org (Ben Spiller)
Date: Thu, 20 Jun 2019 17:07:09 +0000
Subject: [issue35185] Logger race condition - loses lines if removeHandler
 called from another thread while logging
In-Reply-To: <1541612637.38.0.788709270274.issue35185@psf.upfronthosting.co.za>
Message-ID: <1561050429.96.0.994137264968.issue35185@roundup.psfhosted.org>


Ben Spiller <spiller.ben at gmail.com> added the comment:

Interesting conversation. :)

Yes I agree correctness is definitely top priority. :) I'd go further and say I'd prefer correctness to be always there automatically, rather than something the user must remember to enable by setting a flag such as lockCallHandling. (as an aside, adding a separate extra code path and option like that would require a bit more doc and testing changes than just fixing the bug by making the self.handlers list immutable, which is a small and simple change not needing extra doc). 

I'm also not convinced it's worth optimizing the performance of add/remove logger (which sounds like it's the goal of the callHandlers-locking approach you suggest, if I'm understanding correctly?) - since in a realistic application is always that's going to be vastly less frequent than invoking callhandlers. Especially if it reduces performance of the main logging, which is invoked much more often. Though admittedly the 1% regression you quoted isn't so bad (assuming that's true in CPython/IronPython/Jython/others). The test program I provided is a contrived way of quickly reproducing the race condition, but I certainly wouldn't use it for measuring or optimizing performance as it wasn't designed for that - the ratio of add/remove loggers to callhandlers calls is likely to be unrepresentative of a real application, and there's vastly more contention on calling add/remove loggers than you'd see in the wild. 

Do you see any downsides to the immutable self.handlers approach, other than performance of add/remove logger being a little lower?

Personally I think we're on safer ground if we permit add/remove logger be slightly slower (but at least correct! correctness trumps performance), but only if we avoid regressing the more important performance of logging itself. 

Does that seem reasonable?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35185>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:12:55 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 17:12:55 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561050775.92.0.996052183609.issue37349@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

I'm not very keen on this approach, because it needs to be implemented across all shells and maintenance in this area can be a headache because not everyone has knowledge of multiple shells.

There already are hooks for customising behaviour - you can subclass EnvBuilder and override e.g. setup_scripts to update the venv with the exact scripts you want. This puts the maintenance cost onto the people who need this functionality (it doesn't seem like a very common use case).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:17:56 2019
From: report at bugs.python.org (Julien Palard)
Date: Thu, 20 Jun 2019 17:17:56 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
Message-ID: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

In Doc/faq/design.rst there's "with an eye to making it easily tested.".

I'm not native english, but I think "making" is wrong here, maybe "make"?

----------
assignee: docs at python
components: Documentation
keywords: easy
messages: 346141
nosy: docs at python, mdk
priority: normal
severity: normal
status: open
title: Typo in documentation: "to making it easy"
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:18:47 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 20 Jun 2019 17:18:47 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561051127.28.0.813408964286.issue37347@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:22:26 2019
From: report at bugs.python.org (Julien Palard)
Date: Thu, 20 Jun 2019 17:22:26 +0000
Subject: [issue37353] Source code has not always been forward-compatible
Message-ID: <1561051346.87.0.0805255025553.issue37353@roundup.psfhosted.org>


New submission from Julien Palard <julien+python at palard.fr>:

In Doc/library/parser.rst I can read:

The parse trees are not typically compatible from one version to another, whereas source code has always been forward-compatible.

But I don't think this is right, I think of print for example.

Maybe just remove ", whereas source code has always been forward-compatible" or rewrite it so say source is just more stable than parse trees?

----------
assignee: docs at python
components: Documentation
keywords: easy
messages: 346142
nosy: docs at python, mdk
priority: normal
severity: normal
status: open
title: Source code has not always been forward-compatible

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37353>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:28:20 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 17:28:20 +0000
Subject: [issue35185] Logger race condition - loses lines if removeHandler
 called from another thread while logging
In-Reply-To: <1541612637.38.0.788709270274.issue35185@psf.upfronthosting.co.za>
Message-ID: <1561051700.28.0.962021548423.issue35185@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> I'd prefer correctness to be always there automatically, rather than something the user must remember to enable by setting a flag such as lockCallHandling

Yes, I agree, I was just looking at different approaches while mulling all this over. Correctness-by-default can of course always be implemented by setting lockCallHandling to True by default, which is what I have currently in my benchmark testing.

Re. your change:

- self.handlers.remove(hdlr)
+ newhandlers = list(self.handlers)
+ newhandlers.remove(hdlr)
+ self.handlers = hdlr

Did you mean self.handlers = newhandlers in that last line? That's what I assumed you meant, but you've posted that twice now, so I'm not sure what you're getting at.

I agree that having a slower add/removeHandler is acceptable - certainly better than slowing down Logger.handle(). But I'm not sure about

> so without relying on any GIL locking callHandlers will still see the old list or the new list

on platforms other than CPython, since we can't be sure where thread pre-emption might happen (i.e. it could happen inside a source code line boundary) and locking at least has the benefit of having defined semantics.

The other issue is where someone might have subclassed and overridden add/removeHandler methods, for whatever reason. I know it's unlikely, but one never knows.

I think we're broadly on the same page. I'm just not yet sure what the best approach is :-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35185>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:32:01 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 17:32:01 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561051921.82.0.330117698855.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

Common python libraries that make use of environmental variables:
- django
- flask
- jupyter
- TensorFlow
This is just off the top my head.  While most developers are probably fine just setting the required variables at a system level that doesn't mean they should.  The whole point of virtual environments is to avoid global state.

Overriding setup scripts is hardly a trivial task.  One has to completely recreate the activate script to achieve the desired behavior.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:32:47 2019
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 20 Jun 2019 17:32:47 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561051967.48.0.257824175423.issue37352@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

"making" looks fine to me as a native English speaker.  I'm not sure it's properly correct English, but it's fine colloquially and I don't think "make" would improve it :)

If anything, I'd change "to" to "toward", or possibly replace "an eye to" with "the goal of".

----------
nosy: +zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:34:59 2019
From: report at bugs.python.org (Zachary Ware)
Date: Thu, 20 Jun 2019 17:34:59 +0000
Subject: [issue37353] Source code has not always been forward-compatible
In-Reply-To: <1561051346.87.0.0805255025553.issue37353@roundup.psfhosted.org>
Message-ID: <1561052099.72.0.989185707502.issue37353@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

Perhaps just adding "within a major release series" after "forward-compatible" would be sufficient?

----------
nosy: +zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37353>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:37:17 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 17:37:17 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561052237.04.0.470343222918.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

In regards to the added complexity by needing to be implemented across all shells, the functionality I am requesting already exists across all shells (e.g. setting PYTHONPATH) just not in a extensible way.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:55:59 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Thu, 20 Jun 2019 17:55:59 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561053359.54.0.0673772809738.issue37352@roundup.psfhosted.org>


YoSTEALTH <ritesh at stealthcentral.com> added the comment:

"Writing test suites is very helpful, and you might want to plan your code based on expectation of making it easy for testing."

----------
nosy: +YoSTEALTH

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 13:58:31 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 17:58:31 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561053511.33.0.31513784709.issue37349@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> Common python libraries that make use of environmental variables

I didn't say environment variables weren't commonly used. I'm talking about the specific functionality this issue is about.

> Overriding setup scripts is hardly a trivial task. One has to completely recreate the activate script to achieve the desired behavior.

Not trivial, but not overly onerous either, e.g. just point to your own scripts subtree in the overridden method. Isn't your proposal to submit a different activate script?

> the functionality I am requesting already exists across all shells

I'm talking about the code to set, reset your custom environment variables - where is that already existent across all shells?

I'm not saying what you want is unreasonable - it's just putting it into the stdlib this way that I'm not sure about.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:11:12 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 20 Jun 2019 18:11:12 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1561054272.37.0.489639313573.issue37251@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

> BUT I think removing the `if getattr(obj, '__code__', None)` from `_is_async_obj` actually makes this work correctly. It is possible for a coroutine object to not have a __code__, but I don't think it is possible for a coroutine function to be missing a __code__. 

Sorry, I am little confused here. If the code attribute check is removed then my test case in PR fails since obj.__code__ that is passed through iscoroutinefunction returns True. Maybe something along the lines of below that if there is a __code__ attribute then always check it's of CodeType. So that my test passes with MagicMock.__code__ detected.

If I understand the awaitable examples correctly, mocking the obj which is an Awaitable should be returning an AsyncMock. But obj doesn't contain __code__ and hence check for inspect.isawaitable is never done causing _is_async_obj(obj) to return False and subsequently it's patched with MagicMock.


from collections.abc import Awaitable
from unittest.mock import patch

class NewCoroutine(Awaitable):
    def __await__():
        pass

obj = NewCoroutine()

with patch(f"{__name__}.obj") as m:
    print(m)

$ ./python.exe ../backups/bpo37251_awaitable.py
<MagicMock name='obj' id='4552158896'>

On removing the __code__ attribute check my test case of MagicMock with __code__ passes through iscoroutinefunction. Perhaps an acceptable tradeoff would be to check for __code__ and if present to be a CodeType or else to resume normal check like below. This way an AsyncMock is returned. Also there is no test failure. I have less understanding on asyncio terminologies over coroutine and awaitables so feel free to correct me if I am wrong. I guess it would be also helpful to have good number of tests for different asyncio object cases so that this could also be documented.

$ ./python.exe ../backups/bpo37251_awaitable.py
<AsyncMock name='obj' id='4363294672'>

# _is_async_obj to check for __code__ to be CodeType only if present.

def _is_async_obj(obj):
    code = getattr(obj, '__code__', None)
    if code and not isinstance(code, CodeType):
        return False
    return asyncio.iscoroutinefunction(obj) or inspect.isawaitable(obj)

# Also verified asyncio.sleep() to return True for _is_async_obj with above definition

>>> from unittest.mock import _is_async_func, _is_async_obj
>>> import asyncio
>>> _is_async_obj(asyncio.sleep(1))
<stdin>:1: RuntimeWarning: coroutine 'sleep' was never awaited
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
True

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:12:34 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 18:12:34 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561054354.94.0.766567881465.issue37351@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Turns out that using distutils/setuptools with --compiler=mingw32 is just doomed to fail when it hits get_msvcr(), which has never been updated for Python 3.5 onwards.

So I think it's probably safe to assume that this scenario isn't a real thing and people are linking MinGW/Python in some other way?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:19:47 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Thu, 20 Jun 2019 18:19:47 +0000
Subject: [issue19982] Add a "target" parameter to runpy.run_path and
 runpy.run_module
In-Reply-To: <1387027323.14.0.795736210788.issue19982@psf.upfronthosting.co.za>
Message-ID: <1561054787.55.0.0861504374439.issue19982@roundup.psfhosted.org>


Change by Joannah Nanjekye <nanjekyejoannah at gmail.com>:


----------
nosy: +nanjekyejoannah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19982>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:24:03 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 20 Jun 2019 18:24:03 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561055043.35.0.931574681081.issue24214@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This change seems to have caused test failure reported in https://github.com/python-hyper/wsproto/issues/126


from codecs import getincrementaldecoder
decoder = getincrementaldecoder("utf-8")()
print(decoder.decode(b'f\xf1\xf6rd', False))

# With this commit 7a465cb5ee

?  cpython git:(7a465cb5ee) ./python.exe /tmp/foo.py
f

Before 7a465cb5ee

?  cpython git:(38f4e468d4) ./python.exe /tmp/foo.py
Traceback (most recent call last):
  File "/tmp/foo.py", line 3, in <module>
    print(decoder.decode(b'f\xf1\xf6rd', False))
  File "/Users/karthikeyansingaravelan/stuff/python/cpython/Lib/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf1 in position 1: invalid continuation byte

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:28:41 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 20 Jun 2019 18:28:41 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561055321.71.0.68362078159.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

If we're in doubt, we should just apply PR 14193. It's essentially a one-line patch that fixes actual problems experienced by users and which doesn't break anything. Why should we *not* apply it?

I know that we're not obliged to fix anything, but that is besides the point given that a fix exists.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:29:29 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 20 Jun 2019 18:29:29 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
Message-ID: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

If Activate.ps1 was made to not have substitutions upon generation and be an entirely static file, then the file could be signed and thus not require people to lower their security requirements in PowerShell in order to activate their virtual environments.

----------
components: Library (Lib)
messages: 346154
nosy: brett.cannon, paul.moore, steve.dower, tim.golden, vinay.sajip, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Write PowerShell Activate.ps1 to be static so it can be signed
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:30:15 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 20 Jun 2019 18:30:15 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561055415.14.0.403807657625.issue37349@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

I mentioned on python-ideas and opened https://bugs.python.org/issue37354 to actually make the Activate.ps1 file static for security purposes.

----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:42:49 2019
From: report at bugs.python.org (Josh Snyder)
Date: Thu, 20 Jun 2019 18:42:49 +0000
Subject: [issue37355] SSLSocket.read does a GIL round-trip for every 16KB TLS
 record
Message-ID: <1561056169.29.0.814417679233.issue37355@roundup.psfhosted.org>


New submission from Josh Snyder <hashbrowncipher at gmail.com>:

Background:

SSLSocket.read drops the GIL and performs exactly one successful call to  OpenSSL's `SSL_read`, whose documentation states "At most the contents of one record will be returned". TLS records are at most 16KB, so high throughput (especially multithreaded) TLS reception can become bottlenecked on the GIL.

Proposal:

For non-blocking sockets, call SSL_read in a loop until the user-supplied limit is reached or no bytes are available on the socket. I don't know of a way to safely improve performance for blocking sockets.

Initial testing:

I performed initial testing using 32 threads pinned to 16 cores, downloading and re-assembling a single 140270MB file from a "real world" TLS sender. This resulted in a 4x increase in throughput, a 6.6x reduction in voluntary context switches, a 3.5x reduction in system time. User time did increase by 43%, so the overall reduction in CPU usage was only 2.67x.

                                 before     after
     wall clock time (s)    :    29.637     7.116
     user time (s)          :     8.793    12.584
     system time (s)        :   105.118    30.010
     user + system time (s) :   113.911    42.594
     cpu utilization (%)    :       384       599 
     voluntary switches     : 1,653,065   248,484
     speed (MB/s)           :      4733     19712

My git branch (currently a draft) is at https://github.com/hashbrowncipher/cpython/commits/faster_tls

----------
assignee: christian.heimes
components: SSL
messages: 346156
nosy: christian.heimes, josnyder
priority: normal
severity: normal
status: open
title: SSLSocket.read does a GIL round-trip for every 16KB TLS record
type: performance

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37355>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:43:35 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 20 Jun 2019 18:43:35 +0000
Subject: [issue12782] Multiple context expressions do not support parentheses
 for continuation across lines
In-Reply-To: <1313719817.79.0.828403712604.issue12782@psf.upfronthosting.co.za>
Message-ID: <1561056215.54.0.361867691401.issue12782@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

What do you mean with re-raise? The issue is not closed. If you have some proposal to overcome the limitations, the best approach is to comment here in the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue12782>
_______________________________________

From report at bugs.python.org  Thu Jun 20 14:55:12 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 20 Jun 2019 18:55:12 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561056912.5.0.584758142615.issue37352@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

I agree with Zach's suggestions.

If I were to rewrite and pass through a grammar checker, I would get closer to this (removing the verbose "an eye to":

Writing test suites is very helpful, and you might want to design your code to make it easily tested.

In other words, it is fine as is or with modifications. :-)

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:01:27 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 20 Jun 2019 19:01:27 +0000
Subject: [issue37353] Source code has not always been forward-compatible
In-Reply-To: <1561051346.87.0.0805255025553.issue37353@roundup.psfhosted.org>
Message-ID: <1561057287.46.0.451392339026.issue37353@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

"...though source code has usually been forward-compatible within a major release series."

Agree with your thoughts Julien and Zach. Perhaps remove "whereas" as well.

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37353>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:16:36 2019
From: report at bugs.python.org (Josh Rosenberg)
Date: Thu, 20 Jun 2019 19:16:36 +0000
Subject: [issue37340] remove free_list for bound method objects
In-Reply-To: <1560948861.51.0.564500331945.issue37340@roundup.psfhosted.org>
Message-ID: <1561058196.57.0.0375448260416.issue37340@roundup.psfhosted.org>


Change by Josh Rosenberg <shadowranger+python at gmail.com>:


----------
nosy: +josh.r

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37340>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:17:23 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 19:17:23 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561058243.47.0.282997810769.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

> I didn't say environment variables weren't commonly used. I'm talking about the specific functionality this issue is about.

This is likely true, to most people venv is black magic.  That doesn't mean that people wouldn't use it if the functionality existed though.  In fact this the first example given by virtualenvwrapper https://virtualenvwrapper.readthedocs.io/en/latest/scripts.html#example-usage

I personally don't use virtualenvwrapper because you they use a centralized list of env's which is non-starter for me.  I maintain dozens of envs (one per project, sometimes one per branch). So one big list would be a nightmare.

> I'm talking about the code to set, reset your custom environment variables - where is that already existent across all shells?

My point is that this code is not really different than the code to set PYTHONPATH.

> I'm not saying what you want is unreasonable - it's just putting it into the stdlib this way that I'm not sure about.

Is there an architecture that would be less objectionable?

> I mentioned on python-ideas and opened https://bugs.python.org/issue37354 to actually make the Activate.ps1 file static for security purposes.

I am curious how you plan to achieve this without reducing the functionality of venv?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:25:06 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 20 Jun 2019 19:25:06 +0000
Subject: [issue20179] Derby #10: Convert 50 sites to Argument Clinic across 4
 files
In-Reply-To: <1389140120.63.0.492860390436.issue20179@psf.upfronthosting.co.za>
Message-ID: <1561058706.15.0.564397148117.issue20179@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14099
pull_request: https://github.com/python/cpython/pull/14275

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20179>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:26:37 2019
From: report at bugs.python.org (Carol Willing)
Date: Thu, 20 Jun 2019 19:26:37 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561058797.83.0.479254747733.issue37250@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Petr, Thanks for the thoughtful summary.

If I am understanding the many messages in this and the other related issue and by looking at this with a scientific Python hat on (not as the Steering Council), I'm inclined to favor Nick's approach if possible:

> 1. In 3.8.0b2, move tp_print to the end of the structure (rather than removing it entirely) to make the "type->tp_print" in the old Cython generated code harmless rather than a compilation error
>2. In 3.9.0a1, remove it entirely again

I agree that we shouldn't punish our users. IMHO Cython should get the benefit of a compromise, though not a long term guarantee, related to tp_print since Cython addresses a very real need for performance in scientific code. 

While Cython may be able to respond within the beta period, scientific projects that depend on it may lag longer as rebuilds and releases will need to happen on PyPI, conda, and conda-forge. Release versioning is critical in the science world as we depend on it for scientific research reproducibility. While we may not come up with an ideal solution for everyone, let's try to find something acceptable for Cython and the Core Python devs/users.

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:27:15 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Thu, 20 Jun 2019 19:27:15 +0000
Subject: [issue20179] Derby #10: Convert 50 sites to Argument Clinic across 4
 files
In-Reply-To: <1389140120.63.0.492860390436.issue20179@psf.upfronthosting.co.za>
Message-ID: <1561058835.73.0.163765895538.issue20179@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

PR 14275 converts Modules/overlapped.c. Many methods now use METH_FASTCALL.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20179>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:51:58 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 19:51:58 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561060318.63.0.918790365302.issue37351@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14100
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14276

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:55:35 2019
From: report at bugs.python.org (Prateek Nayak)
Date: Thu, 20 Jun 2019 19:55:35 +0000
Subject: [issue37353] Source code has not always been forward-compatible
In-Reply-To: <1561051346.87.0.0805255025553.issue37353@roundup.psfhosted.org>
Message-ID: <1561060535.72.0.199453416658.issue37353@roundup.psfhosted.org>


Change by Prateek Nayak <lelouch.cpp at gmail.com>:


----------
keywords: +patch
pull_requests: +14101
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14277

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37353>
_______________________________________

From report at bugs.python.org  Thu Jun 20 15:57:53 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 19:57:53 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561060673.53.0.235524444036.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> While Cython may be able to respond within the beta period, scientific projects that depend on it may lag longer as rebuilds and releases will need to happen on PyPI, conda, and conda-forge. Release versioning is critical in the science world as we depend on it for scientific research reproducibility. While we may not come up with an ideal solution for everyone, let's try to find something acceptable for Cython and the Core Python devs/users.

Cython has already responded and made a new release, so the problem would be whether the scientific projects will release new sdists some time in the next four months (they will almost all have to do new wheels for 3.8 too).

Is four months really an unreasonable timeline? I thought most of these packages released more frequently than CPython.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 16:01:05 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 20:01:05 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561060865.3.0.325561023312.issue37354@roundup.psfhosted.org>


Change by Caleb Donovick <donovick at cs.stanford.edu>:


----------
nosy: +donovick

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:14:09 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 21:14:09 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561065249.0.0.765916915718.issue36511@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14102
pull_request: https://github.com/python/cpython/pull/14279

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:17:06 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Thu, 20 Jun 2019 21:17:06 +0000
Subject: [issue37289] regression in Cython when pickling objects
In-Reply-To: <1560570212.11.0.192149114574.issue37289@roundup.psfhosted.org>
Message-ID: <1561065426.75.0.69183032616.issue37289@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 1e61504b8b941494f3ac03e0449ddbbba8960175 by Pablo Galindo in branch 'master':
bpo-37289: Add a test for if with ifexpr in the peephole optimiser to detect regressions (GH-14127)
https://github.com/python/cpython/commit/1e61504b8b941494f3ac03e0449ddbbba8960175


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37289>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:35:54 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 21:35:54 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561066554.76.0.855272084805.issue36511@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 43615485f1222cd9a94421a96cb7110bb52e1b8b by Steve Dower in branch '3.8':
bpo-36511: Improve ARM32 buildbot scripts (GH-14251)
https://github.com/python/cpython/commit/43615485f1222cd9a94421a96cb7110bb52e1b8b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:45:14 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 21:45:14 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561067114.23.0.198563303204.issue37354@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

How would you plan to replace the functionality where the venv's bin path is substituted into the script? Purely through introspecting its own path?

I see that PowerShell is/will be portable to e.g. Linux environments, but I presume the security requirements you refer to are purely a Windows constraint - is that right?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:50:53 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 20 Jun 2019 21:50:53 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561067453.64.0.986288924832.issue37349@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

> I am curious how you plan to achieve this without reducing the functionality of venv?

PowerShell has a full programming language and all details can be found in pyvenv.cfg now as of Python 3.8. So Activate.ps1 can read that file to get what it needs to set paths and the prompt which is what gets substituted into the generate Activate.ps1.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:52:23 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 20 Jun 2019 21:52:23 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561067543.3.0.762090477907.issue37354@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

> How would you plan to replace the functionality where the venv's bin path is substituted into the script? Purely through introspecting its own path?

It's stored in pyvenv.cfg.

> I presume the security requirements you refer to are purely a Windows constraint - is that right?

Yes (at least for now; not sure what PowerShell Core plans to do about this sort of thing long-term).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:53:32 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Thu, 20 Jun 2019 21:53:32 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561067612.38.0.534738495266.issue37349@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> Is there an architecture that would be less objectionable?

One thing I would consider is the ability to configure a custom_script_path in the same way as other parameters are now. It would be used as follows: If not None, it should specify a directory, and the files in there would be copied to the target venv *after* the standard scripts are copied (possibly overwriting ones already there, such as "activate"), with the same variable substitutions that are currently done.

This approach allows for other things than just custom environment variable setting, and so it seems a more generic solution to the issue of customisability. While it involves the developers who require such functionality to maintain those scripts, it seems fair to place the onus on them, and not on stdlib maintainers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:55:40 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 21:55:40 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561067740.79.0.0259515908251.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

>PowerShell has a full programming language and all details can be found in pyvenv.cfg now as of Python 3.8. So Activate.ps1 can read that file to get what it needs to set paths and the prompt which is what gets substituted into the generate Activate.ps1.

Then that should be fairly orthogonal to this issue.  We should be able to store key, value pairs in the config and set the environmental variables accordingly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:57:41 2019
From: report at bugs.python.org (Paul Moore)
Date: Thu, 20 Jun 2019 21:57:41 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561067861.93.0.678619081073.issue37354@roundup.psfhosted.org>


Paul Moore <p.f.moore at gmail.com> added the comment:

How will this interact with EnvBuilder.install_scripts() (which explicitly states that it performs textual substitution)?

Note that I'm not aware of anyone who actually uses the ability to subclass EnvBuilder, but I wouldn't be surprised to find that people do...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Thu Jun 20 17:57:58 2019
From: report at bugs.python.org (Phil Thompson)
Date: Thu, 20 Jun 2019 21:57:58 +0000
Subject: [issue37356] Name of 64-bit OpenSSL v1.1.1 DLLs
Message-ID: <1561067878.58.0.201473823293.issue37356@roundup.psfhosted.org>


New submission from Phil Thompson <phil at riverbankcomputing.com>:

In the 3.8b1 64-bit Windows installer the names of the OpenSSL DLLs do not have the -x64 suffix which seems to be the convention (and is the default when building OpenSSL from source). The convention is followed in the 3.7.0 to 3.7.3 installers. I haven't yet checked the 3.7.4rc1 installer.

----------
assignee: christian.heimes
components: Installation, SSL, Windows
messages: 346172
nosy: christian.heimes, paul.moore, philthompson10, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Name of 64-bit OpenSSL v1.1.1 DLLs
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37356>
_______________________________________

From report at bugs.python.org  Thu Jun 20 18:03:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 20 Jun 2019 22:03:57 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561068237.54.0.37953075154.issue24214@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Thu Jun 20 18:09:43 2019
From: report at bugs.python.org (Caleb Donovick)
Date: Thu, 20 Jun 2019 22:09:43 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561068583.74.0.915050699938.issue37349@roundup.psfhosted.org>


Caleb Donovick <donovick at cs.stanford.edu> added the comment:

I have another idea, instead of baking in the semantics of the environmental variables, we could simply add the hooks __VENV_ACTIVATE_EXTRAS__ and __VENV_DEACTIVATE_EXTRAS__ to activate. By default they would be replaced by '', but would allow subclasses to extend the behavior of activate / deactivate arbitrarily. 

> One thing I would consider is the ability to configure a custom_script_path in the same way as other parameters are now. It would be used as follows: If not None, it should specify a directory, and the files in there would be copied to the target venv *after* the standard scripts are copied (possibly overwriting ones already there, such as "activate"), with the same variable substitutions that are currently done.

I'll take a stab at implementing this if the above proposal is not acceptable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Thu Jun 20 19:15:40 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 20 Jun 2019 23:15:40 +0000
Subject: [issue37356] Name of 64-bit OpenSSL v1.1.1 DLLs
In-Reply-To: <1561067878.58.0.201473823293.issue37356@roundup.psfhosted.org>
Message-ID: <1561072540.15.0.812387772914.issue37356@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Yes, I noticed that they changed with OpenSSL 1.1.1a, but as far as I can tell we didn't do anything to cause that - our build definition is still the same, and uses "perl Configure VC-WIN64A-masm && nmake".

Is this causing issues? Or is it just something that you noticed?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37356>
_______________________________________

From report at bugs.python.org  Thu Jun 20 19:43:20 2019
From: report at bugs.python.org (karl)
Date: Thu, 20 Jun 2019 23:43:20 +0000
Subject: [issue24772] Smaller viewport shifts the "expand left menu" character
 into the text
In-Reply-To: <1438422511.74.0.548589592521.issue24772@psf.upfronthosting.co.za>
Message-ID: <1561074200.44.0.288891391087.issue24772@roundup.psfhosted.org>


karl <karl+pythonbugs at la-grange.net> added the comment:

I'm at Mozilla All Hands this week. 
I'll check if my solution still makes sense next week and will make a pull request and/or propose another solution. 
Thanks for the reminder. adding to my calendar.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24772>
_______________________________________

From report at bugs.python.org  Thu Jun 20 19:50:39 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 20 Jun 2019 23:50:39 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561074639.85.0.869624051966.issue36511@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
pull_requests: +14103
pull_request: https://github.com/python/cpython/pull/14280

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Thu Jun 20 21:32:02 2019
From: report at bugs.python.org (YoSTEALTH)
Date: Fri, 21 Jun 2019 01:32:02 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561080722.17.0.220554196191.issue37352@roundup.psfhosted.org>


YoSTEALTH <ritesh at stealthcentral.com> added the comment:

programmers "plan" their code, they don't "design" it, as far as i know!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 21:37:24 2019
From: report at bugs.python.org (Carol Willing)
Date: Fri, 21 Jun 2019 01:37:24 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561081044.51.0.474199387163.issue37250@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

> Is four months really an unreasonable timeline? I thought most of these packages released more frequently than CPython.

I can't really predict with any accuracy what the release cycle is for most scientific projects. Anywhere from 1 month to 9 months probably covers 90% of the actively maintained scientific projects. So is four months unreasonable? Not entirely unreasonable IMHO. Six months seems a safer estimate. What makes it difficult to predict is that many of the scientific projects do not have rigid release cycles and push out releases when a specific feature or bug fix warrants it.

Perhaps it would be helpful for someone to recap the current options on the table for moving forward and the most significant risk to Cython, Projects using Cython, or CPython by selecting each option.

Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Thu Jun 20 22:24:16 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 21 Jun 2019 02:24:16 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561083856.82.0.62394135406.issue37352@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

It reads fine to me as is.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 22:48:26 2019
From: report at bugs.python.org (Mariatta)
Date: Fri, 21 Jun 2019 02:48:26 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561085306.33.0.706057221537.issue37352@roundup.psfhosted.org>


Mariatta <mariatta at python.org> added the comment:

FWIW I agree that "with an eye to ..." sounds too complex. It would be great to change it to "with the goal of...".

----------
nosy: +Mariatta

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Thu Jun 20 23:12:27 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 21 Jun 2019 03:12:27 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561086747.25.0.036807640577.issue37347@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

Why not use sqlite3_create_function_v2 to register a destructor for the function that does Py_DECREF and dispense with the dictionaries entirely?

----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Thu Jun 20 23:12:52 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 03:12:52 +0000
Subject: [issue36165] DOC: ssl.rst is missing formatting on two links
In-Reply-To: <1551525027.87.0.0940888364493.issue36165@roundup.psfhosted.org>
Message-ID: <1561086772.9.0.609889785803.issue36165@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14104
pull_request: https://github.com/python/cpython/pull/14281

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36165>
_______________________________________

From report at bugs.python.org  Thu Jun 20 23:15:37 2019
From: report at bugs.python.org (Mariatta)
Date: Fri, 21 Jun 2019 03:15:37 +0000
Subject: [issue36165] DOC: ssl.rst is missing formatting on two links
In-Reply-To: <1551525027.87.0.0940888364493.issue36165@roundup.psfhosted.org>
Message-ID: <1561086937.8.0.917940554198.issue36165@roundup.psfhosted.org>


Mariatta <mariatta at python.org> added the comment:

This just needed backport to 3.7. Miss-islington is already working on it.

Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36165>
_______________________________________

From report at bugs.python.org  Fri Jun 21 00:32:34 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 21 Jun 2019 04:32:34 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561091554.07.0.942168795611.issue37345@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

We have no setsockopt() shortcut helpers.
socket.setblocking() uses fcntl() internally.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Fri Jun 21 00:50:54 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Fri, 21 Jun 2019 04:50:54 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561091554.07.0.942168795611.issue37345@roundup.psfhosted.org>
Message-ID: <838F3BFD-BF9C-4296-9EAE-446B95F1B357@gabeappleton.me>


Gabe Appleton <gabe at gabeappleton.me> added the comment:

I just want to be explicit so I don't mess up on protocol, since I am new to this project. Does that mean that you want me to remove the helper function and put documentation in about that sockopt, or that an exception could be made in this case?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Fri Jun 21 01:34:59 2019
From: report at bugs.python.org (aeros167)
Date: Fri, 21 Jun 2019 05:34:59 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561095299.53.0.31302776696.issue19696@roundup.psfhosted.org>


aeros167 <aeros167 at gmail.com> added the comment:

Decided to start working on this issue, seems like a solid starting point. After submitting a minor doc contribution, I wanted to also attempt to contribute to some of the easier enhancement requests. 

>From my current assessment, it appears that "test_pkgimport", "test_threaded_import", and "threaded_import_hangers" all would appropriately be categorized in test_importlib. Pkgimport attempts to build the package, perform basic filesystem tests, and ensure that run time errors are correctly functioning. "threaded_import" attempts to simultaneously important multiple modules by assigning each one to different threads. The purpose of "threaded_import_hangers" is specifically dependent on "threaded_import", so those two should be grouped together.

While going through test_pkgimport I noticed that it uses the method "random.choose" on lines 17 and 63. However, the standard seems to "random.choice". I could not find any specific mention of random.choose on the python docs, so this appears to be a deprecated method. As far as I'm aware "random.choice" follows current standard and is used far more frequently within the CPython repository. Would it be appropriate to change the "choose" method to "choice"? 

Additionally, as far as naming convention goes, should the name of "test_pkgimport" instead be "test_pkg_import"? This is entirely semantics, but it makes for better consistency with the other file names and is a bit more readable. Also, would it be best to perform all of these changes within separate pull requests, or are they minor enough to be combined into one?

----------
nosy: +aeros167

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 21 01:43:58 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 21 Jun 2019 05:43:58 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561095838.74.0.824908918363.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Perhaps it would be helpful for someone to recap the current options on the table for moving forward and the most significant risk to Cython, Projects using Cython, or CPython by selecting each option.

There are three options:

(1) Status-quo (keep everything as is in 3.8b1): this breaks any Cython project which has not been recythonized with the latest Cython. For example, it is (together with bpo-37221 which is planned to be fixed) the reason that "pip install numpy" doesn't work with 3.8b1. Typically, projects run Cython at packaging time, so this needs a new source release of every single Cython-using package.

(2) Apply PR 14193: the only disadvantage that I can think of is that types would get 8 bytes larger. We should stop discussing and just do this.

(3) Put back tp_print the way it was in 3.7: same as (2), except that it goes against PEP 590 as putting tp_vectorcall_offset in place of tp_print was a design decision made in that PEP. It would break ABI (any static type compiled with 3.7 would break on 3.8) and it prevents Cython from backporting vectorcall to 3.7. It's also a larger change compared to 3.8b1, so it's more work and more risky. In my personal opinion, the worst of the three options.

Then there is the further question whether we should apply this only on 3.8 or possibly also later versions. But here the consensus seems to be 3.8 only.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 03:21:03 2019
From: report at bugs.python.org (Julien Castiaux)
Date: Fri, 21 Jun 2019 07:21:03 +0000
Subject: [issue28890] logging.handlers: Document that QueueListener is a
 daemon thread
In-Reply-To: <1560956395.72.0.816862676452.issue28890@roundup.psfhosted.org>
Message-ID: <1561101663.92.0.196824848588.issue28890@roundup.psfhosted.org>


Julien Castiaux <julien.castiaux at gmail.com> added the comment:

Hello,

The purpose of the QueueListener is to provide a way to get messages sent by QueueHandlers. I was starting the QueueListener in is own mp.Process and was expecting the start() to hang. As it was not, the process was exiting logging a few messages or not depending on the threads schedule. I had a difficult time debugging it and ended up looking at the source code as the start() method was not stating it was starting a daemon thread.

The documentation now states it, I close the bug.
Regards,

----------
resolution:  -> out of date

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28890>
_______________________________________

From report at bugs.python.org  Fri Jun 21 03:28:34 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 21 Jun 2019 07:28:34 +0000
Subject: [issue28890] logging.handlers: Document that QueueListener is a
 daemon thread
In-Reply-To: <1560956395.72.0.816862676452.issue28890@roundup.psfhosted.org>
Message-ID: <1561102114.77.0.557355019472.issue28890@roundup.psfhosted.org>


Change by Vinay Sajip <vinay_sajip at yahoo.co.uk>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28890>
_______________________________________

From report at bugs.python.org  Fri Jun 21 03:30:50 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 21 Jun 2019 07:30:50 +0000
Subject: [issue37349] venv.EnvBuilder environmental variable hooks
In-Reply-To: <1561041760.57.0.828490070277.issue37349@roundup.psfhosted.org>
Message-ID: <1561102250.33.0.549081625306.issue37349@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> I'll take a stab at implementing this [custom_script_path]

I'll certainly look at a PR for this functionality.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37349>
_______________________________________

From report at bugs.python.org  Fri Jun 21 03:37:38 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Fri, 21 Jun 2019 07:37:38 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561102658.54.0.694251871537.issue37345@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Sorry.
Please drop helper methods but keep IPPROTO_UDPLITE, UDPLITE_SEND_CSCOV, UDPLITE_RECV_CSCOV constants.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Fri Jun 21 03:49:53 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Fri, 21 Jun 2019 07:49:53 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561103393.14.0.283791093348.issue37354@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> It's stored in pyvenv.cfg.

Is it?

$ python3.8maint -m venv --prompt "foo bar" /tmp/venv
$ more /tmp/venv/pyvenv.cfg 
home = /home/vinay/projects/python/3.8
include-system-site-packages = false
version = 3.8.0
prompt = 'foo bar'

The source Python location is stored, but not, from what I can see, the venv path itself ... though of course that can be worked out from $PSScriptRoot or similar.

> How will this interact with EnvBuilder.install_scripts() (which explicitly states that it performs textual substitution)?

If there's nothing to substitute (because the script source has no placeholders), that won't constitute a problem, AFAIK.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:10:26 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 21 Jun 2019 08:10:26 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561104626.84.0.693288936996.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Is four months really an unreasonable timeline? I thought most of these packages released more frequently than CPython.

I'm mostly worried about dependency chains. Right now, any project which depends on numpy cannot even test on 3.8b1 because numpy doesn't build.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:17:47 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Fri, 21 Jun 2019 08:17:47 +0000
Subject: [issue21822] KeyboardInterrupt during Thread.join hangs that Thread
In-Reply-To: <1403365475.16.0.757881205569.issue21822@psf.upfronthosting.co.za>
Message-ID: <1561105067.47.0.151316961007.issue21822@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

I am having the same blocked signal issue on Windows when using Thread.join. This program does not print "interrupted" after pressing Ctrl+C:


import threading
import time


def f():
    while True:
        print("processing")
        time.sleep(1)


if __name__ == "__main__":
    try:
        thread = threading.Thread(target=f)
        thread.start()
        thread.join()
    except KeyboardInterrupt:
        print("interrupted")


For reference, 2 years ago Nathaniel Smith gave an interesting explanation here:
https://mail.python.org/pipermail/python-dev/2017-August/148800.html.

----------
nosy: +maggyero

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21822>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:44:50 2019
From: report at bugs.python.org (Andrew Bernard)
Date: Fri, 21 Jun 2019 08:44:50 +0000
Subject: [issue37357] mbox From line wrongly detected
Message-ID: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>


New submission from Andrew Bernard <andrew.bernard at gmail.com>:

When parsing an mbox file, the Python mailbox library is confused by the presence of lines starting with 'From' in the body of the text. A new fragmentary message item is created, but this is wrong. The following sample code and input demonstrates this. Replacing 'From' in the message body with, say, ' From' results in correct parsing.

This defect prevents correct import of mbox files into hyperkitty for GNU Mailman 3, as one instance where this is an impediment, as the message items become corrupt.

-- Python code
import sys
import mailbox

def main():
    print('mailbox read test')
    mbox = mailbox.mbox(sys.argv[1])
    for msg in mbox:
        print('~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~')
        print(msg)
        print('~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~')
    
if __name__ == "__main__":
    main()


--- sample mbox with one message

>From  Fred Nurk <fred.nurks at nowhere.org> Wed, 8 Dec 1999 14:45:02 -0400
Date:         Wed, 8 Dec 1999 14:45:02 -0400
From:         Fred Nurk <fred.nurk at inowhere.org>
Subject:      Testing mbox in Python


 Lorem ipsum dolor sit amet, consectetur adipiscing elit. Fusce semper
 tempus augue at consectetur. Morbi eu nunc magna. Nulla placerat,
 eros in mollis finibus, dui risus ultrices tortor, non tincidunt nibh
 odio at augue. Quisque quis mauris neque. Curabitur ac accumsan
 neque. Maecenas sed mauris non justo sagittis finibus vel vel
 ex. Maecenas quis rutrum libero. Curabitur ex ante, tincidunt in
 velit at, egestas lobortis quam. Praesent tempus at dui ut
 volutpat. Nullam in rhoncus massa, id malesuada tortor. Suspendisse
 at cursus ex. Phasellus vitae pulvinar eros. Ut euismod dapibus
 libero, ultricies tempor leo accumsan ac. Etiam vestibulum, urna eget
 interdum eleifend, nulla nulla eleifend lacus, at lacinia neque nisi
 non velit.

>From sed vehicula venenatis dui at ultricies. Pellentesque vehicula
vulputate nibh nec aliquet. Vestibulum pretium velit id libero
porttitor, sed facilisis metus fermentum. Donec vestibulum, sapien non
convallis sodales, justo libero volutpat dui, ut luctus odio nisi eget
sapien. In viverra libero gravida arcu euismod, non sollicitudin massa
auctor. Pellentesque vitae laoreet nisi. In eros massa, pretium at
condimentum eu, molestie ut tortor. Suspendisse faucibus felis sem, et
fringilla urna consectetur molestie. Integer suscipit, orci sed
convallis maximus, velit purus tempus dui, id egestas tortor erat
auctor dui. Nulla fermentum tellus ut odio elementum, vel bibendum mi
imperdiet. Proin sed auctor purus. Orci varius natoque penatibus et
magnis dis parturient montes, nascetur ridiculus mus. Nullam non arcu
ex. Duis dapibus nunc in urna dapibus, sit amet interdum lectus
tincidunt.

Fred

--

----------
components: Library (Lib)
messages: 346192
nosy: Andro
priority: normal
severity: normal
status: open
title: mbox From line wrongly detected
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:50:17 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 21 Jun 2019 08:50:17 +0000
Subject: [issue37357] mbox From line wrongly detected
In-Reply-To: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>
Message-ID: <1561107017.65.0.519588928687.issue37357@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
nosy: +barry, maxking, r.david.murray

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:50:25 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 21 Jun 2019 08:50:25 +0000
Subject: [issue37357] mbox From line wrongly detected
In-Reply-To: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>
Message-ID: <1561107025.99.0.173421403412.issue37357@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
components: +email

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:51:53 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 21 Jun 2019 08:51:53 +0000
Subject: [issue37358] Use vectorcall for functools.partial
Message-ID: <1561107113.25.0.81334317867.issue37358@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

functools.partial already has some optimizations to use vectorcall (formerly known as fastcall) for its onward calls, so it makes a lot of sense to also use vectorcall when being called.

----------
components: Library (Lib)
messages: 346193
nosy: Mark.Shannon, jdemeyer, petr.viktorin, vstinner
priority: normal
severity: normal
status: open
title: Use vectorcall for functools.partial
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37358>
_______________________________________

From report at bugs.python.org  Fri Jun 21 04:59:58 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Fri, 21 Jun 2019 08:59:58 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561107598.52.0.556931198666.issue37250@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

> scientific projects that depend on it may lag longer as rebuilds and releases will need to happen on PyPI, conda, and conda-forge.

Keep in mind that binary artifacts (wheels, Conda/distro packages) should not be affected. They need to be re-built for Python 3.8 *either way*, because the ABI changed.

The only artifacts that putting tp_print back in helps are sdists that include pre-generated Cython output, plus possibly projects that pin Cython to an older version.

Specifically, for any platform without a C compiler installed, users aren't helped by putting tp_print back in.

So:

(1) Status-quo (keep everything as is in 3.8b1):
  - binary/compiled distributions need to be re-built (*1)
  - sdists need to be re-generated with an up-to-date Cython (*2)
  - projects that pin Cython need to update it.
  + pure source distributions (where compiling involves running Cython) works as before (*3)
  + type objects do not waste memory
  + Cython can implement vectorcall optimizations for past Python versions (before 3.8)

(2) Apply PR 14193:
  - binary/compiled distributions still need to be re-built (*1)
  + sdists DO NOT need to be re-generated (*2)
  + projects that pin Cython DO NOT need to update it.
  + pure source distributions (where compiling involves running Cython) works as before (*3)
  - type objects get 8 bytes larger
  + Cython can implement vectorcall optimizations for past Python versions (before 3.8)

(3) Put back tp_print the way it was in 3.7:
  - binary/compiled distributions still need to be re-built (*1)
  + sdists DO NOT need to be re-generated (*2)
  + projects that pin Cython DO NOT need to update it.
  + pure source distributions (where compiling involves running Cython) works as before (*3)
  - type objects get 8 bytes larger
  - Cython can NOT implement vectorcall optimizations for past (pre-3.8) Python versions

*1: applicable to most wheel consumers, conda users, etc.
*2: applicable to sdist consumers with a compiler
*3: should be applicable to Conda/Fedora/Debian/... packagers (not so much end users)

> Is four months really an unreasonable timeline? I thought most of these packages released more frequently than CPython.

Note that maintainers of these packages need to take an action (build wheels) anyway to support Python 3.8 (on compiler-less platforms). They need to test, and ideally even read "Porting to Python 3.8" and adjust the code.
Is re-generating Cython output, and bumping the version, too much of an *added* burden here?

If a project doesn't release 3.8 wheels by Python 3.8.0rc1, we don't get feedback on it from PyPI users (but Conda & Linux distros should be unaffected, if they run Cython on build).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:08:34 2019
From: report at bugs.python.org (Phil Thompson)
Date: Fri, 21 Jun 2019 09:08:34 +0000
Subject: [issue37356] Name of 64-bit OpenSSL v1.1.1 DLLs
In-Reply-To: <1561067878.58.0.201473823293.issue37356@roundup.psfhosted.org>
Message-ID: <1561108114.46.0.835823570218.issue37356@roundup.psfhosted.org>


Phil Thompson <phil at riverbankcomputing.com> added the comment:

I think I was incorrect in saying the suffix was the default when building v1.1.1 from source, so any problem I have (trying to share the DLL with different pre-built packages) is not a Python problem. Sorry for the noise.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37356>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:09:09 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Fri, 21 Jun 2019 09:09:09 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561108149.81.0.16800787848.issue37347@roundup.psfhosted.org>


Aleksandr Balezin <gescheit12 at gmail.com> added the comment:

Because destructor can be registered only for particular functions. For example sqlite3_progress_handler() can't register destructor.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:38:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 09:38:28 +0000
Subject: [issue32252] test_regrtest leaves a test_python_* directory in TEMPDIR
In-Reply-To: <1512722953.36.0.213398074469.issue32252@psf.upfronthosting.co.za>
Message-ID: <1561109908.58.0.187822675536.issue32252@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This issue has been fixed in a more generic way: when using -jN, child processes reuse the temporary directory of the main process, and then main process ensures that the temporary directory is always removed:

commit 3c93153f7db5dd9b06f229e61978fd9199b3c097
Author: Victor Stinner <vstinner at redhat.com>
Date:   Tue May 14 15:49:16 2019 +0200

    bpo-36915: regrtest always remove tempdir of worker processes (GH-13312)

I close the issue. Moreover, the initial issue has been fixed.

Thanks for the report Xavier :-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32252>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:40:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 09:40:16 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
Message-ID: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The root issue is likely related to "RuntimeWarning: tests may fail, unable to create temporary directory '/buildbot/tmp/tmpdir/test_python_28144': [Errno 17] File exists".

I don't know if a previous buildbot run forgot to remove this directory, or if it's a race condition in test_regrtest?

https://buildbot.python.org/all/#/builders/103/builds/2679

FAIL: test_list_cases (test.test_regrtest.ArgsTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/test_regrtest.py", line 915, in test_list_cases
    self.assertEqual(output.splitlines(), all_methods)
AssertionError: Lists differ: ['tes[73 chars]hod2', "/buildbot/buildarea/cpython/3.x.ware-g[307 chars]th:'] != ['tes[73 chars]hod2']

First list contains 2 additional elements.
First extra element 2:
"/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/support/__init__.py:1058: RuntimeWarning: tests may fail, unable to create temporary directory '/buildbot/tmp/tmpdir/test_python_28144': [Errno 17] File exists: '/buildbot/tmp/tmpdir/test_python_28144'"

  ['test_regrtest_noop8.Tests.test_method1',
-  'test_regrtest_noop8.Tests.test_method2',
?                                          ^

+  'test_regrtest_noop8.Tests.test_method2']
?                                          ^

-  '/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/support/__init__.py:1058: '
-  'RuntimeWarning: tests may fail, unable to create temporary directory '
-  "'/buildbot/tmp/tmpdir/test_python_28144': [Errno 17] File exists: "
-  "'/buildbot/tmp/tmpdir/test_python_28144'",
-  '  with temp_dir(path=name, quiet=quiet) as temp_path:']

----------------------------------------------------------------------

----------
components: Tests
messages: 346198
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:41:01 2019
From: report at bugs.python.org (Phil Thompson)
Date: Fri, 21 Jun 2019 09:41:01 +0000
Subject: [issue37356] Name of 64-bit OpenSSL v1.1.1 DLLs
In-Reply-To: <1561067878.58.0.201473823293.issue37356@roundup.psfhosted.org>
Message-ID: <1561110061.04.0.110570916724.issue37356@roundup.psfhosted.org>


Phil Thompson <phil at riverbankcomputing.com> added the comment:

A clarification...

It seems the suffix is added when configured as VC-WIN64A but omitted when configured as VC-WIN64A-masm.

...still not a Python problem.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37356>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:45:22 2019
From: report at bugs.python.org (Nick Papior)
Date: Fri, 21 Jun 2019 09:45:22 +0000
Subject: [issue37360] Building without OpenPTY and without stropts.h
Message-ID: <1561110322.83.0.0214129051762.issue37360@roundup.psfhosted.org>


New submission from Nick Papior <nickpapior at gmail.com>:

When trying to compile Python without OpenPTY and without stropts.h the compilation fails at Modules/posixmodule.c.

Apparently there is a failed logic in the def's.

It goes something like this:

#ifdef HAVE_OPENPTY
...
#elif defined(HAVE__GETPTY)
...
#else
...
#if !defined(__CYGWIN__) && !defined(HAVE_DEV_PTC)
    ioctl(slave_fd, I_PUSH, "ptem"); /* push ptem */
...
#endif
#endif

However, in the top of the file there is:
#if defined(HAVE_OPENPTY) || defined(HAVE_FORKPTY) || defined(HAVE_DEV_PTMX)
#ifdef HAVE_PTY_H
#include <pty.h>
#else
#ifdef HAVE_LIBUTIL_H
#include <libutil.h>
#else
#ifdef HAVE_UTIL_H
#include <util.h>
#endif /* HAVE_UTIL_H */
#endif /* HAVE_LIBUTIL_H */
#endif /* HAVE_PTY_H */
#ifdef HAVE_STROPTS_H
#include <stropts.h>
#endif


However, if stropts.h is not present (then I_PUSH isn't either) then the logic fails if OpenPTY isn't present as well... :(

This came up when I tried to compile Python using Intel compiler suite on our cluster.
It succesfully compiles using GNU, but fails with Intel due to this rare hickup.

If you need additional details, please let me now!

----------
messages: 346200
nosy: nickpapior
priority: normal
severity: normal
status: open
title: Building without OpenPTY and without stropts.h
type: compile error
versions: Python 2.7, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37360>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:57:38 2019
From: report at bugs.python.org (Andrew Bernard)
Date: Fri, 21 Jun 2019 09:57:38 +0000
Subject: [issue37357] mbox From line wrongly detected
In-Reply-To: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>
Message-ID: <1561111058.0.0.844162481627.issue37357@roundup.psfhosted.org>


Andrew Bernard <andrew.bernard at gmail.com> added the comment:

Not really a bug. Results from problems with the loose mbix format and lack of standards. Nothing Python can do about it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Fri Jun 21 05:57:54 2019
From: report at bugs.python.org (Andrew Bernard)
Date: Fri, 21 Jun 2019 09:57:54 +0000
Subject: [issue37357] mbox From line wrongly detected
In-Reply-To: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>
Message-ID: <1561111074.71.0.106347163471.issue37357@roundup.psfhosted.org>


Change by Andrew Bernard <andrew.bernard at gmail.com>:


----------
resolution:  -> not a bug

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Fri Jun 21 06:28:36 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 21 Jun 2019 10:28:36 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561112916.87.0.675578225417.issue37348@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +14105
pull_request: https://github.com/python/cpython/pull/14283

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 06:30:07 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 21 Jun 2019 10:30:07 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561113007.49.0.331540252694.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

> I don't understand how _PyUnicodeWriter could be slow. It does not overallocate by default. It's just wrapper to implement efficient memory management.

I misunderstood _PyUnicodeWriter.  I thought it caused one more allocation, but it doesn't.

But _PyUnicodeWriter is still slow, because gcc and clang are not smart enough to optimize _PyUnicodeWriter_Init() & _PyUnicodeWriter_Prepare().

See this example:

```
#define PY_SSIZE_T_CLEAN
#include <Python.h>

#define S(s) (s),strlen(s)

int
main(int argc, char *argv[])
{
    Py_Initialize();

    for (int i=0; i<100000000; i++) {
        //PyObject *s = PyUnicode_FromString("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa");
        PyObject *s = _PyUnicode_FromASCII(S("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"));
        Py_DECREF(s);
    }
    return 0;
}
```

PyUnicode_FromString() takes about 4 sec on my machine.  _PyUnicode_FromASCII() is about 2 sec.
By skipping _PyUnicodeWriter for ASCII string (GH-14283), PyUnicode_FromString() takes about 3 sec.

```
$ time ./x  # PyUnicode_FromString

real    0m4.085s
user    0m4.081s
sys     0m0.004s

$ time ./y  # PyUnicode_FromString (skip _PyUnicode_Writer, GH-14283)

real    0m2.988s
user    0m2.988s
sys     0m0.000s

$ time ./z  # _PyUnicode_FromASCII
$ time ./z

real    0m1.975s
user    0m1.975s
sys     0m0.000s
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 06:37:24 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 21 Jun 2019 10:37:24 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561113444.36.0.975796653857.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

Another micro benchmark:

```
$ ./python-master -m pyperf timeit -o m1.json 'b=b"foobar"' -- 'b.decode()'
.....................
Mean +- std dev: 93.1 ns +- 2.4 ns

$ ./python -m pyperf timeit -o m2.json 'b=b"foobar"' -- 'b.decode()'
.....................
Mean +- std dev: 83.1 ns +- 2.6 ns

$ ./python -m pyperf compare_to m1.json m2.json
Mean +- std dev: [m1] 93.1 ns +- 2.4 ns -> [m2] 83.1 ns +- 2.6 ns: 1.12x faster (-11%)
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 07:16:23 2019
From: report at bugs.python.org (Nick Papior)
Date: Fri, 21 Jun 2019 11:16:23 +0000
Subject: [issue37360] Building without OpenPTY and without stropts.h
In-Reply-To: <1561110322.83.0.0214129051762.issue37360@roundup.psfhosted.org>
Message-ID: <1561115783.41.0.855872859681.issue37360@roundup.psfhosted.org>


Nick Papior <nickpapior at gmail.com> added the comment:

FYI:

The problem arises since Intel adds a library path to:

../clck/2019.2.1/lib/intel64/

which has libutil.so!

This means that the Intel compiler *may* not find OpenPTY since that may optionally be placed in libutil.so...
Simply removing the path from the env means Intel compilers functions again ;)

*sigh*

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37360>
_______________________________________

From report at bugs.python.org  Fri Jun 21 07:23:13 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Fri, 21 Jun 2019 11:23:13 +0000
Subject: [issue37298] IDLE: Revise html to tkinker converter for help.html
In-Reply-To: <1560649872.44.0.457910225797.issue37298@roundup.psfhosted.org>
Message-ID: <1561116193.96.0.474659698069.issue37298@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

tl;dr I think it's a difference in the CSS for the HTML5 writer. 

----------------------------------------

In the HTMLTranslator class for docutils writer [1], I found the following docstring, specifically the line "The html5_polyglot writer solves this using CSS2.".

    """
    The html4css1 writer has been optimized to produce visually compact
    lists (less vertical whitespace).  HTML's mixed content models
    allow list items to contain "<li><p>body elements</p></li>" or
    "<li>just text</li>" or even "<li>text<p>and body
    elements</p>combined</li>", each with different effects.  It would
    be best to stick with strict body elements in list items, but they
    affect vertical spacing in older browsers (although they really
    shouldn't).
    The html5_polyglot writer solves this using CSS2.

    Here is an outline of the optimization:

    - Check for and omit <p> tags in "simple" lists: list items
      contain either a single paragraph, a nested simple list, or a
      paragraph followed by a nested simple list.  This means that
      this list can be compact:

          - Item 1.
          - Item 2.

      But this list cannot be compact:

          - Item 1.

            This second paragraph forces space between list items.

          - Item 2.

    - In non-list contexts, omit <p> tags on a paragraph if that
      paragraph is the only child of its parent (footnotes & citations
      are allowed a label first).

    - Regardless of the above, in definitions, table cells, field bodies,
      option descriptions, and list items, mark the first child with
      'class="first"' and the last child with 'class="last"'.  The stylesheet
      sets the margins (top & bottom respectively) to 0 for these elements.

    The ``no_compact_lists`` setting (``--no-compact-lists`` command-line
    option) disables list whitespace optimization.
    """

In the HTMLTranslator class for the base [2], I found this comment:
    # Do not omit <p> tags
    # --------------------
    #
    # The HTML4CSS1 writer does this to "produce
    # visually compact lists (less vertical whitespace)". This writer
    # relies on CSS rules for"visual compactness".
    #
    # * In XHTML 1.1, e.g. a <blockquote> element may not contain
    #   character data, so you cannot drop the <p> tags.
    # * Keeping simple paragraphs in the field_body enables a CSS
    #   rule to start the field-body on a new line if the label is too long
    # * it makes the code simpler.

Since both comments are a few years old, I think it's in the CSS.


[1] https://sourceforge.net/p/docutils/code/HEAD/tree/trunk/docutils/docutils/writers/html4css1/__init__.py
[2] https://sourceforge.net/p/docutils/code/HEAD/tree/trunk/docutils/docutils/writers/_html_base.py

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37298>
_______________________________________

From report at bugs.python.org  Fri Jun 21 07:34:16 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Fri, 21 Jun 2019 11:34:16 +0000
Subject: [issue37298] IDLE: Revise html to tkinker converter for help.html
In-Reply-To: <1560649872.44.0.457910225797.issue37298@roundup.psfhosted.org>
Message-ID: <1561116856.91.0.924481497609.issue37298@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

Adding on to my last post, it's not in the CSS, but it's that Sphinx 2.0 switches from a default of HTML4 to HTML5.  The docutils comments explain the difference between the two.

https://github.com/sphinx-doc/sphinx/commit/a3cdd465ecf018fa5213b6b2c1c4e495973a2896

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37298>
_______________________________________

From report at bugs.python.org  Fri Jun 21 07:56:15 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Fri, 21 Jun 2019 11:56:15 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561118175.29.0.39685151824.issue20443@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

Perhaps `os._abspath_for_import`? If importlib finds it, then it can handle making early paths absolute itself, otherwise it will defer doing that until it has the full external import system bootstrapped. (importlib does try to make all paths absolute as it loads modules - it's just that some early modules aren't loaded that way)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:31:59 2019
From: report at bugs.python.org (Andreas Jung)
Date: Fri, 21 Jun 2019 12:31:59 +0000
Subject: [issue37361] urllib3: TypeError: unsupported operand type(s) for -=:
 'Session' and 'int' in Retry class
Message-ID: <1561120319.59.0.821947616487.issue37361@roundup.psfhosted.org>


New submission from Andreas Jung <ajung at users.sourceforge.net>:

Python 3.7.3

The following code is support to add a retry to the requests module.

"total" is correctly initialized with 5 here but internally self.total becomes an instation of "Session"


import requests
from requests.adapters import HTTPAdapter
from requests.packages.urllib3.util.retry import Retry


def requests_retry_session(
    retries=5,
    backoff_factor=5,
    status_forcelist=(500, 502, 504),
):
    session = requests.Session()
    retry = Retry(
        total=retries,
        backoff_factor=backoff_factor,
        status_forcelist=status_forcelist,
    )
    import pdb; pdb.set_trace()
    print(retry.total)
    adapter = HTTPAdapter(max_retries=retry)
    session.mount('http://', adapter)
    session.mount('https://', adapter)
    return session


s = requests.Session()
response = requests_retry_session(s).get('https://www.foo.com/')
print(response.status_code)

Traceback (most recent call last):
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/connectionpool.py", line 343, in _make_request
    self._validate_conn(conn)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/connectionpool.py", line 839, in _validate_conn
    conn.connect()
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/connection.py", line 344, in connect
    ssl_context=context)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/util/ssl_.py", line 347, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/opt/python-3.7.3/lib/python3.7/ssl.py", line 412, in wrap_socket
    session=session
  File "/opt/python-3.7.3/lib/python3.7/ssl.py", line 853, in _create
    self.do_handshake()
  File "/opt/python-3.7.3/lib/python3.7/ssl.py", line 1117, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate (_ssl.c:1056)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "bin/zopepy", line 303, in <module>
    exec(compile(__file__f.read(), __file__, "exec"))
  File "foo.py", line 28, in <module>
    response = requests_retry_session(s).get('https://www.foo.com/')
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/requests-2.21.0-py3.7.egg/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/requests-2.21.0-py3.7.egg/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/requests-2.21.0-py3.7.egg/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/requests-2.21.0-py3.7.egg/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/connectionpool.py", line 638, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/urllib3-1.24.2-py3.7.egg/urllib3/util/retry.py", line 348, in increment
    total -= 1
TypeError: unsupported operand type(s) for -=: 'Session' and 'int'

----------
components: Library (Lib)
messages: 346208
nosy: ajung
priority: normal
severity: normal
status: open
title: urllib3: TypeError: unsupported operand type(s) for -=: 'Session' and 'int' in Retry class
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37361>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:39:34 2019
From: report at bugs.python.org (Andreas Jung)
Date: Fri, 21 Jun 2019 12:39:34 +0000
Subject: [issue37361] urllib3: TypeError: unsupported operand type(s) for -=:
 'Session' and 'int' in Retry class
In-Reply-To: <1561120319.59.0.821947616487.issue37361@roundup.psfhosted.org>
Message-ID: <1561120774.71.0.472089460618.issue37361@roundup.psfhosted.org>


Change by Andreas Jung <ajung at users.sourceforge.net>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37361>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:39:39 2019
From: report at bugs.python.org (Andreas Jung)
Date: Fri, 21 Jun 2019 12:39:39 +0000
Subject: [issue37361] urllib3: TypeError: unsupported operand type(s) for -=:
 'Session' and 'int' in Retry class
In-Reply-To: <1561120319.59.0.821947616487.issue37361@roundup.psfhosted.org>
Message-ID: <1561120779.38.0.146405550985.issue37361@roundup.psfhosted.org>


Andreas Jung <ajung at users.sourceforge.net> added the comment:

invalid

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37361>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:42:20 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 21 Jun 2019 12:42:20 +0000
Subject: [issue37361] urllib3: TypeError: unsupported operand type(s) for -=:
 'Session' and 'int' in Retry class
In-Reply-To: <1561120319.59.0.821947616487.issue37361@roundup.psfhosted.org>
Message-ID: <1561120940.25.0.0488645737097.issue37361@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
resolution:  -> not a bug
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37361>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:47:51 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 21 Jun 2019 12:47:51 +0000
Subject: [issue37358] Use vectorcall for functools.partial
In-Reply-To: <1561107113.25.0.81334317867.issue37358@roundup.psfhosted.org>
Message-ID: <1561121271.86.0.891520692978.issue37358@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +14106
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14284

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37358>
_______________________________________

From report at bugs.python.org  Fri Jun 21 08:55:35 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 21 Jun 2019 12:55:35 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561121735.33.0.68885087731.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
pull_requests: +14107
pull_request: https://github.com/python/cpython/pull/14285

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:14:58 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Fri, 21 Jun 2019 13:14:58 +0000
Subject: [issue37071] HTMLParser mistakenly inventing new tags while parsing
In-Reply-To: <1559006580.21.0.290263720763.issue37071@roundup.psfhosted.org>
Message-ID: <1561122898.03.0.0623370000836.issue37071@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

Thank you for the report.

Looking at the BeautifulSoup source, there is a comment about this scenario:
            # Unlike other parsers, html.parser doesn't send separate end tag
            # events for empty-element tags. (It's handled in
            # handle_startendtag, but only if the original markup looked like
            # <tag/>.)
            #
            # So we need to call handle_endtag() ourselves. Since we
            # know the start event is identical to the end event, we
            # don't want handle_endtag() to cross off any previous end
            # events for tags of this name.


HTMLParser itself produces output such as:
>>> class MyParser(HTMLParser):
...     def handle_starttag(self, tag, attrs):
...         print(f'start: {tag}')
...     def handle_endtag(self, tag):
...         print(f'end: {tag}')
...     def handle_data(self, data):
...         print(f'data: {data}')
...
>>> parser = MyParser()
>>> parser.feed('<p><test></p>')
start: p
start: test
end: p

My suggestion would be to try a different parser in BeautifulSoup [1] to handle this.  Even if we wanted to modify HTMLParser, any such change would probably be backwards incompatible.

[1] https://www.crummy.com/software/BeautifulSoup/bs4/doc/#installing-a-parser

----------
nosy: +cheryl.sabella
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37071>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:45:56 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 13:45:56 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
Message-ID: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

Currently, test_gdb fails if gdb logs messages on stderr which are "unexpected". I don't understand the rationale for that: Python is not supposed to test gdb. It's only supposed to check that python-gdb.py commands work as expected: stderr should be ignored.

In the past, I was lazy and just added more and more patterns to ignore on stderr, but this approach doesn't work in the long term: gdb evolves frequently, and there are always new messages.

Attached PR modify test_gdb to ignore stderr, except of "PC not saved" pattern used to skip test_gdb on a special case: bpo-34007.

        # bpo34007: Sometimes some versions of the shared libraries that
        # are part of the traceback are compiled in optimised mode and the
        # Program Counter (PC) is not present, not allowing gdb to walk the
        # frames back. When this happens, the Python bindings of gdb raise
        # an exception, making the test impossible to succeed.
        if "PC not saved" in err:
            raise unittest.SkipTest("gdb cannot walk the frame object"
                                    " because the Program Counter is"
                                    " not present")

----------
components: Tests
messages: 346211
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_gdb must not fail on "unexpected" messages written into stderr
versions: Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:46:36 2019
From: report at bugs.python.org (Pierre Glaser)
Date: Fri, 21 Jun 2019 13:46:36 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1561124796.01.0.715114865579.issue36888@roundup.psfhosted.org>


Change by Pierre Glaser <pierreglaser at msn.com>:


----------
pull_requests: +14108
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14286

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:48:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 13:48:53 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561124933.35.0.793989580198.issue37362@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14109
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14287

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:51:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 13:51:32 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561125092.48.0.49645064264.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> In the past, I was lazy and just added more and more patterns to ignore on stderr, but this approach doesn't work in the long term: gdb evolves frequently, and there are always new messages.

A recent example: test_gdb fails on Fedora because a warning which should not prevent to test python-gdb.py commands:

"Missing separate debuginfo for /lib/ld-linux-aarch64.so.1"

Moreover, Fedora also suggests a command to install missing package in this case:

"Try: dnf --enablerepo='*debug*' install ..."

https://bugzilla.redhat.com/show_bug.cgi?id=1721483

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:52:31 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 13:52:31 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561125151.28.0.399064874065.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

FWIW, I agree totally with Petr's analysis.

Jeroen's analysis ignores some points, has technical inaccuracies (nobody can use a static type compiled for 3.7 with 3.8), and is based on precedents that do not apply to this situation. (All of which I've mentioned above, but I assume nobody is reading the whole repetitive thread anymore.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:55:41 2019
From: report at bugs.python.org (Matej Cepl)
Date: Fri, 21 Jun 2019 13:55:41 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1561125341.61.0.197664386644.issue37169@roundup.psfhosted.org>


Matej Cepl <mcepl at cepl.eu> added the comment:

I don't think this has been really fixed, see attached log,even with the patch applied I am still getting:

[ 6220s] ======================================================================
[ 6220s] FAIL: test_pyobject_freed_is_freed (test.test_capi.PyMemMallocDebugTests)
[ 6220s] ----------------------------------------------------------------------
[ 6220s] Traceback (most recent call last):
[ 6220s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/test_capi.py", line 730, i
n test_pyobject_freed_is_freed
[ 6220s]     self.check_pyobject_is_freed('check_pyobject_freed_is_freed')
[ 6220s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/test_capi.py", line 721, i
n check_pyobject_is_freed
[ 6220s]     assert_python_ok('-c', code, PYTHONMALLOC=self.PYTHONMALLOC)
[ 6220s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py",
 line 157, in assert_python_ok
[ 6220s]     return _assert_python(True, *args, **env_vars)
[ 6220s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py",
 line 143, in _assert_python
[ 6220s]     res.fail(cmd_line)
[ 6220s]   File "/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/Lib/test/support/script_helper.py", line 70, in fail
[ 6220s]     raise AssertionError("Process return code is %d\n"
[ 6220s] AssertionError: Process return code is 1
[ 6220s] command line: ['/home/abuild/rpmbuild/BUILD/Python-3.8.0b1/python', '-X', 'faulthandler', '-c', '\nimport gc, os, sys, _testcapi\n# Disable the GC to avoid crash on GC collection\ngc.disable()\ntry:\n    _testcapi.check_pyobject_freed_is_freed()\n    # Exit immediately to avoid a crash while deallocating\n    # the invalid object\n    os._exit(0)\nexcept _testcapi.error:\n    os._exit(1)\n']

----------
Added file: https://bugs.python.org/file48431/log.txt.gz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:56:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 13:56:43 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561125403.62.0.649160601938.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Related change:

commit 3c93153f7db5dd9b06f229e61978fd9199b3c097
Author: Victor Stinner <vstinner at redhat.com>
Date:   Tue May 14 15:49:16 2019 +0200

    bpo-36915: regrtest always remove tempdir of worker processes (GH-13312)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:57:15 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 13:57:15 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561125435.24.0.303258129562.issue37354@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

One thing to note is that if we sign this file, it'll have to bypass the text substitution step completely to avoid modifying line endings or encoding. So there could be code changes in venv too.

This would be a great contribution from a PowerShell expert, and might be worth advertising (Twitter) for one. File parsing can get tricky quickly, but there are a few clever ways to approach it. We also need to set a minimum PowerShell version to support, as plenty of its features aren't available on base Windows 7 installs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:58:25 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Fri, 21 Jun 2019 13:58:25 +0000
Subject: [issue36210] correct AIX logic in setup.py for (non-existant)
 optional extensions
In-Reply-To: <1551877478.38.0.771456862754.issue36210@roundup.psfhosted.org>
Message-ID: <1561125505.12.0.132375868221.issue36210@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:


New changeset 08970cb03c61f62f4f69e7769d0075fa66bb86aa by Nick Coghlan (Michael Felt) in branch 'master':
bpo-36210: update optional extension handling for AIX (GH-12202)
https://github.com/python/cpython/commit/08970cb03c61f62f4f69e7769d0075fa66bb86aa


----------
nosy: +ncoghlan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36210>
_______________________________________

From report at bugs.python.org  Fri Jun 21 09:58:40 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Fri, 21 Jun 2019 13:58:40 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561125520.24.0.63685709713.issue37250@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> based on precedents that do not apply to this situation

I'm curious what you mean here...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:01:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 14:01:07 +0000
Subject: [issue37330] open(): remove 'U' mode, deprecated since Python 3.3
In-Reply-To: <1560872905.7.0.609892598407.issue37330@roundup.psfhosted.org>
Message-ID: <1561125667.71.0.39979134161.issue37330@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I reported the issue to docutils. In fact, docutils FileInput class was already fixed to prevent the deprecation warning, but there was no release yet:
https://sourceforge.net/p/docutils/bugs/363/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37330>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:03:20 2019
From: report at bugs.python.org (Pierre Glaser)
Date: Fri, 21 Jun 2019 14:03:20 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1561125800.84.0.74701074477.issue37244@roundup.psfhosted.org>


Change by Pierre Glaser <pierreglaser at msn.com>:


----------
keywords: +patch
pull_requests: +14110
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14288

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:28:10 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Fri, 21 Jun 2019 14:28:10 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561127290.79.0.926770829825.issue37250@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

It isn't the actively maintained projects that publish wheel files that I'm worried about fixing - it's the sdist only projects that would otherwise only need recompilation to work on the new Python version.

With this fixed, and the PyCode_New -> PyCode_New + PyCode_WithPosArgs fix from bpo-37221 merged, then that long tail will get another few years of life, and will start emitting deprecation warnings for the part that's actually going to go away in Python 3.9 (i.e. the tp_print slot).

My opinion would be different if tp_print had actually been emitting compile time warnings for the past 10 years, but it hasn't been - we just haven't been using it for anything.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:30:56 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Fri, 21 Jun 2019 14:30:56 +0000
Subject: [issue30905] Embedding should have public API for interactive mode
In-Reply-To: <1499783657.19.0.814858997931.issue30905@psf.upfronthosting.co.za>
Message-ID: <1561127456.05.0.414262937409.issue30905@roundup.psfhosted.org>


Change by Joannah Nanjekye <nanjekyejoannah at gmail.com>:


----------
nosy: +nanjekyejoannah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30905>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:31:07 2019
From: report at bugs.python.org (Dave Malcolm)
Date: Fri, 21 Jun 2019 14:31:07 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561127467.96.0.875975574913.issue37362@roundup.psfhosted.org>


Dave Malcolm <dmalcolm at redhat.com> added the comment:

I think when I wrote this I was over-optimistically thinking that we could just add more patterns, but if it's becoming a pain, then your approach looks good to me.

----------
nosy: +dmalcolm

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:34:55 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 14:34:55 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561127695.25.0.793795478666.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I'm curious what you mean here...

msg345409

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:39:06 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 14:39:06 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561127946.14.0.146006351547.issue37250@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> With this fixed, and the PyCode_New -> PyCode_New + PyCode_WithPosArgs fix from bpo-37221 merged, then that long tail will get another few years of life, and will start emitting deprecation warnings for the part that's actually going to go away in Python 3.9 (i.e. the tp_print slot).

By definition (as unmaintained packages), that's a few more years until death. Nobody is looking at their compile time warnings (that would require maintenance ;) ), so nothing will happen until it actually breaks. Keeping the field for one more version makes less sense than keeping it forever.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 10:55:00 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Fri, 21 Jun 2019 14:55:00 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1561128900.5.0.00358290885846.issue37221@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

I'm happy with the change in https://github.com/python/cpython/pull/13959, but we need sign-off from ?ukasz as release manager on bumping the Py_VERSION_SERIAL a bit early so Cython can reliably detect that this change has been reverted without having to check for the existence of the PyCode_NewWithPosArgs symbol.

Alternatively, if my proposal at https://github.com/cython/cython/pull/3009 to check directly for PyCode_NewWithPosOnlyArgs in the Cython module setup code is accepted, then we wouldn't need to bump the version number early, and could merge the PR as soon as the What's New conflict is resolved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:10:50 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 21 Jun 2019 15:10:50 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561129850.93.0.772984171679.issue37316@roundup.psfhosted.org>


Change by Eric Snow <ericsnowcurrently at gmail.com>:


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:27:37 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 21 Jun 2019 15:27:37 +0000
Subject: [issue37293] concurrent.futures.InterpreterPoolExecutor
In-Reply-To: <1560604517.31.0.263744065617.issue37293@roundup.psfhosted.org>
Message-ID: <1561130857.81.0.119041296864.issue37293@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

FWIW, performance benefits when subinterpreters stop sharing the GIL are not the only benefit.  In fact, PEP 554 is specifically written to avoid that consideration, focusing on the benefits of the concurrency model (i.e. CSP).  So I wouldn't call this pointless even without per-interpreter GIL. :)

(Of course, this *would* be blocked on acceptance and implementation of PEP 554.)

----------
stage:  -> needs patch

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37293>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:28:08 2019
From: report at bugs.python.org (Eric Snow)
Date: Fri, 21 Jun 2019 15:28:08 +0000
Subject: [issue37293] concurrent.futures.InterpreterPoolExecutor
In-Reply-To: <1560604517.31.0.263744065617.issue37293@roundup.psfhosted.org>
Message-ID: <1561130888.42.0.396464455558.issue37293@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

@Davin, we've spoken before about something similar for multiprocessing, IIRC. :)

----------
nosy: +davin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37293>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:32:15 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 15:32:15 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561131135.46.0.100779740288.issue37316@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Thanks! Well spotted.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:32:24 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 15:32:24 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561131144.92.0.57665495082.issue37316@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 08286d52b29de604a4b187bf1f0d4209e39c926c by Steve Dower (Zackery Spytz) in branch 'master':
bpo-37316: mmap.mmap() passes the wrong variable to PySys_Audit() (GH-14152)
https://github.com/python/cpython/commit/08286d52b29de604a4b187bf1f0d4209e39c926c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:42:29 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 15:42:29 +0000
Subject: [issue37363] Additional PEP578 hooks
Message-ID: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

We should also (see whether we should) add audit hooks for the following modules:
* configparser
* crypt
* ensurepip
* ftplib
* glob
* http
* imaplib
* nntplib
* pdb
* poplib
* runpy
* shutil
* smtpd
* smtplib
* socketserver
* sqlite3
* telnetlib
* webbrowser
* xmlrpc

All of these seem likely to have interesting events (specifically, they can all be misused in scenarios where the impact would not be obvious without extra information).

----------
messages: 346229
nosy: christian.heimes, steve.dower
priority: normal
severity: normal
stage: needs patch
status: open
title: Additional PEP578 hooks
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:46:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 15:46:04 +0000
Subject: [issue37364] Use io.open_code for .pth files
Message-ID: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

Since .pth files may contain executable code, we should open them using io.open_code().

----------
messages: 346230
nosy: christian.heimes, steve.dower
priority: normal
severity: normal
stage: needs patch
status: open
title: Use io.open_code for .pth files
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:46:48 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 21 Jun 2019 15:46:48 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1561132008.28.0.107978356853.issue33694@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14111
pull_request: https://github.com/python/cpython/pull/14152

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:50:56 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 21 Jun 2019 15:50:56 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561132256.95.0.640044096571.issue37364@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

+1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 11:52:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 15:52:16 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561132336.04.0.447654743251.issue37316@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14112
pull_request: https://github.com/python/cpython/pull/14289

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:08:01 2019
From: report at bugs.python.org (Adrien)
Date: Fri, 21 Jun 2019 16:08:01 +0000
Subject: [issue37365] RecursionError not caught explicitly may crash with
 "Aborted (core dumped)"
Message-ID: <1561133281.34.0.995554507152.issue37365@roundup.psfhosted.org>


New submission from Adrien <delgan.py at gmail.com>:

This is an issue that I first saw repoted by @remi.lapeyre on issue36272: https://bugs.python.org/issue36272#msg337843
It also be reported some years ago: https://stackoverflow.com/a/54171640/2291710
I searched but I did not find any existing issue, so I open a new one, I hope this is not a duplicate.

It's easily reproducible:


def rec():
    try:
        rec()
    except Exception:
        rec()
rec()


It will kill the CPython interpreter (@remi.lapeyre provided explanation in the issue I linked).

Of course, this is a contrived example. Still, I guess CPython should avoid to crash in any situation. This is a tricky edge case: by doing `except Exception:` one could expect to correctly handle all kind of errors without being aware that in some situation the "RecursionError" need to be managed too.

Particularly, the fix in issue36272 solely patches "StreamHandler": https://github.com/python/cpython/blob/65f64b1903ae85b97a30f514bbc1b7ce940c3af2/Lib/logging/__init__.py#L1082-L1102
There is many other handlers that are still affected, every time you see "except Exception" in "emit()": https://github.com/python/cpython/blob/65f64b1903ae85b97a30f514bbc1b7ce940c3af2/Lib/logging/handlers.py

Finally, it should also be noted that the "except RecursionError" workaround implies that loggers are not longer able to catch recursive erros in "write()" or "format()" without re-raising the RecursionError and (probably) halting the program.
It may happen for example that a faulty implementation of a custom Handler or LogRecord attribute cause a RecursionError. Thanks to the "raiseExceptions = false" logging option, this would usually be caught and a message printed on stderr without killing the app.

----------
messages: 346232
nosy: Delgan
priority: normal
severity: normal
status: open
title: RecursionError not caught explicitly may crash with "Aborted (core dumped)"
type: crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37365>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:40:29 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 16:40:29 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561135229.41.0.3494445781.issue36511@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f8dd77d36067fd7be614edde1e5e9e7467c450dc by Steve Dower (Paul Monson) in branch 'master':
bpo-36511: Fix -u parameters for ARM32 tests (GH-14280)
https://github.com/python/cpython/commit/f8dd77d36067fd7be614edde1e5e9e7467c450dc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:45:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 16:45:04 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561135504.77.0.602814190475.issue36511@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14113
pull_request: https://github.com/python/cpython/pull/14290

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:45:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 16:45:16 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561135516.68.0.852130558098.issue37316@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 6c7947713a40851e123493ca0fe8f2791d7ed2a6 by Steve Dower in branch '3.8':
bpo-37316: mmap.mmap() passes the wrong variable to PySys_Audit() (GH-14152)
https://github.com/python/cpython/commit/6c7947713a40851e123493ca0fe8f2791d7ed2a6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:48:58 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 16:48:58 +0000
Subject: [issue37316] mmap.mmap() passes the wrong variable to PySys_Audit()
In-Reply-To: <1560765079.9.0.997846608931.issue37316@roundup.psfhosted.org>
Message-ID: <1561135738.19.0.64187571483.issue37316@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37316>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:53:37 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 21 Jun 2019 16:53:37 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561136017.57.0.18594978336.issue37348@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +14114
pull_request: https://github.com/python/cpython/pull/14291

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 12:59:50 2019
From: report at bugs.python.org (Mariatta)
Date: Fri, 21 Jun 2019 16:59:50 +0000
Subject: [issue32924] Python 3.7 docs in docs.p.o points to GitHub's master
 branch
In-Reply-To: <1519405058.43.0.467229070634.issue32924@psf.upfronthosting.co.za>
Message-ID: <1561136390.7.0.316699755751.issue32924@roundup.psfhosted.org>


Change by Mariatta <mariatta at python.org>:


----------
pull_requests: +14115
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14282

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32924>
_______________________________________

From report at bugs.python.org  Fri Jun 21 13:03:09 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 21 Jun 2019 17:03:09 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561136589.49.0.80808348722.issue19696@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

> Would it be appropriate to change the "choose" method to "choice"? 

Yep, just make sure the tests still pass before and after the change. :)

> should the name of "test_pkgimport" instead be "test_pkg_import"?

Since things are moving it's fine to rename the file.

> would it be best to perform all of these changes within separate pull requests, or are they minor enough to be combined into one?

Separate are easier to review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 21 13:08:34 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 21 Jun 2019 17:08:34 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561136914.74.0.398899490249.issue37354@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

> How will this interact with EnvBuilder.install_scripts() (which explicitly states that it performs textual substitution)?

It won't, so that would have to change as well. As you mentioned, Paul, I don't know who even uses the functionality through a subclass, but since this is a security consideration I think it's worth changing.

> Is it?

Sorry, misread what you were asking. You're right it's not stored, but it can be worked out in other ways, e.g. from the location of pyvenv.cfg or Activate.ps1, etc.

> So there could be code changes in venv too.

Yep, hence making the issue now so that others talking about adding more substitution ideas know that there's talk going the other way and removing the substitution abilities.

> This would be a great contribution from a PowerShell expert, and might be worth advertising (Twitter) for one.

Already have a co-worker interested in working on it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Fri Jun 21 13:08:38 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 21 Jun 2019 17:08:38 +0000
Subject: [issue37354] Write PowerShell Activate.ps1 to be static so it can be
 signed
In-Reply-To: <1561055369.2.0.393754678677.issue37354@roundup.psfhosted.org>
Message-ID: <1561136918.77.0.784409950966.issue37354@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37354>
_______________________________________

From report at bugs.python.org  Fri Jun 21 13:10:02 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 21 Jun 2019 17:10:02 +0000
Subject: [issue37348] Optimize PyUnicode_GetString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561137002.22.0.258089315245.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

PR 14291 seems simpler than PR 14283.  But PR 14283 is faster because _PyUnicodeWriter is a learge struct.

master: 3.7sec
PR 14283: 2.9sec
PR 14291: 3.45sec

compiler: gcc (Ubuntu 8.3.0-6ubuntu1) 8.3.0
without LTO, without PGO

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 13:14:07 2019
From: report at bugs.python.org (Carol Willing)
Date: Fri, 21 Jun 2019 17:14:07 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561137247.4.0.493213305255.issue37250@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Thanks Petr for the wonderful summary.

Of the pros/cons that you mention (if I am understanding correctly), I think that the issue comes down to sdist consumers and regeneration.

1. If sdist consumers will need to regenerate an sdist?
2. How many sdist consumers will likely be impacted?
3. If impacted, how difficult would the regeneration be for a scientist who is moderately comfortable with compilation?
4. Is there any guidance or information that can be given to sdist consumers?

Do we have any good metrics/insights on Question 2 and 3?

---

While TypeObject size, updating a pinned version, and vectorcall optimization for prior versions are considerations, I believe that they are secondary:

- Typeobject size: Nice to have a smaller size but probably not a concern of the sdist consumer or general user.
- Update a pinned Cython version: General expectation is it should work with the environment which it was pinned within. There should not be an expectation that the pinned version will work if other parts of the environment change.
- vectorcall optimization extends to prior versions: While perhaps nice to have, it is likely more an added benefit instead of an implicit contract or expectation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:06:51 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 18:06:51 +0000
Subject: [issue32924] Python 3.7 docs in docs.p.o points to GitHub's master
 branch
In-Reply-To: <1519405058.43.0.467229070634.issue32924@psf.upfronthosting.co.za>
Message-ID: <1561140411.65.0.165907859697.issue32924@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 52c4a4fb816d51a36c02b043d6fd5eeb875411d6 by Miss Islington (bot) (Mariatta) in branch '3.8':
[3.8] bpo-32924: Fix the Show Source url in 3.8 documentation. (GH-14282)
https://github.com/python/cpython/commit/52c4a4fb816d51a36c02b043d6fd5eeb875411d6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32924>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:17:05 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 21 Jun 2019 18:17:05 +0000
Subject: [issue30202] Update test.test_importlib.test_abc to test find_spec()
In-Reply-To: <1493416572.94.0.214494308366.issue30202@psf.upfronthosting.co.za>
Message-ID: <1561141025.06.0.471757401906.issue30202@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:


New changeset a0d73a143af404deecb9c4fcdbd3ddbafd96b41b by Brett Cannon (Joannah Nanjekye) in branch 'master':
bpo-30202 : Update test.test_importlib.test_abc to test find_spec() (GH-12847)
https://github.com/python/cpython/commit/a0d73a143af404deecb9c4fcdbd3ddbafd96b41b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30202>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:26:38 2019
From: report at bugs.python.org (Roufique Hossain)
Date: Fri, 21 Jun 2019 18:26:38 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561141598.39.0.49264839375.issue24214@roundup.psfhosted.org>


Change by Roufique Hossain <roufique at rtat.net>:


----------
nosy: +roufique7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:26:38 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 21 Jun 2019 18:26:38 +0000
Subject: [issue37298] IDLE: Revise html to tkinker converter for help.html
In-Reply-To: <1560649872.44.0.457910225797.issue37298@roundup.psfhosted.org>
Message-ID: <1561141598.57.0.505841846594.issue37298@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Thank you for the research, including the crucial commit!  What I understand from the quotes:

1. Sphinx 2 writes HTML5 by default.  The html5 writers always writes paragraphs because they are required by the xhtml used by html5.

2. Firefox, for instance, displays the result the same as before either because it either has the logic to avoid extra blank lines when reading html5 or because this is taken care of by revised css (this is unclear from the quotes). 

To deal with html5, our converter would have to ignore the <p>s that the html4 writer omitted, by adding logic for the cases used in idle.rst.  Not fun.

Reading the commit (3rd line) revealed a new sphinx configuration option: html4_writer, defaulting to False.  When I switched from building html with my 3.6 install with sphinx 1.8.1 to 3.7 with 2.something, and added "-D html4_writer=1" to a direct call of sphinx-build, I indeed got html without added <p>s.  The only different was the irrelevant omission of '\n' between list item header and text in the html file.  Example:
  -<dt>New File</dt>
  -<dd>Create a new file editing window.</dd>
  +<dt>New File</dt><dd>Create a new file editing window.</dd>

Setting SPHINXOPTS should work when using 'Doc/make.bat html'.  I will prepare a PR documenting our parser requirement and include the neutral html changes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37298>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:28:24 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 18:28:24 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1561141704.13.0.408459982183.issue37302@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +14116
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14292

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:28:24 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 18:28:24 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1561141704.22.0.406782247349.issue36422@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +14117
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14292

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:35:37 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 21 Jun 2019 18:35:37 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1561142137.93.0.86457701204.issue37323@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
keywords: +patch
pull_requests: +14118
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14293

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:35:45 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 21 Jun 2019 18:35:45 +0000
Subject: [issue37365] RecursionError not caught explicitly may crash with
 "Aborted (core dumped)"
In-Reply-To: <1561133281.34.0.995554507152.issue37365@roundup.psfhosted.org>
Message-ID: <1561142145.64.0.961206961434.issue37365@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thank you for the report.  The issue of the interpreter not being able to gracefully handle a stack overflow error is an old one: see, for example Issue18075 or Issue35542.  So far, no one has proposed a solution and, as can be seen in Issue18075, workarounds someimes produce unexpected side-effects that can be more problematic than the stack overflow segfault.  I'm going to close this as a duplicate of Issue18075.  If anyone has further suggestions for solutions, please continue the discussion there.

----------
nosy: +ned.deily
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Infinite recursion tests triggering a segfault

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37365>
_______________________________________

From report at bugs.python.org  Fri Jun 21 14:57:28 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 21 Jun 2019 18:57:28 +0000
Subject: [issue37307] isinstance/issubclass doc isn't clear on whether it's an
 AND or an OR.
In-Reply-To: <1560686347.4.0.566273891061.issue37307@roundup.psfhosted.org>
Message-ID: <1561143448.35.0.403079276364.issue37307@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions:  -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37307>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:01:10 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:01:10 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1561143670.98.0.429500897065.issue37302@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

The PR is ready for review.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:03:24 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:03:24 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1561143804.38.0.870811694565.issue37302@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:09:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 19:09:02 +0000
Subject: [issue37169] test_pyobject_is_freed_free fails with 3.8.0beta1
In-Reply-To: <1559778711.54.0.15966452891.issue37169@roundup.psfhosted.org>
Message-ID: <1561144142.78.0.0168386520867.issue37169@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I have no idea why the test fails on this specific server, whereas it pass on our large fleet of buildbots which test various libc and various compilers and platforms.

I cannot investigate if I cannot reproduce the failure. Someone should run the test in a debugger to see the content of the memory after free.

Python is not used with malloc, except for debug or testing. In thr meanwhile you can skip this test for malloc, since it seems to work with pymalloc. The same test is run on malloc and on pymalloc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37169>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:25:52 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:25:52 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
Message-ID: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>


New submission from Jeffrey Kintscher <websurfer at surf2c.net>:

Add an "onitem" callback paramter to shutil.rmtree() that, if provided, gets called for each directory entry as it is encountered.  This allows the caller to perform any required special handling of individual directory entries (e.g. unmounting a mount point, closing a file, shutting down a named pipe, etc.) before rmtree() attempts to remove them.

This enhancement is related to issue #36422.

----------
components: Library (Lib)
messages: 346245
nosy: Jeffrey.Kintscher
priority: normal
severity: normal
status: open
title: Add an "onitem" callback parameter to shutil.rmtree()
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:36:47 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:36:47 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561145807.05.0.685909730734.issue37366@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +giampaolo.rodola, josh.r, max, paul.moore, riccardomurri, serhiy.storchaka, steve.dower, tarek, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:41:57 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:41:57 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561146117.74.0.544407419048.issue37366@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:42:14 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 21 Jun 2019 19:42:14 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1561146134.49.0.449898204497.issue37302@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
versions: +Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:46:08 2019
From: report at bugs.python.org (Dan Snider)
Date: Fri, 21 Jun 2019 19:46:08 +0000
Subject: [issue37367] octal escapes applied inconsistently throughout the
 interpreter and lib
Message-ID: <1561146368.97.0.686299796922.issue37367@roundup.psfhosted.org>


New submission from Dan Snider <mr.assume.away at gmail.com>:

At present, the bytecode compiler can generate 512 different unicode characters, one for each integral from the range [0-511), 512 being the total number of syntactically valid permutations of 3 octal digits preceded by a backslash. However, this does not match the regex compiler, which raises an error regardless of the input type when it encounters an an octal escape character with a decimal value greater than 255. On the other hand... the bytes literal:

>>> b'\407'

is somehow valid, and can lead to extremely difficult bugs to track down, such as this nonsense:

>>> re.compile(b'\407').search(b'\a')
<re.Match object; span=(0, 1), match=b'\x07'>

I propose that the regex parser be augmented, enabling for unicode patterns the interpretation of three character octal escapes from the range(256, 512), while the bytecode parser be adjusted to match the behavior of the regex parser, raising an error for bytes literals > b"\400", rather than truncating the 9th bit.

----------
messages: 346246
nosy: bup
priority: normal
severity: normal
status: open
title: octal escapes applied inconsistently throughout the interpreter and lib

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37367>
_______________________________________

From report at bugs.python.org  Fri Jun 21 15:49:26 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 21 Jun 2019 19:49:26 +0000
Subject: [issue37367] octal escapes applied inconsistently throughout the
 interpreter and lib
In-Reply-To: <1561146368.97.0.686299796922.issue37367@roundup.psfhosted.org>
Message-ID: <1561146566.67.0.442791529849.issue37367@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
components: +Regular Expressions
nosy: +ezio.melotti, mrabarnett, serhiy.storchaka
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37367>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:03:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:03:51 +0000
Subject: [issue37348] Optimize PyUnicode_FromString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561151031.84.0.508472756553.issue37348@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I'm confused by the issue title: PyUnicode_GetString() doesn't exist, it's PyUnicode_FromString() :-) I changed the title.

----------
title: Optimize PyUnicode_GetString for short ASCII strings -> Optimize PyUnicode_FromString for short ASCII strings

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:06:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:06:40 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561151200.65.0.931341254007.issue24214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf1 in position 1: invalid continuation byte

Python is right: b'f\xf1\xf6rd' is not a valid UTF-8 string:

$ python3
Python 3.7.3 (default, May 11 2019, 00:38:04) 
>>> b'f\xf1\xf6rd'.decode()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf1 in position 1: invalid continuation byte

This change is deliberate: it makes UTF-8 incremental decoder correct (respect the UTF-8 standard). I close the issue.

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:08:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:08:50 +0000
Subject: [issue37368] test_asyncio: test_create_server_ssl_match_failed()
 failed on s390x SLES 3.x and logged an unraisable exception
Message-ID: <1561151330.27.0.514257001535.issue37368@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

https://buildbot.python.org/all/#/builders/16/builds/3290

test_create_server_ssl_match_failed (test.test_asyncio.test_events.PollEventLoopTests) ...

/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/sslproto.py:321: ResourceWarning: unclosed transport <asyncio.sslproto._SSLProtocolTransport object at 0x3ff9c5d8cd0>
  _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback

Warning -- Unraisable exception
Exception ignored in: <function _SSLProtocolTransport.__del__ at 0x3ff9e45e5f0>
Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/sslproto.py", line 322, in __del__
    self.close()
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/sslproto.py", line 317, in close
    self._ssl_protocol._start_shutdown()
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/sslproto.py", line 591, in _start_shutdown
    self._abort()
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/sslproto.py", line 732, in _abort
    self._transport.abort()
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/selector_events.py", line 660, in abort
    self._force_close(None)
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/selector_events.py", line 711, in _force_close
    self._loop.call_soon(self._call_connection_lost, exc)
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/base_events.py", line 711, in call_soon
    self._check_closed()
  File "/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/base_events.py", line 504, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed

/home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/selector_events.py:684: ResourceWarning: unclosed transport <_SelectorSocketTransport closing fd=7>
  _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback

Task was destroyed but it is pending!
task: <Task pending name='Task-443' coro=<BaseSelectorEventLoop._accept_connection2() done, defined at /home/dje/cpython-buildarea/3.x.edelsohn-sles-z/build/Lib/asyncio/selector_events.py:191> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x3ff9c54ac90>()]>>

ok

----------
components: Tests, asyncio
messages: 346249
nosy: asvetlov, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: test_asyncio: test_create_server_ssl_match_failed() failed on s390x SLES 3.x and logged an unraisable exception
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37368>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:09:57 2019
From: report at bugs.python.org (Mark Rice)
Date: Fri, 21 Jun 2019 21:09:57 +0000
Subject: [issue37352] Typo in documentation: "to making it easy"
In-Reply-To: <1561051076.38.0.680855087082.issue37352@roundup.psfhosted.org>
Message-ID: <1561151397.01.0.968389235407.issue37352@roundup.psfhosted.org>


Mark Rice <mrice at nocimed.com> added the comment:

Hi, first time on here. And new to the python bug tracker. But, the sentence might read fine as is, or could be tweaked to say "with an eye toward making it easily tested..." as Zach suggested. It is what my internal grammar alarm jumped to automatically.

----------
nosy: +mrice88

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37352>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:17:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:17:35 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561151855.99.0.712747866485.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset e56a123fd0acaa295a28b98d2e46d956b97d1263 by Victor Stinner in branch 'master':
bpo-37362: test_gdb now ignores stderr (GH-14287)
https://github.com/python/cpython/commit/e56a123fd0acaa295a28b98d2e46d956b97d1263


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:17:48 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 21:17:48 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561151868.76.0.119708880716.issue37362@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14119
pull_request: https://github.com/python/cpython/pull/14295

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:17:56 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 21:17:56 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561151876.56.0.65700758215.issue37362@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14120
pull_request: https://github.com/python/cpython/pull/14296

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:22:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:22:43 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561152163.87.0.0300644011973.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I think when I wrote this I was over-optimistically thinking that we could just add more patterns, but if it's becoming a pain, then your approach looks good to me.

Well, I tried hard to fit into this approach: over the years, I added more and more patterns... but it's a painful work: first a CI break, I add more patterns and then I have to backport the change to all branches. As I wrote, I'm not convinced of the purpose of getting a failure in this case. Python doesn't get any benefit from this.

Anyway, I merged my change. Thanks for your approval ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:27:29 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Fri, 21 Jun 2019 21:27:29 +0000
Subject: [issue30052] URL Quoting page links to function Bytes instead of
 defintion
In-Reply-To: <1492001374.68.0.411275444037.issue30052@psf.upfronthosting.co.za>
Message-ID: <1561152449.85.0.470182734743.issue30052@roundup.psfhosted.org>


Cheryl Sabella <cheryl.sabella at gmail.com> added the comment:

Hi @wim.glenn, 

Thanks for the report.  It looks like the same issue applies to all the built-in functions that are handled this way, not just bytearray and bytes.  So, dict, frozenset, list, memoryview, range, set, str, and tuple too.  I'm not sure what the fix is, but I agree that we should take a look.  Can you create a new tracker issue for this?  Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30052>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:28:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:28:01 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561152481.6.0.886067458905.issue37362@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14121
pull_request: https://github.com/python/cpython/pull/14297

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:28:50 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 21:28:50 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561152530.52.0.668281636124.issue37351@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f5690925df897cf45818bf944b28d13f37b9f8ca by Steve Dower in branch 'master':
bpo-37351: Removes libpython38.a from standard Windows distribution (#14276)
https://github.com/python/cpython/commit/f5690925df897cf45818bf944b28d13f37b9f8ca


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:30:39 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 21:30:39 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561152639.39.0.0623206673448.issue37351@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14122
pull_request: https://github.com/python/cpython/pull/14298

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:38:30 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 21:38:30 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561153110.86.0.892687269859.issue37362@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 16ec95bb191e4136630de7437f75636d4b6a450f by Miss Islington (bot) in branch '3.7':
bpo-37362: test_gdb now ignores stderr (GH-14287)
https://github.com/python/cpython/commit/16ec95bb191e4136630de7437f75636d4b6a450f


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:39:52 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 21:39:52 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561153192.93.0.144449301354.issue36511@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset f3e38ec7f014557296f6cc7b60a33d65faad1716 by Steve Dower in branch '3.8':
bpo-36511: Fix -u parameters for ARM32 tests (GH-14280)
https://github.com/python/cpython/commit/f3e38ec7f014557296f6cc7b60a33d65faad1716


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:40:01 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 21:40:01 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561153201.91.0.699200458651.issue37362@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3523e0c47be372477e990df7435a0f45be80fd50 by Miss Islington (bot) in branch '3.8':
bpo-37362: test_gdb now ignores stderr (GH-14287)
https://github.com/python/cpython/commit/3523e0c47be372477e990df7435a0f45be80fd50


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:43:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 21:43:20 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561153400.16.0.83951768096.issue37364@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
assignee:  -> steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:43:56 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 21:43:56 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561153436.8.0.919118033208.issue37364@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14123
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14299

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 17:59:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 21:59:11 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561154351.13.0.690904429136.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset adcdb1e4f5eb3c63e4e40242737be9c00a26764c by Victor Stinner in branch '2.7':
bpo-37362: test_gdb now ignores stderr (GH-14287) (GH-14297)
https://github.com/python/cpython/commit/adcdb1e4f5eb3c63e4e40242737be9c00a26764c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:16:52 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 22:16:52 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561155412.96.0.348493682099.issue37364@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 184f3d4f39056f6fe450d007d3b9b61d811a2a4d by Miss Islington (bot) (Steve Dower) in branch 'master':
bpo-37364: Use io.open_code() to read .pth files (GH-14299)
https://github.com/python/cpython/commit/184f3d4f39056f6fe450d007d3b9b61d811a2a4d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:17:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 22:17:13 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561155433.09.0.941262275202.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

For the record, examples of ignored patterns:

        ignore_patterns = (
            'Function "%s" not defined.' % breakpoint,
            'Do you need "set solib-search-path" or '
            '"set sysroot"?',
            # BFD: /usr/lib/debug/(...): unable to initialize decompress
            # status for section .debug_aranges
            'BFD: ',
            # ignore all warnings
            'warning: ',
            )

Enjoy the older list before I chose to ignore "warning: " :-)

        # Ignore some benign messages on stderr.
        ignore_patterns = (
            'Function "%s" not defined.' % breakpoint,
            "warning: no loadable sections found in added symbol-file"
            " system-supplied DSO",
            "warning: Unable to find libthread_db matching"
            " inferior's thread library, thread debugging will"
            " not be available.",
            "warning: Cannot initialize thread debugging"
            " library: Debugger service failed",
            'warning: Could not load shared library symbols for '
            'linux-vdso.so',
            'warning: Could not load shared library symbols for '
            'linux-gate.so',
            'warning: Could not load shared library symbols for '
            'linux-vdso64.so',
            'Do you need "set solib-search-path" or '
            '"set sysroot"?',
            'warning: Source file is more recent than executable.',
            # Issue #19753: missing symbols on System Z
            'Missing separate debuginfo for ',
            'Try: zypper install -C ',
            )

Oh strange, "Missing separate debuginfo for " message was ignored!

commit f4a4898c18c9cc5ca6d2747789c6586524daf461
Author: Victor Stinner <victor.stinner at gmail.com>
Date:   Sun Nov 24 18:55:25 2013 +0100

    Issue #19753: Try to fix test_gdb on SystemZ buildbot

But I removed it in:

commit 904f5def5cc6da106a1e2e9feb0830cdb1433519
Author: Victor Stinner <victor.stinner at gmail.com>
Date:   Wed Mar 23 18:32:54 2016 +0100

    Try to fix test_gdb on s390x buildbots

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:17:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 22:17:38 +0000
Subject: [issue37362] test_gdb must not fail on "unexpected" messages written
 into stderr
In-Reply-To: <1561124756.23.0.387959706511.issue37362@roundup.psfhosted.org>
Message-ID: <1561155458.73.0.170846327046.issue37362@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I closed the issue. test_gdb now ignores stderr in all branches.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37362>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:17:52 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 22:17:52 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561155472.69.0.818293048275.issue37364@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14124
pull_request: https://github.com/python/cpython/pull/14300

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:35:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 21 Jun 2019 22:35:17 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561156517.54.0.717835022931.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Effect of my PR 14053 using script.py:

import sys
print(f"{__file__=}")
print(f"{sys.argv=}")
print(f"{sys.path[0]=}")

Before:

$ ./python script.py 
__file__=script.py
sys.argv=['script.py']
sys.path[0]=/home/vstinner/prog/python/master

With the change:

$ ./python script.py 
__file__=/home/vstinner/prog/python/master/script.py
sys.argv=['/home/vstinner/prog/python/master/script.py']
sys.path[0]=/home/vstinner/prog/python/master

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:35:48 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 21 Jun 2019 22:35:48 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561156548.31.0.40261172429.issue37364@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 35202c763703c9c00345b4445a638211e6e37bbc by Miss Islington (bot) in branch '3.8':
bpo-37364: Use io.open_code() to read .pth files (GH-14299)
https://github.com/python/cpython/commit/35202c763703c9c00345b4445a638211e6e37bbc


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 18:56:35 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 22:56:35 +0000
Subject: [issue37364] Use io.open_code for .pth files
In-Reply-To: <1561131964.9.0.272012376462.issue37364@roundup.psfhosted.org>
Message-ID: <1561157795.33.0.0520134091635.issue37364@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37364>
_______________________________________

From report at bugs.python.org  Fri Jun 21 19:01:08 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 21 Jun 2019 23:01:08 +0000
Subject: [issue30202] Update test.test_importlib.test_abc to test find_spec()
In-Reply-To: <1493416572.94.0.214494308366.issue30202@psf.upfronthosting.co.za>
Message-ID: <1561158068.0.0.556954328297.issue30202@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30202>
_______________________________________

From report at bugs.python.org  Fri Jun 21 19:13:06 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 21 Jun 2019 23:13:06 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561158786.63.0.212111795994.issue37363@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14125
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14301

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Fri Jun 21 19:54:16 2019
From: report at bugs.python.org (Brooke Storm)
Date: Fri, 21 Jun 2019 23:54:16 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
Message-ID: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>


New submission from Brooke Storm <brooke at largespiky.club>:

I am finding that, using Powershell on Windows 10 and the current version of Python 3.7.3 installed from the Microsoft Store, when I create a virtualenv via "python -m venv <name>" and activate it in Powershell with the Activate.ps1 script that is generated, pip fails with:

> pip freeze
Fatal error in launcher: Unable to create process using '"c:\users\<home>\<path-to-venv>\scripts\python.exe"  "C:\Users\<home>\<path-to-venv>\Scripts\pip.exe" freeze'

There are no spaces in my python path, and I cannot find any "simple workaround" that actually works online.  I am using pip 19.1.1 (current as of now).  This only happens with Powershell.  cmd.exe is able to use the virtualenv and pip just fine after using the activate.bat script.

If I activate in Powershell and run "python -m pip" or similar commands, including importing pip, I get a message that pip is not installed, which is interesting.

My Powershell version as installed is:
Major  Minor  Build  Revision
-----  -----  -----  --------
5      1      18917  1000

I also tried Powershell Core 6 with the same result.  This seems to be a consistent behavior of the resultant Activate.ps1 script, which is why I'm creating the issue here.  I didn't find quite a duplicate when I searched, but I could be wrong.

----------
components: Windows
messages: 346264
nosy: bstorm, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Issue with pip in venv on Powershell in Windows
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 21 20:03:34 2019
From: report at bugs.python.org (Brooke Storm)
Date: Sat, 22 Jun 2019 00:03:34 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561161814.11.0.650835326342.issue37369@roundup.psfhosted.org>


Brooke Storm <brooke at largespiky.club> added the comment:

I should add that, after testing a bit, it isn't actually working in cmd.exe.  That is simply using the overarching python install.  It's not using the virtualenv at all.  The virtualenv that was created by the venv module appears to be non-functional at least as far as pip goes (which makes it hard to use at all).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 21 20:58:50 2019
From: report at bugs.python.org (Paul Monson)
Date: Sat, 22 Jun 2019 00:58:50 +0000
Subject: [issue37370] AF_UNIX should be supported on Windows
Message-ID: <1561165130.02.0.287912372249.issue37370@roundup.psfhosted.org>


New submission from Paul Monson <paulmons at gmail.com>:

AF_UNIX has been supported on windows since version 1803 (build 17134)
see https://devblogs.microsoft.com/commandline/af_unix-comes-to-windows/

Enabling support for AF_UNIX will enable better peer-to-peer connectivity scenarios for Azure IoT Edge.  The changes to enable AF_UNIX on Windows seem small and low risk.

I need feedback on these proposed changes

----------
components: Windows
messages: 346266
nosy: Paul Monson, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: AF_UNIX should be supported on Windows
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37370>
_______________________________________

From report at bugs.python.org  Fri Jun 21 21:02:44 2019
From: report at bugs.python.org (Paul Monson)
Date: Sat, 22 Jun 2019 01:02:44 +0000
Subject: [issue37370] AF_UNIX should be supported on Windows
In-Reply-To: <1561165130.02.0.287912372249.issue37370@roundup.psfhosted.org>
Message-ID: <1561165364.65.0.63616974046.issue37370@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
keywords: +patch
pull_requests: +14126
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14302

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37370>
_______________________________________

From report at bugs.python.org  Fri Jun 21 21:11:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Sat, 22 Jun 2019 01:11:31 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561165891.32.0.147062752985.issue37250@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Fri Jun 21 22:37:49 2019
From: report at bugs.python.org (aeros167)
Date: Sat, 22 Jun 2019 02:37:49 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561171069.16.0.979090654227.issue19696@roundup.psfhosted.org>


aeros167 <aeros167 at gmail.com> added the comment:

> Yep, just make sure the tests still pass before and after the change. :)

Sounds good, the first thing I had done before proposing the change was testing it in an IDE and using some logging to ensure that random.choose and random.choice were providing the same functionality. So hopefully the PR tests will pass as well. 

> Separate are easier to review.

Alright, I'll do each of the file moves in individual PRs and then a separate one for changing random.choice to random.choose. 

Thanks!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 21 22:45:17 2019
From: report at bugs.python.org (aeros167)
Date: Sat, 22 Jun 2019 02:45:17 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561171517.96.0.584717030386.issue19696@roundup.psfhosted.org>


Change by aeros167 <aeros167 at gmail.com>:


----------
keywords: +patch
pull_requests: +14127
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14303

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 21 23:00:41 2019
From: report at bugs.python.org (Caleb Hattingh)
Date: Sat, 22 Jun 2019 03:00:41 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1561172441.7.0.561664722024.issue37334@roundup.psfhosted.org>


Caleb Hattingh <caleb.hattingh at gmail.com> added the comment:

I'm interested in how this change would affect the pattern of shutting down a queue-processing task.

How would one decide between whether to cancel the queue or the task? (I'm asking for real, this is not an objection to the PR). For example, looking at the two tests in the PR:

    def test_cancel_get(self):
        queue = asyncio.Queue(loop=self.loop)

        getter = self.loop.create_task(queue.get())
        test_utils.run_briefly(self.loop)
        queue.cancel()                       # <---- HERE
        test_utils.run_briefly(self.loop)
        with self.assertRaises(asyncio.CancelledError):
            self.loop.run_until_complete(getter)

This test would work exactly the same if the `getter` task was cancelled instead right?  Like this:

    def test_cancel_get(self):
        queue = asyncio.Queue(loop=self.loop)

        getter = self.loop.create_task(queue.get())
        test_utils.run_briefly(self.loop)
        getter.cancel()                       # <---- HERE
        test_utils.run_briefly(self.loop)
        with self.assertRaises(asyncio.CancelledError):
            self.loop.run_until_complete(getter)

So my initial reaction is that I'm not sure under what conditions it would be more useful to cancel the queue instead of the task. I am very used to applying cancellation to tasks rather than the queues they contain, so I might lack imagination in this area. The idiom I've been using so far for consuming queues looks roughly something like this:

async def consumer(q: asyncio.Queue):
    while True:
        try:
            data = await q.get()
        except asyncio.CancelledError:
            q.put_nowait(None) # ignore QueueFull for this discussion
            continue

        try:
            if not data:
                logging.info('Queue shut down cleanly')
                return     # <------ The only way to leave the coro
            <process data>
        except Exception:
            logging.exception('Unexpected exception:')
            continue
        finally:
            q.task_done() 

^^ With this pattern, I can shut down the `consumer` task either by cancelling the task (internally it'll put a `None` on the queue) or by placing a `None` on the queue outright from anywhere else. The key point is that in either case, existing items on the queue will still get processed before the `None` is consumed, terminating the task from the inside.

(A) If the queue itself is cancelled (as in the proposed PR), would it still be possible to catch the `CancelledError` and continue processing whatever items have already been placed onto the queue? (and in this case, I think I'd still need to place a sentinel onto the queue to mark the "end"...is that correct?)

(B) The `task_done()` is important for app shutdown so that the application shutdown process waits for all currently-pending queue items to be processed before proceeding with the next shutdown step. So, if the queue itself is cancelled (as in the proposed PR), what happens to the application-level call to `await queue.join()` during the shutdown sequence, if a queue was cancelled while there were still unprocessed items on the queue for which `task_done()` had not been called?

It would be great to have an example of how the proposed `queue.cancel()` would be used idiomatically, w.r.t. the two questions above.  It might be intended that the idiomatic usage of `queue.cancel()` is for situations where one doesn't care about dropping items previously placed on the queue. Is that the case?

----------
nosy: +cjrh

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Fri Jun 21 23:45:57 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Sat, 22 Jun 2019 03:45:57 +0000
Subject: [issue37345] Add formal support for UDPLITE protococl
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561175157.3.0.94073410906.issue37345@roundup.psfhosted.org>


Gabe Appleton <gabe at gabeappleton.me> added the comment:

Okay, I removed the helper functions and added some additional documentation. Does that look okay now?

----------
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Sat Jun 22 00:32:19 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 04:32:19 +0000
Subject: [issue36073] sqlite crashes with converters mutating cursor
In-Reply-To: <1550821487.87.0.741979609564.issue36073@roundup.psfhosted.org>
Message-ID: <1561177939.96.0.101509599279.issue36073@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +berker.peksag

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36073>
_______________________________________

From report at bugs.python.org  Sat Jun 22 00:45:10 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 04:45:10 +0000
Subject: [issue32934] logging.handlers.BufferingHandler capacity is unclearly
 specified
In-Reply-To: <1519467889.68.0.467229070634.issue32934@psf.upfronthosting.co.za>
Message-ID: <1561178710.81.0.600298073791.issue32934@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +vinay.sajip
type:  -> behavior
versions: +Python 3.7, Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32934>
_______________________________________

From report at bugs.python.org  Sat Jun 22 03:13:54 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 22 Jun 2019 07:13:54 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561187634.53.0.692466961254.issue37345@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
title: Add formal support for UDPLITE protococl -> Add formal support for UDPLITE protocol

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Sat Jun 22 03:17:21 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 07:17:21 +0000
Subject: [issue37212] ordered keyword arguments in unittest.mock.call repr and
 error messages
In-Reply-To: <1560153217.35.0.990763770677.issue37212@roundup.psfhosted.org>
Message-ID: <1561187841.05.0.534524908359.issue37212@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I created a python-dev thread for discussion : https://mail.python.org/archives/list/python-dev at python.org/thread/6F2NGCERZLZ2CDGYIAR5QOHMGAAE5VHE/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37212>
_______________________________________

From report at bugs.python.org  Sat Jun 22 04:12:39 2019
From: report at bugs.python.org (Adrien)
Date: Sat, 22 Jun 2019 08:12:39 +0000
Subject: [issue37365] RecursionError not caught explicitly may crash with
 "Aborted (core dumped)"
In-Reply-To: <1561133281.34.0.995554507152.issue37365@roundup.psfhosted.org>
Message-ID: <1561191159.13.0.68704919134.issue37365@roundup.psfhosted.org>


Adrien <delgan.py at gmail.com> added the comment:

Thanks to your answer, @ned.deily.

Sorry to insist, but are you sure this is a duplicate of issue18075 / issue35542?

According to the discussion in issue36272, it seems this is not related to stack exhaustion nor to issue18075.

Also, @remi.lapeyre suggested that a fix could be possible by modifying ceval.c. (re-raise RecursionError if it has been cleared).

issue18075 and issue35542 are both of status "closed", I would expect this issue to be duplicate to an "open" issue because there is a clear reproducible "bug" which crashes the interpreter.

There is also the problems still remaining in logging Handlers that I linked.

I think this is an issue with how recursion error are handled in ceval.c, this is related to "tstate->overflowed" and "tstate->recursion_depth > recursion_limit + 50".
If I understand correctly, this is implemented like this to allow gracefully catch and handle RecursionError from the calling function.
For example, why not re-raise the exception if the first one could not be handled correctly?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37365>
_______________________________________

From report at bugs.python.org  Sat Jun 22 04:26:08 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 22 Jun 2019 08:26:08 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561191968.17.0.955948178256.issue37345@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
versions:  -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Sat Jun 22 04:26:52 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 22 Jun 2019 08:26:52 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561192012.16.0.866169276226.issue37345@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

3.8 is in beta stage, public API is frozen

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Sat Jun 22 05:57:37 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 22 Jun 2019 09:57:37 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561197457.88.0.282930182385.issue24214@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +14128
pull_request: https://github.com/python/cpython/pull/14304

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Sat Jun 22 06:11:05 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 22 Jun 2019 10:11:05 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561198265.14.0.141412799426.issue24214@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Victor, I think you misunderstood the issue. The problem is not that a decoding error is raised. The problem is that the incremental decoder no longer raises where it raised before.

I think that both behavior may be correct, and that it is better to not rely on ability of the incremental decoder with final=False to detect an invalid encoded data, but I see now that it is possible to fix for the original issue more carefully, without changing that behavior. PR 14304 does this.

It also change the UTF-16 incremental decoder with the surrogatepass error handler to return a non-empty data when decode a low surrogate with final=False. It is not necessary, but it makes all UTF-* decoders consistent and makes tests simpler.

----------
resolution: fixed -> 
stage: resolved -> patch review
status: closed -> open
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Sat Jun 22 06:25:33 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 10:25:33 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1561199133.93.0.225782707943.issue37323@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 186f70905d07b42a9cbf0a29e448f30baf2b53cb by Miss Islington (bot) (Xtreak) in branch 'master':
bpo-37323: Suppress DeprecationWarning raised by @asyncio.coroutine (GH-14293)
https://github.com/python/cpython/commit/186f70905d07b42a9cbf0a29e448f30baf2b53cb


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Sat Jun 22 06:25:42 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 10:25:42 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1561199142.58.0.490809002082.issue37323@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14129
pull_request: https://github.com/python/cpython/pull/14305

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Sat Jun 22 06:43:11 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 10:43:11 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1561200191.09.0.94846755759.issue37323@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 9b32b44d3ec298e02c33fea1aa842f52c9650243 by Miss Islington (bot) in branch '3.8':
bpo-37323: Suppress DeprecationWarning raised by @asyncio.coroutine (GH-14293)
https://github.com/python/cpython/commit/9b32b44d3ec298e02c33fea1aa842f52c9650243


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Sat Jun 22 07:16:49 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 22 Jun 2019 11:16:49 +0000
Subject: [issue37323] test_asyncio: test_debug_mode_interop() fails using
 -Werror
In-Reply-To: <1560803823.97.0.920531372035.issue37323@roundup.psfhosted.org>
Message-ID: <1561202209.0.0.355684127479.issue37323@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37323>
_______________________________________

From report at bugs.python.org  Sat Jun 22 08:32:07 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 22 Jun 2019 12:32:07 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1561206727.95.0.0427479411029.issue37334@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Agree with Caleb.

The more I think the more I doubt about the proposal.
Cancellation is for tasks, not for queues or locks.

When should I cancel a queue but cannot cancel a task?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Sat Jun 22 08:46:26 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 22 Jun 2019 12:46:26 +0000
Subject: [issue32934] logging.handlers.BufferingHandler capacity is unclearly
 specified
In-Reply-To: <1519467889.68.0.467229070634.issue32934@psf.upfronthosting.co.za>
Message-ID: <1561207586.86.0.549874717958.issue32934@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Python isn't a low-level language, and there isn't *in general* a particular intention "to give a bound to memory usage". When using "buffer" in a general sense, rather than a buffer object (which is more akin to a byte-array), it's usually understood to mean a Python list (used as an array) and the capacity refers to the number of elements.

You may struggle to see a use case for specifying a buffer capacity as a number of elements rather than a byte size, but that doesn't mean that such use cases don't exist.

Are you perhaps using MicroPython in a constrained-memory environment?

In the 17 years that this code has been in Python, it's the first time AFAIK that anyone has raised the term "capacity" as potentially confusing, so I don't think such confusion is common. However, I'll be happy to update the documentation to clarify that "capacity" means "number of records buffered".

----------
assignee:  -> vinay.sajip
components: +Documentation -Library (Lib)
stage:  -> needs patch
type: behavior -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32934>
_______________________________________

From report at bugs.python.org  Sat Jun 22 08:51:07 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 22 Jun 2019 12:51:07 +0000
Subject: [issue34556] Add --upgrade to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561207867.94.0.518495345224.issue34556@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

Can this issue be closed now?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Sat Jun 22 09:23:27 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 22 Jun 2019 13:23:27 +0000
Subject: [issue37370] AF_UNIX should be supported on Windows
In-Reply-To: <1561165130.02.0.287912372249.issue37370@roundup.psfhosted.org>
Message-ID: <1561209807.05.0.944301426463.issue37370@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

This is a duplicate of bpo-33408.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37370>
_______________________________________

From report at bugs.python.org  Sat Jun 22 10:11:00 2019
From: report at bugs.python.org (Shlomi Fish)
Date: Sat, 22 Jun 2019 14:11:00 +0000
Subject: [issue37371] Optimize and refactor readline().
Message-ID: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>


New submission from Shlomi Fish <shlomif at shlomifish.org>:

See:

https://github.com/python/cpython/pull/14306

===================

1. Merge two duplicate branches.

2. Extract some constants.

3. Convert to prefix-++ instead of suffix-++.

===========

Benchmarks:

before:

+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.655s
user	0m6.599s
sys	0m0.054s
+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.817s
user	0m6.772s
sys	0m0.045s
+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.763s
user	0m6.706s
sys	0m0.057s

============

After:

+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.651s
user	0m6.595s
sys	0m0.056s
+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.625s
user	0m6.559s
sys	0m0.066s
+ PATH=/home/shlomif/apps/python3/bin:/home/shlomif/apps/fcs/bin:/home/shlomif/progs/freecell/git/0fc-b/:/home/shlomif/progs/freecell/git/0fc-b//board_gen:/home/shlomif/bin:/home/shlomif/apps/perl/modules/bin:/home/shlomif/apps/perl/modules/local/bin:/home/shlomif/apps/neovim/bin:/home/shlomif/apps/fop/fop-20140425:/home/shlomif/apps/vim/bin:/home/shlomif/apps/golang/bin:/home/shlomif/.local/bin:/home/shlomif/.perl6/bin:/home/shlomif/.cargo/bin:/usr/local/bin:/usr/bin:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/usr/games
+ export LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ LD_LIBRARY_PATH=/home/shlomif/apps/python3/lib
+ python3 collect-stats.py 0fc-log.txt
S	18474775
Int	617438

real	0m6.601s
user	0m6.559s
sys	0m0.042s

=========

Based on https://github.com/shlomif/freecell-pro-0fc-deals .

<!--
Thanks for your contribution!
Please read this comment in its entirety. It's quite important.

# Pull Request title

It should be in the following format:

```
bpo-NNNN: Summary of the changes made
```

Where: bpo-NNNN refers to the issue number in the https://bugs.python.org.

Most PRs will require an issue number. Trivial changes, like fixing a typo, do not need an issue.

# Backport Pull Request title

If this is a backport PR (PR made against branches other than `master`),
please ensure that the PR title is in the following format:

```
[X.Y] <title from the original PR> (GH-NNNN)
```

Where: [X.Y] is the branch name, e.g. [3.6].

GH-NNNN refers to the PR number from `master`.

-->

----------
components: IO
messages: 346280
nosy: shlomif
priority: normal
pull_requests: 14130
severity: normal
status: open
title: Optimize and refactor readline().
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Sat Jun 22 10:26:05 2019
From: report at bugs.python.org (Daniel Hilst Selli)
Date: Sat, 22 Jun 2019 14:26:05 +0000
Subject: [issue37212] ordered keyword arguments in unittest.mock.call repr and
 error messages
In-Reply-To: <1560153217.35.0.990763770677.issue37212@roundup.psfhosted.org>
Message-ID: <1561213565.23.0.779450462446.issue37212@roundup.psfhosted.org>


Change by Daniel Hilst Selli <danielhilst at gmail.com>:


----------
nosy: +dhilst

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37212>
_______________________________________

From report at bugs.python.org  Sat Jun 22 10:28:15 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 14:28:15 +0000
Subject: [issue37212] ordered keyword arguments in unittest.mock.call repr and
 error messages
In-Reply-To: <1560153217.35.0.990763770677.issue37212@roundup.psfhosted.org>
Message-ID: <1561213695.02.0.254690270334.issue37212@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I will create a PR for this as per mailing list discussion : https://mail.python.org/archives/list/python-dev at python.org/message/JWPDLKNM5X27FRWJG7UOAFXHNRUGH44S/

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37212>
_______________________________________

From report at bugs.python.org  Sat Jun 22 10:40:58 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 14:40:58 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561214458.08.0.481993842641.issue35224@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c8a35417db8853a253517a3e5190e174075c6384 by Miss Islington (bot) (J?rn Heissler) in branch 'master':
bpo-35224: Reverse evaluation order of key: value in dict comprehensions (GH-14139)
https://github.com/python/cpython/commit/c8a35417db8853a253517a3e5190e174075c6384


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 11:49:15 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Sat, 22 Jun 2019 15:49:15 +0000
Subject: [issue37371] Optimize and refactor readline().
In-Reply-To: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>
Message-ID: <1561218555.47.0.373972605688.issue37371@roundup.psfhosted.org>


Change by Michele Angrisano <michele.angrisano at gmail.com>:


----------
nosy: +benjamin.peterson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Sat Jun 22 11:54:15 2019
From: report at bugs.python.org (Gabe Appleton)
Date: Sat, 22 Jun 2019 15:54:15 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561218855.16.0.504022314926.issue37345@roundup.psfhosted.org>


Gabe Appleton <gabe at gabeappleton.me> added the comment:

I didn't realize that when I submitted this the first time, but I corrected that in the documentation when someone else removed it from the tags. If I re-added it it was by mistake. I notice that my browser had that auto-highlighted. Should be fixed now.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Sat Jun 22 12:15:13 2019
From: report at bugs.python.org (Justin Blanchard)
Date: Sat, 22 Jun 2019 16:15:13 +0000
Subject: [issue37372] datetime.time unpickling fails in case of python2 pickle
 with seconds>=24
Message-ID: <1561220113.72.0.97808916119.issue37372@roundup.psfhosted.org>


New submission from Justin Blanchard <uncombedcoconut at gmail.com>:

Under bpo-22005, Python 3 gained support for unpickling datetime data from Python 2. (Thanks!) It turns out the input validation isn't quite right: it bombs on datetime.time when the encoded seconds (not hours) field is >=24:

python2>>> datetime.time(1, 2, 3).__reduce__()
(<type 'datetime.time'>, ('\x01\x02\x03\x00\x00\x00',))
python2>>> datetime.time(23, 24, 25).__reduce__()
(<type 'datetime.time'>, ('\x17\x18\x19\x00\x00\x00',))

python3>>> datetime.time('\x01\x02\x03\x00\x00\x00')
datetime.time(1, 2, 3)
python3>>> datetime.time('\x17\x18\x19\x00\x00\x00')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: an integer is required (got type str)

I would like to contribute a fix and will be opening a PR. This is my first contribution - any help and patience appreciated!

----------
components: Library (Lib)
messages: 346284
nosy: Justin Blanchard
priority: normal
severity: normal
status: open
title: datetime.time unpickling fails in case of python2 pickle with seconds>=24
type: behavior
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37372>
_______________________________________

From report at bugs.python.org  Sat Jun 22 12:42:42 2019
From: report at bugs.python.org (Roundup Robot)
Date: Sat, 22 Jun 2019 16:42:42 +0000
Subject: [issue37372] datetime.time unpickling fails in case of python2 pickle
 with seconds>=24
In-Reply-To: <1561220113.72.0.97808916119.issue37372@roundup.psfhosted.org>
Message-ID: <1561221762.76.0.586095521517.issue37372@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14131
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14307

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37372>
_______________________________________

From report at bugs.python.org  Sat Jun 22 12:51:31 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 16:51:31 +0000
Subject: [issue37372] datetime.time unpickling fails in case of python2 pickle
 with seconds>=24
In-Reply-To: <1561220113.72.0.97808916119.issue37372@roundup.psfhosted.org>
Message-ID: <1561222291.97.0.312294497084.issue37372@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +belopolsky, p-ganssle
versions:  -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37372>
_______________________________________

From report at bugs.python.org  Sat Jun 22 13:07:14 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 22 Jun 2019 17:07:14 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561223234.12.0.504785781291.issue37347@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

But there can be only one progress handler per connection, so you can just keep an single reference in the struct yourself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Sat Jun 22 13:21:57 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sat, 22 Jun 2019 17:21:57 +0000
Subject: [issue37371] Optimize and refactor readline().
In-Reply-To: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>
Message-ID: <1561224117.27.0.21642652917.issue37371@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Could you please provide some mickrobenchmarks that shows the performance boost?

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Sat Jun 22 13:53:28 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 17:53:28 +0000
Subject: [issue37372] datetime.time unpickling fails in case of python2 pickle
 with seconds>=24
In-Reply-To: <1561220113.72.0.97808916119.issue37372@roundup.psfhosted.org>
Message-ID: <1561226008.22.0.0671180137301.issue37372@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37372>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:08:45 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 18:08:45 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561226925.19.0.0414114122472.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

All the stable 3.x Windows buildbots are failing since (https://github.com/python/cpython/pull/14139) was merged:

https://buildbot.python.org/all/#/builders/3/builds/3026
https://buildbot.python.org/all/#/builders/40/builds/2621
https://buildbot.python.org/all/#/builders/12/builds/2766

Extract from the logs:

2 tests failed:
    test_asdl_parser test_clinic

 ======================================================================
ERROR: test_attributes (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 64, in test_attributes
    stmt = self.types['stmt']
KeyError: 'stmt'
======================================================================
ERROR: test_constructor_fields (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 72, in test_constructor_fields
    ehandler = self.types['excepthandler']
KeyError: 'excepthandler'
======================================================================
ERROR: test_definitions (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 54, in test_definitions
    self.assertIsInstance(self.types['withitem'], self.asdl.Product)
KeyError: 'withitem'
======================================================================
ERROR: test_product (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 58, in test_product
    alias = self.types['alias']
KeyError: 'alias'
======================================================================
ERROR: test_visitor (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 119, in test_visitor
    v.visit(self.types['mod'])
KeyError: 'mod'
======================================================================
FAIL: test_module (test.test_asdl_parser.TestAsdlParser)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\buildarea\3.x.bolen-windows10\build\lib\test\test_asdl_parser.py", line 45, in test_module
    self.assertIn('stmt', self.types)
AssertionError: 'stmt' not found in {Sum([Construct....
----------------------------------------------------------------------

I cannot reproduce the error locally on my Windows 10 machine, but it fails consistently. I made a custom run in one of the buildbots and still fails:

https://buildbot.python.org/all/#/builders/3/builds/3027

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:13:59 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 18:13:59 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561227239.76.0.215082318332.issue37359@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Another failure:

https://buildbot.python.org/all/#/builders/103/builds/2688/steps/6/logs/stdio

======================================================================
FAIL: test_list_cases (test.test_regrtest.ArgsTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/test_regrtest.py", line 915, in test_list_cases
    self.assertEqual(output.splitlines(), all_methods)
AssertionError: Lists differ: ['tes[73 chars]hod2', "/buildbot/buildarea/cpython/3.x.ware-g[305 chars]th:'] != ['tes[73 chars]hod2']
First list contains 2 additional elements.
First extra element 2:
"/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/support/__init__.py:1058: RuntimeWarning: tests may fail, unable to create temporary directory '/buildbot/tmp/tmpdir/test_python_5670': [Errno 17] File exists: '/buildbot/tmp/tmpdir/test_python_5670'"
  ['test_regrtest_noop8.Tests.test_method1',
-  'test_regrtest_noop8.Tests.test_method2',
?                                          ^
+  'test_regrtest_noop8.Tests.test_method2']
?                                          ^
-  '/buildbot/buildarea/cpython/3.x.ware-gentoo-x86.installed/build/target/lib/python3.9/test/support/__init__.py:1058: '
-  'RuntimeWarning: tests may fail, unable to create temporary directory '
-  "'/buildbot/tmp/tmpdir/test_python_5670': [Errno 17] File exists: "
-  "'/buildbot/tmp/tmpdir/test_python_5670'",
-  '  with temp_dir(path=name, quiet=quiet) as temp_path:']
----------------------------------------------------------------------
Ran 73 tests in 35.451s
FAILED (failures=1, skipped=5)
test test_regrtest failed
1 test failed again:
    test_regrtest

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:32:55 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 22 Jun 2019 18:32:55 +0000
Subject: [issue37302] Add an "onerror" callback parameter to the
 tempfile.TemporaryDirectory member functions
In-Reply-To: <1560660368.0.0.203020777798.issue37302@roundup.psfhosted.org>
Message-ID: <1561228375.58.0.543732526723.issue37302@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
components: +Library (Lib)

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37302>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:33:25 2019
From: report at bugs.python.org (Ben Darnell)
Date: Sat, 22 Jun 2019 18:33:25 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
Message-ID: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>


New submission from Ben Darnell <ben.darnell at gmail.com>:

On Windows there are two event loop implementions with different interfaces: The proactor event loop is missing the file descriptor family of methods (add_reader()), while the selector event loop has other limitations including missing support for pipes and subprocesses and generally lower scalability. (The default has changed from selector to proactor in Python 3.8).

If an application requires the selector event loop, it can set the global event loop policy when it starts up. But what if a library requires the selector event loop? It wouldn't be appropriate for a library to set the event loop policy. The best I can do is document that "This library requires an event loop which supports the add_reader() method; to use this library on Windows (directly or indirectly) you must install the WindowsSelectorEventLoopPolicy."  

This places a burden on application developers that target Windows to examine all their transitive dependencies to see if any require selectorevent loops (and if any have conflicting requirements for proactor event loops, which are even less likely to be documented since this is now the default). Concretely, this is a concern for Tornado (which requires add_reader()) and applications in the scientific python community (including Jupyter) which depend on it. 

I know it's probably too late to do anything about this for 3.8, but it would be great if there were some better process to negotiate the right event loop. Some ideas (none of which are very satisfying):
- A declarative marker in setup.cfg or similar indicating the required feature set for an event loop
- A dummy package that could be depended on to indicate the same thing (and maybe this package could even use .pth hacks to change the default simply by being installed, but that seems like a hack too far)
- Some sort of runtime registry: at import time, Tornado could call `asyncio.add_required_features(asyncio.ADD_READER)` and this would influence the default policy
- Flags to `get_event_loop()` indicating the required features (passed through to the policy).

----------
components: asyncio
messages: 346289
nosy: Ben.Darnell, asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Configuration of windows event loop for libraries
type: enhancement
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:45:43 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 18:45:43 +0000
Subject: [issue37212] ordered keyword arguments in unittest.mock.call repr and
 error messages
In-Reply-To: <1560153217.35.0.990763770677.issue37212@roundup.psfhosted.org>
Message-ID: <1561229143.34.0.0592120583183.issue37212@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
keywords: +patch
pull_requests: +14132
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14310

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37212>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:51:54 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Sat, 22 Jun 2019 18:51:54 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561229514.7.0.0407611109676.issue35224@roundup.psfhosted.org>


J?rn Heissler <launchpad at joern.heissler.de> added the comment:

Pablo,
https://bugs.python.org/issue37359 was created yesterday, i.e. before the merge.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 14:55:08 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Sat, 22 Jun 2019 18:55:08 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561229708.71.0.888827091223.issue35224@roundup.psfhosted.org>


J?rn Heissler <launchpad at joern.heissler.de> added the comment:

Sorry,
I guess that's something completely different.

So maybe the issue is related to my pull request.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 15:24:39 2019
From: report at bugs.python.org (=?utf-8?q?J=C3=B6rn_Heissler?=)
Date: Sat, 22 Jun 2019 19:24:39 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561231479.64.0.643877126263.issue35224@roundup.psfhosted.org>


J?rn Heissler <launchpad at joern.heissler.de> added the comment:

My working theory:

The change modifies the MAP_ADD instruction and also what the instruction expects to find on the stack.
When *.pyc files are kept, the code generates the old stack layout (TOS=key, TOS1=value), but cpython will assume it's the other way round.

I.e. all *.pyc files created before the change won't work with later cpython versions, and vice versa.

I assume the build bots don't remove *.pyc files.

How large an issue is that?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 15:34:50 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Sat, 22 Jun 2019 19:34:50 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561232090.48.0.716445473802.issue37373@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

Victor, Andrew,

I'm not an expert in IOCP, but is it possible to implement add_reader/writer in ProactorEventLoop?  If there's no native API for that, I guess we can spawn a thread with a 'select()' call to emulate this API?

Lukasz, 

Another question: if we fix this, would you allow this to go in beta2/3?  Strictly speaking it's going to be a new functionality.

----------
nosy: +lukasz.langa, vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 15:53:06 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 22 Jun 2019 19:53:06 +0000
Subject: [issue20177] Derby #8: Convert 28 sites to Argument Clinic across 2
 files
In-Reply-To: <1389138574.32.0.892814928986.issue20177@psf.upfronthosting.co.za>
Message-ID: <1561233186.23.0.0542792751623.issue20177@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14133
pull_request: https://github.com/python/cpython/pull/14311

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20177>
_______________________________________

From report at bugs.python.org  Sat Jun 22 15:53:17 2019
From: report at bugs.python.org (shajianrui)
Date: Sat, 22 Jun 2019 19:53:17 +0000
Subject: [issue37301] CGIHTTPServer doesn't handle long POST requests
In-Reply-To: <1560656329.17.0.731326583269.issue37301@roundup.psfhosted.org>
Message-ID: <1561233197.61.0.956417633044.issue37301@roundup.psfhosted.org>


shajianrui <shajianrui at 126.com> added the comment:

Sorry for replying so late, and thank you very much for your reply and explanation.

At first reply to you last post: I think at least in the non-unix environment, the CGIHTTPRequestHandler read the whole(expected) data from rfile and then transfer it to the CGI script.

And considering the code for Unix environment, I dont think to set the rbufsize to -1 is a good idea. I prefer a safer way: to do a read() loop and read until nbytes received. It is much slower but more compatible. Like this:

            if self.command.lower() == "post" and nbytes > 0:
                #data = self.rfile.read(nbytes)                     #Original code at line 1199
                databuf = bytearray(nbytes)
                datacount = 0
                while datacount + 1 < nbytes:
                    buf = self.rfile.read(self.request.getsockopt(socket.SOL_SOCKET, socket.SO_RCVBUF))    #You can set your number.
                    if len(buf) == 0:            
                        print("Connection closed before nbytes reached.")
                        break
                    for i in range(len(buf)):
                        databuf[datacount] = buf[i]
                        datacount += 1
                        if datacount == nbytes:
                            break
                data = bytes(databuf)

This code is only for explanation... Not for use...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37301>
_______________________________________

From report at bugs.python.org  Sat Jun 22 15:54:05 2019
From: report at bugs.python.org (Big Stone)
Date: Sat, 22 Jun 2019 19:54:05 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561233245.78.0.814025848128.issue37373@roundup.psfhosted.org>


Big Stone <stonebig34 at gmail.com> added the comment:

Windows users would certainly prefer to have an emulated non-performant emulation of the old API, rather than a breakage of their beloved Jupyter/Tornado ecosystem.

----------
nosy: +Big Stone

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 16:28:40 2019
From: report at bugs.python.org (Mitar)
Date: Sat, 22 Jun 2019 20:28:40 +0000
Subject: [issue5752] xml.dom.minidom does not escape CR,
 LF and TAB characters within attribute values
In-Reply-To: <1239707588.77.0.33795755364.issue5752@psf.upfronthosting.co.za>
Message-ID: <1561235320.67.0.377350910033.issue5752@roundup.psfhosted.org>


Change by Mitar <mmitar at gmail.com>:


----------
nosy: +mitar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5752>
_______________________________________

From report at bugs.python.org  Sat Jun 22 16:31:20 2019
From: report at bugs.python.org (Mitar)
Date: Sat, 22 Jun 2019 20:31:20 +0000
Subject: [issue14465] xml.etree.ElementTree: add feature to prettify XML output
In-Reply-To: <1333294084.01.0.984287406664.issue14465@psf.upfronthosting.co.za>
Message-ID: <1561235480.43.0.300612000322.issue14465@roundup.psfhosted.org>


Change by Mitar <mmitar at gmail.com>:


----------
nosy: +mitar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue14465>
_______________________________________

From report at bugs.python.org  Sat Jun 22 16:34:20 2019
From: report at bugs.python.org (Mitar)
Date: Sat, 22 Jun 2019 20:34:20 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
Message-ID: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>


New submission from Mitar <mmitar at gmail.com>:

I am using Minidom to pretty-print XML. But currently if there is a quote inside a text segment it escapes it to &quot;

To my understanding this is unnecessary if all other symbols are escaped. This escaping makes it really ugly and defeats the purpose of me using Minidom for pretty-printing XML.

----------
components: XML
messages: 346296
nosy: mitar
priority: normal
severity: normal
status: open
title: Minidom does not have to escape quote inside text segments
type: enhancement
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 22 16:37:00 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 22 Jun 2019 20:37:00 +0000
Subject: [issue20177] Derby #8: Convert 28 sites to Argument Clinic across 2
 files
In-Reply-To: <1389138574.32.0.892814928986.issue20177@psf.upfronthosting.co.za>
Message-ID: <1561235820.27.0.427880344438.issue20177@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

I have created a PR for Modules/timemodule.c.

----------
nosy: +ZackerySpytz
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20177>
_______________________________________

From report at bugs.python.org  Sat Jun 22 16:42:24 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 22 Jun 2019 20:42:24 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1561231479.64.0.643877126263.issue35224@roundup.psfhosted.org>
Message-ID: <CAP7+vJJcbcFYoP+Jdxvq0_tsgL4qxoKedh6MWJPhuzP823F8rQ@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

Ouch. That means we need to buy.p the puck format version number.
-- 
--Guido (mobile)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 17:00:49 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sat, 22 Jun 2019 21:00:49 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561237249.63.0.575617068119.issue37373@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

> Is it possible to implement add_reader/writer in ProactorEventLoop?

Sorry, no. There is no way IIUC.

Regarding a request for selecting event loop by a library.
1. You can call asyncio.set_event_loop_policy() already.
2. From my understanding, there is no issue for Tornado itself. If Jupiter Notebook needs Tornado, Tornado needs selector event loop on Windows -- Jupiter can install the proper loop.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 17:08:06 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 22 Jun 2019 21:08:06 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561237686.87.0.367745701268.issue37351@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset fa23bd286fb7719bd7601da0b713457589f5536f by Steve Dower in branch '3.8':
bpo-37351: Removes libpython38.a from standard Windows distribution (GH-14276)
https://github.com/python/cpython/commit/fa23bd286fb7719bd7601da0b713457589f5536f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Sat Jun 22 17:09:33 2019
From: report at bugs.python.org (Mitar)
Date: Sat, 22 Jun 2019 21:09:33 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561237773.66.0.589673155178.issue37374@roundup.psfhosted.org>


Change by Mitar <mmitar at gmail.com>:


----------
keywords: +patch
pull_requests: +14134
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14312

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 22 17:35:27 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 22 Jun 2019 21:35:27 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561239327.34.0.428934375287.issue37363@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

PR 14301 has at least a few hooks for most of the modules above.

I think xmlrpc deserves some, but it is not as immediately obvious where to put them as for the other modules. smtpd also still needs looking at.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:03:50 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 22:03:50 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561241030.17.0.115263594528.issue35224@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +14136
pull_request: https://github.com/python/cpython/pull/14313

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:05:04 2019
From: report at bugs.python.org (Ben Darnell)
Date: Sat, 22 Jun 2019 22:05:04 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561241104.05.0.743639637265.issue37373@roundup.psfhosted.org>


Ben Darnell <ben.darnell at gmail.com> added the comment:

> From my understanding, there is no issue for Tornado itself. If Jupiter Notebook needs Tornado, Tornado needs selector event loop on Windows -- Jupiter can install the proper loop.

Right. I'm just advocating for something that would make the transition smoother than each project independently stumbling across this issue and adding their own patch (and then fielding support issues from users who have ended up with a combination of versions that doesn't quite work). This of course depends on how many affected projects there are; I know Jupyter is the biggest but they're not the only one. 

There's no more direct way, but a thread that does select() should work. In fact, ProactorEventLoop could simply spin up a SelectorEventLoop in another thread when one of the FD methods is called, and proxy the callbacks back and forth. 

    def add_reader(self, fd, callback, *args):
        if not self.selector_started:
            self.start_selector()
        self.selector.call_soon(self.selector.add_reader, fd, lambda: self.call_soon(callback, *args))

    def start_selector(self):
        self.selector = SelectorEventLoop()
        def target():
            asyncio.set_event_loop(self.selector)
            self.selector.run_forever()
        thread = threading.Thread(target=target)
        thread.start()
        # Clean shutdown is left as an exercise for the reader.

Unifying the two interfaces like this would be preferable to adding more complexity for configuration IMHO.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:05:05 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 22:05:05 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561241105.64.0.699397299148.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I have created PR14313 and triggered a custom build from that PR in the buildbots to confirm our hypothesis.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:16:00 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 22:16:00 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561241760.46.0.768810762109.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

Although it can be related, note that the buildbots do indeed delete pyc files. Check for example https://buildbot.python.org/all/#/builders/40/builds/2621/steps/2/logs/stdio :

...
Deleting .pyc/.pyo files ...
Deleting test leftovers ...
Using "C:\buildbot.python.org\3.x.kloth-win64\build\PCbuild\\..\externals\pythonx86\tools\python.exe" (found in externals directory)
Fetching external libraries...
...

But I could be missing something. What I don't understand currently is why it fails only on the Windows buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:16:20 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 22:16:20 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561241780.64.0.955005655927.issue35224@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14137
pull_request: https://github.com/python/cpython/pull/14314

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:20:53 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sat, 22 Jun 2019 22:20:53 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1561241780.65.0.621691068568.issue35224@roundup.psfhosted.org>
Message-ID: <CAP7+vJKnbt3qCnkyJLH+hRM02KncBViMAZxf-xG7mm-ZsqNsvA@mail.gmail.com>


Guido van Rossum <guido at python.org> added the comment:

I don't know why the failure is Windows-only, but I suspect that some of
the cleanup doesn't work there...

This definitely needs a bump of the pyc format version number.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:34:14 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 22:34:14 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561242854.08.0.555009026552.issue35224@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 874ff65e0a70ff4fd1a67e85cd61d76adfcc219d by Miss Islington (bot) in branch '3.8':
bpo-35224: Reverse evaluation order of key: value in dict comprehensions (GH-14139)
https://github.com/python/cpython/commit/874ff65e0a70ff4fd1a67e85cd61d76adfcc219d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:47:38 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sat, 22 Jun 2019 22:47:38 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561243658.08.0.788117328599.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 663131a6e2c6c8b83e9f982d8c6ca38fc7c238b4 by Pablo Galindo in branch 'master':
bpo-35224: Bump the pyc magic number after the change in MAP_ADD (GH-14313)
https://github.com/python/cpython/commit/663131a6e2c6c8b83e9f982d8c6ca38fc7c238b4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 18:47:43 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 22:47:43 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561243663.69.0.186898225918.issue35224@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14138
pull_request: https://github.com/python/cpython/pull/14315

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 19:04:47 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 22 Jun 2019 23:04:47 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561244687.02.0.232787701755.issue35224@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5c8b4e2b5de647a67dd1b6414fa520d2b8e973aa by Miss Islington (bot) in branch '3.8':
bpo-35224: Bump the pyc magic number after the change in MAP_ADD (GH-14313)
https://github.com/python/cpython/commit/5c8b4e2b5de647a67dd1b6414fa520d2b8e973aa


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 19:26:53 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 22 Jun 2019 23:26:53 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561246013.64.0.953654182325.issue37374@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +scoder, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 22 20:18:20 2019
From: report at bugs.python.org (Daniel Hilst Selli)
Date: Sun, 23 Jun 2019 00:18:20 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561249100.72.0.37142868098.issue37374@roundup.psfhosted.org>


Daniel Hilst Selli <danielhilst at gmail.com> added the comment:

Wouldn't be better to support this as a parameter? Escaping is pretty useful in HTML contexts

----------
nosy: +dhilst

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 22 21:19:01 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Sun, 23 Jun 2019 01:19:01 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561252741.94.0.506754357983.issue37373@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

Andrew,

> Sorry, no. There is no way IIUC.

Well, in this case we should do that via a thread+select approach as I and Ben suggested.

I can write some PoC code; will you have some time to polish it and commit it? (I'm OOO and don't have a windows machine/VM at the moment).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sat Jun 22 22:57:11 2019
From: report at bugs.python.org (Guido van Rossum)
Date: Sun, 23 Jun 2019 02:57:11 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561258631.01.0.640308114687.issue35224@roundup.psfhosted.org>


Guido van Rossum <guido at python.org> added the comment:

How are the buildbots doing now?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sat Jun 22 23:34:25 2019
From: report at bugs.python.org (Zac Hatfield-Dodds)
Date: Sun, 23 Jun 2019 03:34:25 +0000
Subject: [issue26967] argparse: allow_abbrev=False stops -vv from working
In-Reply-To: <1462475086.65.0.670765920247.issue26967@psf.upfronthosting.co.za>
Message-ID: <1561260865.14.0.462267033391.issue26967@roundup.psfhosted.org>


Change by Zac Hatfield-Dodds <zac.hatfield.dodds at gmail.com>:


----------
keywords: +patch
pull_requests: +14140
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14316

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26967>
_______________________________________

From report at bugs.python.org  Sun Jun 23 00:44:45 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Sun, 23 Jun 2019 04:44:45 +0000
Subject: [issue37284] Not obvious that new required attrs of
 sys.implementation must have a PEP.
In-Reply-To: <1560535361.35.0.573554677552.issue37284@roundup.psfhosted.org>
Message-ID: <1561265085.12.0.393504953925.issue37284@roundup.psfhosted.org>


Giovanni Cappellotto <potomak84 at gmail.com> added the comment:

Hi,

I'd like to claim this task if nobody else already started working on it.

----------
nosy: +potomak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37284>
_______________________________________

From report at bugs.python.org  Sun Jun 23 06:04:22 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 10:04:22 +0000
Subject: [issue37375] Fix a code style in dictobject.c
Message-ID: <1561284262.45.0.118240244482.issue37375@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
components: Interpreter Core
nosy: shihai1991
priority: normal
severity: normal
status: open
title: Fix a code style in dictobject.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37375>
_______________________________________

From report at bugs.python.org  Sun Jun 23 06:08:45 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 10:08:45 +0000
Subject: [issue37375] Fix a code style in dictobject.c
Message-ID: <1561284525.28.0.616112950247.issue37375@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +14141
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14317

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37375>
_______________________________________

From report at bugs.python.org  Sun Jun 23 06:12:04 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 10:12:04 +0000
Subject: [issue37375] Fix a code style in dictobject.c
Message-ID: <1561284724.57.0.302008165127.issue37375@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

# A small code style question: PyDictObject*mp should add a space:)
PyDictObject *mp = (PyDictObject *)op

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37375>
_______________________________________

From report at bugs.python.org  Sun Jun 23 06:31:57 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 23 Jun 2019 10:31:57 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561285917.22.0.773927930294.issue37373@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I doubt if we should split a proactor loop into two objects in two threads.
I see no strong objections but have a feeling that we'll get other problems in this way. asyncio is just not designed for this mode.

The proposal looks like a very dirty hack and smells as it is.
There is no very strong reason to apply it. 
Jupiter Notebook can fix the problem on its own side in two-three lines of clear code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sun Jun 23 07:18:32 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 23 Jun 2019 11:18:32 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1561288712.89.0.729480431626.issue35181@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Julien, @Barry

Now that the PRs are merged, I think that we can close this issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Sun Jun 23 07:34:11 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Sun, 23 Jun 2019 11:34:11 +0000
Subject: [issue35181] Doc: Namespace Packages: Inconsistent documentation of
 __loader__ being None
In-Reply-To: <1541543349.68.0.788709270274.issue35181@psf.upfronthosting.co.za>
Message-ID: <1561289651.01.0.603044191447.issue35181@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

Oops, sorry, only one of the two PRs has been merged.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35181>
_______________________________________

From report at bugs.python.org  Sun Jun 23 08:22:47 2019
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 23 Jun 2019 12:22:47 +0000
Subject: [issue37376] pprint for types.SimpleNamespace
Message-ID: <1561292567.66.0.352814165526.issue37376@roundup.psfhosted.org>


New submission from Carl Bordum Hansen <carl at bordum.dk>:

Currently, pprint.pprint does not help you at all when pretty-printing SimpleNamespaces. I have implemented support for this.

----------
components: Library (Lib)
messages: 346318
nosy: carlbordum, fdrake, serhiy.storchaka
priority: normal
severity: normal
status: open
title: pprint for types.SimpleNamespace
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37376>
_______________________________________

From report at bugs.python.org  Sun Jun 23 08:24:53 2019
From: report at bugs.python.org (Carl Bordum Hansen)
Date: Sun, 23 Jun 2019 12:24:53 +0000
Subject: [issue37376] pprint for types.SimpleNamespace
In-Reply-To: <1561292567.66.0.352814165526.issue37376@roundup.psfhosted.org>
Message-ID: <1561292693.54.0.899930107296.issue37376@roundup.psfhosted.org>


Change by Carl Bordum Hansen <carl at bordum.dk>:


----------
keywords: +patch
pull_requests: +14142
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14318

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37376>
_______________________________________

From report at bugs.python.org  Sun Jun 23 09:02:47 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 23 Jun 2019 13:02:47 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561294967.67.0.222265033014.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

All buildbots for 3.8 and master are green again :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 09:16:48 2019
From: report at bugs.python.org (Enrico Zini)
Date: Sun, 23 Jun 2019 13:16:48 +0000
Subject: [issue32934] logging.handlers.BufferingHandler capacity is unclearly
 specified
In-Reply-To: <1519467889.68.0.467229070634.issue32934@psf.upfronthosting.co.za>
Message-ID: <1561295808.53.0.341573431243.issue32934@roundup.psfhosted.org>


Enrico Zini <enrico at enricozini.org> added the comment:

Thanks! Clarifying "number of records buffered" would perfectly solve the problem for me.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32934>
_______________________________________

From report at bugs.python.org  Sun Jun 23 09:29:20 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 13:29:20 +0000
Subject: [issue37377] unicode error should raise a value error
Message-ID: <1561296560.83.0.406050319971.issue37377@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

>>> "\x1"
  File "<stdin>", line 1
SyntaxError: (unicode error) 'unicodeescape' codec can't decode bytes in position 0-2: truncated \xXX escape

I think rasing the valueError would be exact.(pep223 agree this behavior: https://www.python.org/dev/peps/pep-0223/#bdfl-pronouncements).

And I think the error type could be changed in:
https://github.com/python/cpython/blob/master/Python/ast.c#L682

----------
components: Interpreter Core
messages: 346321
nosy: shihai1991
priority: normal
severity: normal
status: open
title: unicode error should raise a value error
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37377>
_______________________________________

From report at bugs.python.org  Sun Jun 23 09:57:39 2019
From: report at bugs.python.org (Lokesh Chandak)
Date: Sun, 23 Jun 2019 13:57:39 +0000
Subject: [issue37378] FatalError: initfsencoding python couldn't find codec
 Module not found: Encodings
Message-ID: <1561298259.69.0.399868439526.issue37378@roundup.psfhosted.org>


New submission from Lokesh Chandak <lokeshchandak2 at gmail.com>:

I encountered this issue when using pip. Whenever I try to install a package, it shows a Fatal error, saying that the module encodings was not found, followed by a reboot.
The blue screen shows this message:
KMode exception not handled.
What failed: dipsp.sys.

I have tried uninstalling and reinstalling python 3.7.3. I have also tried moving back to Python 3.5, because I am certain that this issue didn't exist when I was using that. However I encountered the same issues again.

I can otherwise use the interpreter, and run all my code just fine. Previously installed modules like pandas and numpy also work like usual. The only difficulty I encountered is when attempting to install new packages using pip.

After looking around, I found something about setting PYTHONPATH and PYTHONHOME environment variables, but it didn't work either.
I tried installing python in different locations, but that didn't help either.

I am now stuck because I can't install any modules, (and I lost previously installed modules during clean reinstall).
How do I solve this? And while a solution is found, is there a way to install modules without pip?

----------
components: Installation, Windows
messages: 346322
nosy: Lokesh Chandak, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: FatalError: initfsencoding python couldn't find codec Module not found: Encodings
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37378>
_______________________________________

From report at bugs.python.org  Sun Jun 23 09:59:44 2019
From: report at bugs.python.org (nother)
Date: Sun, 23 Jun 2019 13:59:44 +0000
Subject: [issue37379] Provide triggering AttributeError exception to
 __getattr__ for reraising
Message-ID: <1561298384.82.0.239193690622.issue37379@roundup.psfhosted.org>


New submission from nother <christoph at out-world.com>:

Not sure where to file this suggestion properly and how.

Currently when mixing attributes and properties it can happen that an AttributeError not raised intentionally by @property getter can cause @property to vanish from from classinstance. This happens when on the class or any of its super classes __getattr__ method is defined and has no clue on how to handle attribute with name of property. In this case the latter is reported as not existent.

The understood purpose of this behavior is that this is the only means to enable @property getters to indicate the availability of the property for a specific class instance dependent upon local state of instance object. Another purpose is to implement canonical load/creation on deemand schema for @properties the same way as for attributes.

The down of this is that in case inside a more complex getter method an AttribteError is triggered unintentionally this also triggers call to __getattr__ whithout any means for the latter to figure whether the @property getter needs assistance or the error should be passed on unhandled.

Therefore i do suggest the following little change to slot_tp_getattr_hook method in file typeobject.c (github python/cpython master) on lines 6604 - 6607 from

`
if (res == NULL && PyErr_ExceptionMatches(PyExc_AttributeError)) {
        PyErr_Clear();
        res = call_attribute(self, getattr, name);
}
`

to 

`
if (res == NULL && PyErr_ExceptionMatches(PyExc_AttributeError)) {
        res = call_attribute(self, getattr, name);
        if ( res != NULL) {
             PyErr_Clear();
        }        
}
`

this little change would allow __getattr__ special method to 

  1) use plain raise (see pythoncode example attached) to reraise exception which caused the call to it

  2) allow @property getters convey by adding custom attribute to AttributteExcpetion  the reason for an intentionally raised AttributeError over to __getattr__ allowing for distinction between AttributeError raised to hide @property from class instance versus triggering load/creation on demmand for class instance vs AttributeError accidentially triggered by getter/setter/deleter code.


Still not possible would be for getattr and hasattr methods to figure whether the AttributeError is raised cause class instance does not have the requested attirbute or whether accessing the attribute or @property respekctive caused some there downstream an AttributeError. In case that would be reliably feasible at all.

----------
components: Interpreter Core
files: test6.py
messages: 346323
nosy: nother
priority: normal
severity: normal
status: open
title: Provide triggering AttributeError exception to __getattr__ for reraising
type: enhancement
Added file: https://bugs.python.org/file48432/test6.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37379>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:03:05 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 23 Jun 2019 14:03:05 +0000
Subject: [issue37377] unicode error should raise a value error
In-Reply-To: <1561296560.83.0.406050319971.issue37377@roundup.psfhosted.org>
Message-ID: <1561298585.48.0.287091579652.issue37377@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

It is a *syntax* error. You have written bad syntax, just as the error message says. Your \xXX code is too short, only 1 hex digit instead of 2. I disagree that this should be a value error: it isn't a bad value, it is bad syntax.

I don't know what the context of the BDFL pronouncement in PEP 223 was, but I think it was decided later that Guido wrong because the error in Python 2.4 and 2.5 was UnicodeDecodeError and then changed to SyntaxError in 2.6 (probably to match Python 3, I guess).

In Python 3, both unicode and bytes strings give a syntax error for this error.

----------
nosy: +steven.daprano
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37377>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:08:13 2019
From: report at bugs.python.org (Steven D'Aprano)
Date: Sun, 23 Jun 2019 14:08:13 +0000
Subject: [issue37379] Provide triggering AttributeError exception to
 __getattr__ for reraising
In-Reply-To: <1561298384.82.0.239193690622.issue37379@roundup.psfhosted.org>
Message-ID: <1561298893.78.0.948600124917.issue37379@roundup.psfhosted.org>


Steven D'Aprano <steve+python at pearwood.info> added the comment:

Could you supply a *simple* demonstration of a class showing this problem? I've looked at the uploaded "test6.py" (what happened to the other 5?) and don't see anything to do with either __getattr__ or property in it.

----------
nosy: +steven.daprano
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37379>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:15:14 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 14:15:14 +0000
Subject: [issue37377] unicode error should raise a value error
In-Reply-To: <1561296560.83.0.406050319971.issue37377@roundup.psfhosted.org>
Message-ID: <1561299314.93.0.9234203708.issue37377@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Got it, thank for your detailed explanation, steven.

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37377>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:18:12 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 14:18:12 +0000
Subject: [issue18299] Change script_helper to use universal_newlines=True in
 _assert_python
In-Reply-To: <1372163490.54.0.858843080501.issue18299@psf.upfronthosting.co.za>
Message-ID: <1561299492.05.0.413582423184.issue18299@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
nosy:  -shihai1991

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18299>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:20:14 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 23 Jun 2019 14:20:14 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561299614.09.0.256487954798.issue35224@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

So issue29652 can be closed now? Was all concerns of previous discussions addressed?

I suggest to increment the magic number by 1, not by 10. The space of magic numbers is finite.

Add please a What's New entry for this change.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 10:50:07 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 23 Jun 2019 14:50:07 +0000
Subject: [issue35431] Add a function for computing binomial coefficients to
 the math module
In-Reply-To: <1544131082.09.0.788709270274.issue35431@psf.upfronthosting.co.za>
Message-ID: <1561301407.42.0.82328838183.issue35431@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 914d6b79735e5eabaf4e4d77e3f2ad4eae0beb9a by Serhiy Storchaka in branch '3.8':
[3.8] bpo-35431: Test math.comb() and math.perm() for OverflowError only on CPython. (GH-14146) (#14226)
https://github.com/python/cpython/commit/914d6b79735e5eabaf4e4d77e3f2ad4eae0beb9a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35431>
_______________________________________

From report at bugs.python.org  Sun Jun 23 11:09:04 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 23 Jun 2019 15:09:04 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561302544.16.0.562309021945.issue35224@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +14143
pull_request: https://github.com/python/cpython/pull/14319

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 11:12:30 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 23 Jun 2019 15:12:30 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561302750.55.0.127803565019.issue35224@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
pull_requests: +14144
pull_request: https://github.com/python/cpython/pull/14320

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 12:00:12 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Sun, 23 Jun 2019 16:00:12 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561305612.01.0.458362867348.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset b3ca7972c8d8c6479b6542ce28e0f7a6ebd5b8fe by Pablo Galindo in branch 'master':
bpo-35224: Bump the pyc magic number by 1 instead of by 10 in last modification (GH-14320)
https://github.com/python/cpython/commit/b3ca7972c8d8c6479b6542ce28e0f7a6ebd5b8fe


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 12:01:07 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 23 Jun 2019 16:01:07 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561305667.27.0.935283912766.issue35224@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14145
pull_request: https://github.com/python/cpython/pull/14321

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 12:12:48 2019
From: report at bugs.python.org (Inada Naoki)
Date: Sun, 23 Jun 2019 16:12:48 +0000
Subject: [issue37378] FatalError: initfsencoding python couldn't find codec
 Module not found: Encodings
In-Reply-To: <1561298259.69.0.399868439526.issue37378@roundup.psfhosted.org>
Message-ID: <1561306368.31.0.06253040448.issue37378@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

There may be a broken pip.exe in your computer.

Try `python -VV` to check what python are you using.
After that, try `python -m pip`, instead of `pip`.

----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37378>
_______________________________________

From report at bugs.python.org  Sun Jun 23 12:19:31 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 23 Jun 2019 16:19:31 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561306771.22.0.114166120547.issue35224@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 175b2e974586152c1d4cdea589b971d7ecad4d30 by Miss Islington (bot) in branch '3.8':
bpo-35224: Bump the pyc magic number by 1 instead of by 10 in last modification (GH-14320)
https://github.com/python/cpython/commit/175b2e974586152c1d4cdea589b971d7ecad4d30


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Sun Jun 23 14:42:24 2019
From: report at bugs.python.org (Ruslan Kuprieiev)
Date: Sun, 23 Jun 2019 18:42:24 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
Message-ID: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>


New submission from Ruslan Kuprieiev <kupruser at gmail.com>:

subprocess keeps the list of active processes in its `_active` list. Whenever you try to Popen a new process, it is immediately (like right in the first line of Popen.__init__ [1]) trying to go clean up the old ones. If one of the processes in that list is gone, then

```
(_WaitForSingleObject(self._handle, 0)
```

[2] will get `OSError: [WinError 6] The handle is invalid` and will prevent you from creating any new processes with Popen after that, because the line where that handle is removes from _active list is not reached. On *nix [3] _internal_poll will actually try-except waitpid and will catch OSError without re-raising it, so if the process is gone, it will simply report it as dead and successfully remove it from _active list. It seems like we should do the same thing on Windows and if we catch `The handle is invalid` error, just report that process as dead and remove it from _active list.


[1] https://github.com/python/cpython/blob/v3.8.0b1/Lib/subprocess.py#L715

[2] https://github.com/python/cpython/blob/v3.8.0b1/Lib/subprocess.py#L1310

[3] https://github.com/python/cpython/blob/v3.8.0b1/Lib/subprocess.py#L1710

----------
components: Windows
messages: 346332
nosy: Ruslan Kuprieiev, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: subprocess.Popen._cleanup() "The handle is invalid" error when some old process is gone
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 14:47:26 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 23 Jun 2019 18:47:26 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561315646.08.0.752655099265.issue37380@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +gregory.p.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:03:28 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 23 Jun 2019 19:03:28 +0000
Subject: [issue20181] Derby #12: Convert 50 sites to Argument Clinic across 4
 files
In-Reply-To: <1389140203.53.0.198441160626.issue20181@psf.upfronthosting.co.za>
Message-ID: <1561316608.74.0.26702042371.issue20181@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
pull_requests: +14146
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14326

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20181>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:04:59 2019
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 23 Jun 2019 19:04:59 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561316699.7.0.755025803002.issue37380@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

See issue 36067 for a related discussion. The _active list and _cleanup function are not required in Windows. When a process exits, it gets rundown to free its handle table and virtual memory. Only the kernel object remains, which is kept alive by pointer and handle references to it that can query information such as the exit status code. As soon as the last reference is closed, the Process object is automatically reaped. It doesn't have to be waited on.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:10:54 2019
From: report at bugs.python.org (finefoot)
Date: Sun, 23 Jun 2019 19:10:54 +0000
Subject: [issue30256] Adding a SyncManager Queue proxy to a SyncManager dict
 or Namespace proxy raises an exception
In-Reply-To: <1493812414.86.0.361870744934.issue30256@psf.upfronthosting.co.za>
Message-ID: <1561317054.92.0.275860413313.issue30256@roundup.psfhosted.org>


finefoot <jj-adad at web.de> added the comment:

This is still an issue: https://stackoverflow.com/questions/56716470/python-multiprocessing-nested-shared-objects-doesnt-work-with-queue

Is there a specific reason, why https://github.com/python/cpython/pull/4819 doesn't get reviewed?

----------
nosy: +finefoot

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30256>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:13:40 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 23 Jun 2019 19:13:40 +0000
Subject: [issue20181] Derby #12: Convert 50 sites to Argument Clinic across 4
 files
In-Reply-To: <1389140203.53.0.198441160626.issue20181@psf.upfronthosting.co.za>
Message-ID: <1561317220.87.0.392148216074.issue20181@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

PR 14326 converts Modules/readline.c.

As the parser module is slated for removal in 3.9 (according to PEP 594), Modules/parsermodule.c should not be converted.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20181>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:13:45 2019
From: report at bugs.python.org (Roundup Robot)
Date: Sun, 23 Jun 2019 19:13:45 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561317225.03.0.862274142544.issue37380@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14147
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14327

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:22:58 2019
From: report at bugs.python.org (nother)
Date: Sun, 23 Jun 2019 19:22:58 +0000
Subject: [issue37379] Provide triggering AttributeError exception to
 __getattr__ for reraising
In-Reply-To: <1561298384.82.0.239193690622.issue37379@roundup.psfhosted.org>
Message-ID: <1561317778.32.0.0133274415582.issue37379@roundup.psfhosted.org>


nother <christoph at out-world.com> added the comment:

Ah sorry, sure. Attached some examples hope they are not too artificially simple to still render real world scenarios.

The one loaded was just the test that a function called from within the except block inside another method can use raise keyword to reraise exception caught by caller.

----------
Added file: https://bugs.python.org/file48433/tes_attr1.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37379>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:33:46 2019
From: report at bugs.python.org (nother)
Date: Sun, 23 Jun 2019 19:33:46 +0000
Subject: [issue37379] Provide triggering AttributeError exception to
 __getattr__ for reraising
In-Reply-To: <1561298384.82.0.239193690622.issue37379@roundup.psfhosted.org>
Message-ID: <1561318426.37.0.898036615246.issue37379@roundup.psfhosted.org>


nother <christoph at out-world.com> added the comment:

The first two exampel should produce the same result not throwing any exception. The third example should as it does report that prop is not available for instance.

The fourth example should pass on the AttributeError raised for the not available attr2 instead of raising a new one stating the prop2 is not available form instance.

In all cases the change would allow __getattr__ instead of raising a new AttributeError exception reraise the one triggering the  __getattr__ call

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37379>
_______________________________________

From report at bugs.python.org  Sun Jun 23 15:46:35 2019
From: report at bugs.python.org (Ruslan Kuprieiev)
Date: Sun, 23 Jun 2019 19:46:35 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561319195.15.0.706375079921.issue37380@roundup.psfhosted.org>


Ruslan Kuprieiev <kupruser at gmail.com> added the comment:

Hi Eryk!

Thanks for a swift reply! So the current plan for fixing it is:

1) disable _cleanup, _active, and remove _internal_poll() for windows
2) ignore EBADF(OSError: [WinError 6] The handle is invalid) in terminate() and probably some other methods

Please let me know if I'm missing something. Also, is anyone working on this, or should I prepare a PR?

Thanks,
Ruslan

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 16:09:18 2019
From: report at bugs.python.org (Joannah Nanjekye)
Date: Sun, 23 Jun 2019 20:09:18 +0000
Subject: [issue8579] Add missing tests for FlushKey, LoadKey,
 and SaveKey in winreg
In-Reply-To: <1272650551.21.0.0191974450566.issue8579@psf.upfronthosting.co.za>
Message-ID: <1561320558.0.0.762799977254.issue8579@roundup.psfhosted.org>


Joannah Nanjekye <nanjekyejoannah at gmail.com> added the comment:

@Claudiu.Popa are you still interested in working on this, If so please open a pull request for review.

----------
nosy: +nanjekyejoannah

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue8579>
_______________________________________

From report at bugs.python.org  Sun Jun 23 16:11:33 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 23 Jun 2019 20:11:33 +0000
Subject: [issue37379] Provide triggering AttributeError exception to
 __getattr__ for reraising
In-Reply-To: <1561298384.82.0.239193690622.issue37379@roundup.psfhosted.org>
Message-ID: <1561320693.66.0.0556344635241.issue37379@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37379>
_______________________________________

From report at bugs.python.org  Sun Jun 23 16:53:50 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Sun, 23 Jun 2019 20:53:50 +0000
Subject: [issue37375] Fix a code style in dictobject.c
In-Reply-To: <1561284724.57.0.302008165127.issue37375@roundup.psfhosted.org>
Message-ID: <1561323230.48.0.901091588262.issue37375@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Sorry, but we usually do not accept pure cosmetic PRs.

----------
nosy: +serhiy.storchaka
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37375>
_______________________________________

From report at bugs.python.org  Sun Jun 23 17:08:19 2019
From: report at bugs.python.org (Mitar)
Date: Sun, 23 Jun 2019 21:08:19 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561324099.29.0.907341454007.issue37374@roundup.psfhosted.org>


Mitar <mmitar at gmail.com> added the comment:

FYI, this is exactly how ElementTree.tostring does it. So this would make ElementTree.tostring behave the same as minidom.

@dhilst: I do not think a parameter is needed here. This is completely compatible with HTML. It is just that currently an additional unnecessary escaping (for both XML in HTML context) is done.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sun Jun 23 17:08:50 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 23 Jun 2019 21:08:50 +0000
Subject: [issue37375] Fix a code style in dictobject.c
In-Reply-To: <1561284724.57.0.302008165127.issue37375@roundup.psfhosted.org>
Message-ID: <1561324130.35.0.473964582785.issue37375@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Thanks, got it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37375>
_______________________________________

From report at bugs.python.org  Sun Jun 23 17:24:26 2019
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 23 Jun 2019 21:24:26 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561325066.55.0.261532226812.issue37380@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> 1) disable _cleanup, _active, and remove _internal_poll() for windows

_active only gets appended to in __del__. We can skip the entire body of __del__. Also, calling _cleanup can be skipped in __init__.

_internal_poll is required for poll().

2) ignore EBADF(OSError: [WinError 6] The handle is invalid) in terminate() and probably some other methods

ERROR_INVALID_HANDLE should not be ignored. 

terminate() is doing the right thing by not masking ERROR_INVALID_HANDLE. The only concern is the case where our handle has been closed elsewhere (not by subprocess) and the handle value was subsequently reused as a handle for another process to which we have terminate access. This is a bad handle at a logical, application level, but it's valid and accessible for TerminateProcess. It was suggested to initially get the pid and process startup time in order to validate the call, but Alexey Izbyshev is right that it's not worth complicating the code in subprocess to address an uncommon bug in particular application or library code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sun Jun 23 17:42:26 2019
From: report at bugs.python.org (Cooper Lees)
Date: Sun, 23 Jun 2019 21:42:26 +0000
Subject: [issue34556] Add --upgrade to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561326146.63.0.920714712963.issue34556@roundup.psfhosted.org>


Cooper Lees <me at cooperlees.com> added the comment:

I believe so - Would love it could be included with latest 3.8 or is there no chance of that?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Sun Jun 23 18:35:46 2019
From: report at bugs.python.org (William D. Jones)
Date: Sun, 23 Jun 2019 22:35:46 +0000
Subject: [issue37381] Script using ProactorEventLoop does not exit cleanly on
 Windows with multiple subprocesses
Message-ID: <1561329346.62.0.272283503836.issue37381@roundup.psfhosted.org>


New submission from William D. Jones <wjones at wdj-consulting.com>:

On Windows 7, when using ProactorEventLoop, when asyncio.subprocess.terminate is called on the last subprocess when multiple subprocesses are spawned*, the last subprocess will never exit, and the Python interpreter will never exit. 

Spawning an instance of "TASKKILL /F" to kill the subprocess, and then awaiting asyncio.subprocess.wait is a workaround. Since both "TASKKILL /F" and asyncio.subprocess.terminate ultimately call TerminateProcess, I would expect the same behavior using both (without the need to wait for the subprocess to actually die).

I have confirmed this behavior on Python 3.5, 3.6, and 3.7 on both MSVC and MinGW Python (although I most frequently use the latter).

Zip file is too large, so I have a GH repo (ready to run) demonstrating this issue: https://github.com/cr1901/proactor

An example run looks like the following:$ python3 proactor.py
Infinite Loop, Iteration 0
Finite Loop, Iteration 0
Infinite Loop, Iteration 1
Finite Loop, Iteration 1
Infinite Loop, Iteration 2
Finite Loop, Iteration 2
Finite Loop, Iteration 3
Infinite Loop, Iteration 3
Infinite Loop, Iteration 4
Task poller finished.

The interpreter hangs after the "Task poller finished." line, which makes me believe that the Python interpreter is trying and failing to cleanup resources for some reason (IOCP never completes?).

*Each subprocess is associated with its own coroutine to handle standard output.

----------
components: Windows, asyncio
messages: 346345
nosy: asvetlov, cr1901, paul.moore, steve.dower, tim.golden, yselivanov, zach.ware
priority: normal
severity: normal
status: open
title: Script using ProactorEventLoop does not exit cleanly on Windows with multiple subprocesses
type: behavior
versions: Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37381>
_______________________________________

From report at bugs.python.org  Sun Jun 23 18:59:00 2019
From: report at bugs.python.org (William D. Jones)
Date: Sun, 23 Jun 2019 22:59:00 +0000
Subject: [issue37381] Script using ProactorEventLoop does not exit cleanly on
 Windows with multiple subprocesses
In-Reply-To: <1561329346.62.0.272283503836.issue37381@roundup.psfhosted.org>
Message-ID: <1561330740.88.0.251088897426.issue37381@roundup.psfhosted.org>


William D. Jones <wjones at wdj-consulting.com> added the comment:

Update: It turns out multiple spawned subprocesses are NOT required. If I replace "(short_fut, _) = await spawn()" with "short_fut = asyncio.ensure_future(asyncio.sleep(4))", the hang still occurs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37381>
_______________________________________

From report at bugs.python.org  Sun Jun 23 19:14:59 2019
From: report at bugs.python.org (Ben Darnell)
Date: Sun, 23 Jun 2019 23:14:59 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561331699.75.0.719838579157.issue37373@roundup.psfhosted.org>


Ben Darnell <ben.darnell at gmail.com> added the comment:

Yeah, it's definitely a hack. The argument for it, at best, is "practicality beats purity". The solution is two simple lines, but those lines need to be repeated in every project that depends on Tornado and cares about Windows, now or in the future. How many projects have to be affected to justify a hack like this? I'm not sure, but without this hack the add_reader methods, and by extension Tornado, will remain a compatibility trap.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sun Jun 23 19:32:53 2019
From: report at bugs.python.org (Yury Selivanov)
Date: Sun, 23 Jun 2019 23:32:53 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561332773.0.0.427578129724.issue37373@roundup.psfhosted.org>


Yury Selivanov <yselivanov at gmail.com> added the comment:

+1 to what Ben said.

Andrew,

> The proposal looks like a very dirty hack and smells as it is.

I wonder why are you feeling like that about this idea.  I don't think this is a hack at all.  There's no native API, so we're forced to use another approach.

> There is no very strong reason to apply it.

I think there's such a reason.  asyncio has a well defined API that people use and create programs dependent on it.  And then people learn that the API isn't really supported on Windows with one loop, or when it is supported, other APIs aren't.  They are then forced to either not support Windows or to rewrute their programs.  The situation further complicates if they are using third-party code.

This is a very unfortunate and weird position we put our users into.  So this indeed is a perfect example where "practicality beats purity" principle should be invoked.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Sun Jun 23 20:07:25 2019
From: report at bugs.python.org (Mark turner)
Date: Mon, 24 Jun 2019 00:07:25 +0000
Subject: [issue36661] Missing dataclass decorator import in dataclasses module
 docs
In-Reply-To: <1555616208.44.0.536731608649.issue36661@roundup.psfhosted.org>
Message-ID: <1561334845.35.0.979195736346.issue36661@roundup.psfhosted.org>


Mark turner <mturner865 at gmail.com> added the comment:

I tried a couple of the examples from the docs and found the setup to be a little confusing
amd inconsistent. For example, the decorator line "@decorator" requires you to use

from dataclasses import dataclass

while the example line "mylist: List[int] = field(default_factory=list)" requires you to use these

import dataclasses
import typing

and must be modified to
mylist: typing.List[int] = dataclasses.field(default_factory=list)

The decorator line could be modified to be
@dataclasses.dataclass
and the from/import line could be eliminated. But that seems awkward.

So, what is are best practices for handling the imports needed by these examples?
And should the examples be updated to be consistent with a best practice set of imports?
Or am I not understanding how this code works?

Also, the intro section states "If any of the added methods already exist on the class, a TypeError will be raised."
This statement seems incorrect and contrdicts the parameter documentation that follows.

----------
nosy: +mturner865

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36661>
_______________________________________

From report at bugs.python.org  Sun Jun 23 20:50:12 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Mon, 24 Jun 2019 00:50:12 +0000
Subject: [issue37284] Not obvious that new required attrs of
 sys.implementation must have a PEP.
In-Reply-To: <1560535361.35.0.573554677552.issue37284@roundup.psfhosted.org>
Message-ID: <1561337412.29.0.986557316224.issue37284@roundup.psfhosted.org>


Change by Giovanni Cappellotto <potomak84 at gmail.com>:


----------
keywords: +patch
pull_requests: +14148
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14328

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37284>
_______________________________________

From report at bugs.python.org  Sun Jun 23 21:07:24 2019
From: report at bugs.python.org (William D. Jones)
Date: Mon, 24 Jun 2019 01:07:24 +0000
Subject: [issue37381] Script using ProactorEventLoop does not exit cleanly
 when subprocesses are spawned.
In-Reply-To: <1561329346.62.0.272283503836.issue37381@roundup.psfhosted.org>
Message-ID: <1561338444.32.0.16870373639.issue37381@roundup.psfhosted.org>


Change by William D. Jones <wjones at wdj-consulting.com>:


----------
title: Script using ProactorEventLoop does not exit cleanly on Windows with multiple subprocesses -> Script using ProactorEventLoop does not exit cleanly when subprocesses are spawned.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37381>
_______________________________________

From report at bugs.python.org  Sun Jun 23 21:42:18 2019
From: report at bugs.python.org (Daniel Hilst Selli)
Date: Mon, 24 Jun 2019 01:42:18 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561340538.73.0.958747369695.issue37374@roundup.psfhosted.org>


Daniel Hilst Selli <danielhilst at gmail.com> added the comment:

This changes behavior in an irreversible way. A parameter would make it reversible.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sun Jun 23 23:30:30 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 24 Jun 2019 03:30:30 +0000
Subject: [issue37348] Optimize PyUnicode_FromString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561347030.88.0.801194057799.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 770847a7db33b3d4c451b42372b6942687aa6121 by Inada Naoki in branch 'master':
bpo-37348: optimize decoding ASCII string (GH-14283)
https://github.com/python/cpython/commit/770847a7db33b3d4c451b42372b6942687aa6121


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Sun Jun 23 23:30:43 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 24 Jun 2019 03:30:43 +0000
Subject: [issue37348] Optimize PyUnicode_FromString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561347043.58.0.251183605416.issue37348@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Mon Jun 24 01:10:21 2019
From: report at bugs.python.org (Lokesh Chandak)
Date: Mon, 24 Jun 2019 05:10:21 +0000
Subject: [issue37378] FatalError: initfsencoding python couldn't find codec
 Module not found: Encodings
In-Reply-To: <1561298259.69.0.399868439526.issue37378@roundup.psfhosted.org>
Message-ID: <1561353021.91.0.877796548463.issue37378@roundup.psfhosted.org>


Lokesh Chandak <lokeshchandak2 at gmail.com> added the comment:

Thank Inada Naoki, I can confirm that python -m pip works as normal and I can resume my work.
However pip is still causing the errors, and not just pip, it was also the same for pip3 and pip3.7 as well as easy_install. I guess I will wait for future updates to solve this.
(Also, just one question: how could python -m pip work but not pip? What are the differences in them?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37378>
_______________________________________

From report at bugs.python.org  Mon Jun 24 01:19:22 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 24 Jun 2019 05:19:22 +0000
Subject: [issue37378] FatalError: initfsencoding python couldn't find codec
 Module not found: Encodings
In-Reply-To: <1561298259.69.0.399868439526.issue37378@roundup.psfhosted.org>
Message-ID: <1561353562.11.0.420985453329.issue37378@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

You can use `where pip` to find which pip is used.
And you can check `PATH` environment variable and remove unused PATHs.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37378>
_______________________________________

From report at bugs.python.org  Mon Jun 24 01:34:19 2019
From: report at bugs.python.org (Prateek Nayak)
Date: Mon, 24 Jun 2019 05:34:19 +0000
Subject: [issue36661] Missing dataclass decorator import in dataclasses module
 docs
In-Reply-To: <1555616208.44.0.536731608649.issue36661@roundup.psfhosted.org>
Message-ID: <1561354459.01.0.0552459135982.issue36661@roundup.psfhosted.org>


Change by Prateek Nayak <lelouch.cpp at gmail.com>:


----------
keywords: +patch
pull_requests: +14149
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14329

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36661>
_______________________________________

From report at bugs.python.org  Mon Jun 24 02:13:28 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Mon, 24 Jun 2019 06:13:28 +0000
Subject: [issue37348] Optimize PyUnicode_FromString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561356808.52.0.384407949014.issue37348@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Could you please measure the performance for long strings (1000, 10000 and 100000 characters): a long ASCII string and a long ASCII string ending with a non-ASCII character?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Mon Jun 24 02:59:01 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Mon, 24 Jun 2019 06:59:01 +0000
Subject: [issue34556] Add --upgrade to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561359541.31.0.323761345217.issue34556@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> included with latest 3.8 or is there no chance of that?

Unfortunately not, I think, as it missed the cut for 3.8beta1. Never mind! Thanks for your contribution.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Mon Jun 24 03:08:11 2019
From: report at bugs.python.org (Inada Naoki)
Date: Mon, 24 Jun 2019 07:08:11 +0000
Subject: [issue37348] Optimize PyUnicode_FromString for short ASCII strings
In-Reply-To: <1561030857.7.0.211621244107.issue37348@roundup.psfhosted.org>
Message-ID: <1561360091.04.0.757915641822.issue37348@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

This optimization is only for short strings.  There is no significant difference for long and non-ASCII strings.

```
# 1000 ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"f"*1000' -- 'b.decode()'
python-master: ..................... 196 ns +- 1 ns
python: ..................... 185 ns +- 1 ns

Mean +- std dev: [python-master] 196 ns +- 1 ns -> [python] 185 ns +- 1 ns: 1.06x faster (-6%)

# 10000 ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"f"*10000' -- 'b.decode()'
python-master: ..................... 671 ns +- 4 ns
python: ..................... 662 ns +- 1 ns

Mean +- std dev: [python-master] 671 ns +- 4 ns -> [python] 662 ns +- 1 ns: 1.01x faster (-1%)

# 100000 ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"f"*100000' -- 'b.decode()'
python-master: ..................... 5.86 us +- 0.03 us
python: ..................... 5.85 us +- 0.02 us

Mean +- std dev: [python-master] 5.86 us +- 0.03 us -> [python] 5.85 us +- 0.02 us: 1.00x faster (-0%)

# 1 non-ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b="?".encode()' -- 'b.decode()'
python-master: ..................... 138 ns +- 2 ns
python: ..................... 136 ns +- 2 ns

Mean +- std dev: [python-master] 138 ns +- 2 ns -> [python] 136 ns +- 2 ns: 1.02x faster (-2%)

# 1000 ASCII + 1 non-ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"x"*1000 + "?".encode()' -- 'b.decode()'
python-master: ..................... 361 ns +- 9 ns
python: ..................... 360 ns +- 5 ns

Mean +- std dev: [python-master] 361 ns +- 9 ns -> [python] 360 ns +- 5 ns: 1.00x faster (-0%)
Not significant!

# 10000 ASCII + 1 non-ASCII
$ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"x"*10000 + "?".encode()' -- 'b.decode()'
python-master: ..................... 2.83 us +- 0.02 us
python: ..................... 2.83 us +- 0.03 us

Mean +- std dev: [python-master] 2.83 us +- 0.02 us -> [python] 2.83 us +- 0.03 us: 1.00x slower (+0%)
Not significant!
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37348>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:24:38 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 24 Jun 2019 08:24:38 +0000
Subject: [issue37097] python_is_optimized() false negatives
In-Reply-To: <1559202228.98.0.967762980868.issue37097@roundup.psfhosted.org>
Message-ID: <1561364678.64.0.816048248385.issue37097@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Never mind, I probably tested wrong here.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37097>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:31:13 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 24 Jun 2019 08:31:13 +0000
Subject: [issue37382] Improve conditional check for test_gdb
Message-ID: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>


New submission from Jeroen Demeyer <J.Demeyer at UGent.be>:

Many tests in test_gdb are not run if python_is_optimized() is true. However, it's not entirely clear why we have this condition. For example, on my system, with the default CPython configuration, Python *is* optimized but still all gdb tests pass if I artificially enable them.

Maybe we need debug symbols, but the existence of debug symbols and optimization are orthogonal.

----------
components: Tests
messages: 346358
nosy: benjamin.peterson, jdemeyer
priority: normal
severity: normal
status: open
title: Improve conditional check for test_gdb
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:34:36 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 24 Jun 2019 08:34:36 +0000
Subject: [issue20177] Derby #8: Convert 28 sites to Argument Clinic across 2
 files
In-Reply-To: <1389138574.32.0.892814928986.issue20177@psf.upfronthosting.co.za>
Message-ID: <1561365276.55.0.413930142375.issue20177@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14150
pull_request: https://github.com/python/cpython/pull/14330

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20177>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:52:57 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 24 Jun 2019 08:52:57 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561366377.0.0.195206509618.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

The tests FAIL when CPython is compiled with "-O0 -g0" (without optimizations, without debug info) but tests PASS when compiled with "-O3 -g", showing that the check for "-g" is the right one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:53:35 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Mon, 24 Jun 2019 08:53:35 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561366415.72.0.700074617569.issue37382@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +14151
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14331

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Mon Jun 24 04:57:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 08:57:47 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561366667.72.0.885825228603.issue37359@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14152
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14332

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 05:42:43 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 09:42:43 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561369363.81.0.996387859725.issue37373@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I don't like to have not required parts like thread pool, time handlers, and the exception handler executed in the auxiliary thread.

What's about an alternative proposal: embed into ProactorEventLoop not entire SelectorEventLoop but selectors.SelectSelector only? We will have a little more code but the code is very clear and self-contained.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Mon Jun 24 05:59:01 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 09:59:01 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561370341.53.0.839086537068.issue37345@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5 by Miss Islington (bot) (Gabe Appleton) in branch 'master':
bpo-37345: Add formal UDPLITE support (GH-14258)
https://github.com/python/cpython/commit/2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Mon Jun 24 05:59:46 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 09:59:46 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561370386.09.0.36300778988.issue37345@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:03:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:03:08 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561370588.73.0.680260024457.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 47fbc4e45b35b3111e2d947a66490a43ac21d363 by Victor Stinner in branch 'master':
bpo-37359: Add --cleanup option to python3 -m test (GH-14332)
https://github.com/python/cpython/commit/47fbc4e45b35b3111e2d947a66490a43ac21d363


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 05:59:01 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 09:59:01 +0000
Subject: [issue37345] Add formal support for UDPLITE protocol
In-Reply-To: <1561012547.39.0.170090489381.issue37345@roundup.psfhosted.org>
Message-ID: <1561370341.53.0.839086537068.issue37345@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5 by Miss Islington (bot) (Gabe Appleton) in branch 'master':
bpo-37345: Add formal UDPLITE support (GH-14258)
https://github.com/python/cpython/commit/2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37345>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:15:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:15:57 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561371357.31.0.657722977851.issue37359@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14153
pull_request: https://github.com/python/cpython/pull/14333

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:17:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:17:18 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561371438.32.0.742362722067.issue37359@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14154
pull_request: https://github.com/python/cpython/pull/14334

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:17:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:17:51 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561371471.73.0.149387865161.issue37359@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14155
pull_request: https://github.com/python/cpython/pull/14335

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:24:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:24:05 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561371845.97.0.350958716905.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I created https://github.com/python/buildmaster-config/pull/98 to cleanup tests in buildbots.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:30:16 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 24 Jun 2019 10:30:16 +0000
Subject: [issue37383] call count in not registered in AsyncMock till the
 coroutine is awaited
Message-ID: <1561372216.92.0.906837687381.issue37383@roundup.psfhosted.org>


New submission from Karthikeyan Singaravelan <tir.karthi at gmail.com>:

I noticed this while working on https://github.com/aio-libs/aiosmtpd/issues/167 where an async function was mocked that now returns an AsyncMock instead of MagicMock. The tests seem to look for call_args, mock_calls etc in the synchronous API without awaiting on the AsyncMock. In AsyncMock __call__ is an async function [0] and hence in the below example mock_calls is not recorded unless the coroutine is awaited. Is this intended since super()._mock_call [1] is inside the async function _mock_call through which the synchronous API is recorded. It's slightly confusing in my opinion while trying to use synchronous helpers before calling await. 

./python.exe -m asyncio
asyncio REPL 3.9.0a0 (heads/master:770847a7db, Jun 24 2019, 10:36:45)
[Clang 7.0.2 (clang-700.1.81)] on darwin
Use "await" directly instead of "asyncio.run()".
Type "help", "copyright", "credits" or "license" for more information.
>>> import asyncio
>>> from unittest.mock import AsyncMock
>>> mock = AsyncMock()
>>> coro = mock(1, 2)
>>> mock.mock_calls
[]
>>> await coro # Await executes _mock_call now and hence mock_calls are registered
<AsyncMock name='mock()' id='4332060752'>
>>> mock.mock_calls
[call(1, 2)]

[0] https://github.com/python/cpython/blob/47fbc4e45b35b3111e2d947a66490a43ac21d363/Lib/unittest/mock.py#L2081
[1] https://github.com/python/cpython/blob/47fbc4e45b35b3111e2d947a66490a43ac21d363/Lib/unittest/mock.py#L2083

----------
components: Library (Lib)
messages: 346364
nosy: cjw296, lisroach, mariocj89, michael.foord, xtreak
priority: normal
severity: normal
status: open
title: call count in not registered in AsyncMock till the coroutine is awaited
type: behavior
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37383>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:38:40 2019
From: report at bugs.python.org (Ben Brown)
Date: Mon, 24 Jun 2019 10:38:40 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1561372720.77.0.769209596338.issue37226@roundup.psfhosted.org>


Ben Brown <ben.brown at envisionvirginracing.com> added the comment:

Hi is there any update on this issue, were you able to replicate the error with the minimal example I provided or is there any additional information I can provide.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:41:10 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 24 Jun 2019 10:41:10 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1561372870.37.0.226517242976.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset a8b27e623d75377aabe50df27e97cab4e81a174a by Petr Viktorin (Jeroen Demeyer) in branch 'master':
bpo-36974: inherit tp_vectorcall_offset unconditionally (GH-13858)
https://github.com/python/cpython/commit/a8b27e623d75377aabe50df27e97cab4e81a174a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:47:34 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 24 Jun 2019 10:47:34 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561373254.99.0.0502679861412.issue37363@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'll add hooks to ssl module for wrap_socket and wrap_bio.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:48:13 2019
From: report at bugs.python.org (Eryk)
Date: Mon, 24 Jun 2019 10:48:13 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
Message-ID: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>


New submission from Eryk <eryklok at gmail.com>:

So I am trying to compile python 3.7.3 on debian 9.9, got all the libraries installed and previously I was getting an uuid module error which was then fixed by finding this 'tweak':

--- Modules/_uuidmodule.c.orig
+++ Modules/_uuidmodule.c
@@ -3,8 +3,7 @@
 #include "Python.h"
 #ifdef HAVE_UUID_UUID_H
 #include <uuid/uuid.h>
-#endif
-#ifdef HAVE_UUID_H
+#elif defined(HAVE_UUID_H)
 #include <uuid.h>
 #endif

however now I am puzzled as I am getting a different error and have no idea how to go about it:

gcc -pthread -fPIC -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction -DHAVE_NCURSESW=1 -I/usr/include/ncursesw -I./Include -I. -I/usr/include/x86_64-linux-gnu -I/usr/local/include -I/home/anubis/Python-3.7.3/Include -I/home/anubis/Python-3.7.3 -c /home/anubis/Python-3.7.3/Modules/_cursesmodule.c -o build/temp.linux-x86_64-3.7/home/anubis/Python-3.7.3/Modules/_cursesmodule.o

/home/anubis/Python-3.7.3/Modules/_cursesmodule.c: In function ?PyCurses_ConvertToString.isra.0?:
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCurses_ConvertToString.isra.0? does not match its profile data (counter ?arcs?) [-Werror=coverage-mismatch]
 }
 ^
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCurses_ConvertToString.isra.0? does not match its profile data (counter ?time_profiler?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c: In function ?PyCursesWindow_InsNStr?:
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsNStr? does not match its profile data (counter ?arcs?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsNStr? does not match its profile data (counter ?indirect_call?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsNStr? does not match its profile data (counter ?time_profiler?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c: In function ?PyCursesWindow_InsStr?:
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsStr? does not match its profile data (counter ?arcs?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsStr? does not match its profile data (counter ?indirect_call?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_InsStr? does not match its profile data (counter ?time_profiler?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c: In function ?PyCursesWindow_AddNStr?:
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddNStr? does not match its profile data (counter ?arcs?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddNStr? does not match its profile data (counter ?indirect_call?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddNStr? does not match its profile data (counter ?time_profiler?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c: In function ?PyCursesWindow_AddStr?:
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddStr? does not match its profile data (counter ?arcs?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddStr? does not match its profile data (counter ?indirect_call?) [-Werror=coverage-mismatch]
/home/anubis/Python-3.7.3/Modules/_cursesmodule.c:3500:1: error: the control flow of function ?PyCursesWindow_AddStr? does not match its profile data (counter ?time_profiler?) [-Werror=coverage-mismatch]

Failed to build these modules:
_curses 

Any help would be greatly appreciated as I am keen to start learning and never thought getting the newest version could be so complicated

----------
components: Installation
messages: 346368
nosy: Eryk
priority: normal
severity: normal
status: open
title: Compiling Python 3.7.3 from source and getting all sorts of errors on Debian?
type: compile error
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:50:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:50:53 +0000
Subject: [issue37373] Configuration of windows event loop for libraries
In-Reply-To: <1561228405.39.0.674272094682.issue37373@roundup.psfhosted.org>
Message-ID: <1561373453.51.0.252049655427.issue37373@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ben:
> Concretely, this is a concern for Tornado (which requires add_reader()) and applications in the scientific python community (including Jupyter) which depend on it.

If you need add_reader/add_writer in Python 3.8, you can switch the default event loop to selector at the beginning of your application:

if sys.platform == 'win32':
  asyncio.set_event_loop_policy(asyncio.WindowsSelectorEventLoopPolicy())


Yury:
> If there's no native API for that, I guess we can spawn a thread with a 'select()' call to emulate this API?

There is no native API because IOCP design is to run an asynchronous read/write and then wait for  its completion. Unix select() has the opposite design: check if a file descriptor is read for read/write.

Reimplementing add_reader/add_writer using a single select() call in a thread sounds like a good idea, but we have to make sure that it can be stopped whenever using a dedicated "self-pipe" (to awake the blocked select(), so loop.close() can stop this thread.

See attached proof-of-concept: selector_thread.py: run a selector in a separated thread which pass pack events to the loop using call_soon().

I would prefer to use a single selector to better scale with the number of FD.

Note: On Windows, select() only supports sockets.

Note: select.select() may be extended to support more than 512 sockets on Windows, see bpo-28708 :-)


Yury:
> Another question: if we fix this, would you allow this to go in beta2/3?  Strictly speaking it's going to be a new functionality.

It's a new feature, so it can wait for Python 3.9 :-)

I don't see any regression here, as soon as you can opt-in for SelectorEventLoop.

----------
Added file: https://bugs.python.org/file48434/selector_thread.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37373>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:51:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:51:35 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561373495.61.0.390261158636.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 20ad3310d4f3dec1318a85e66963581501eeb634 by Victor Stinner in branch '3.7':
bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14335)
https://github.com/python/cpython/commit/20ad3310d4f3dec1318a85e66963581501eeb634


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 06:51:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 10:51:50 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561373510.77.0.12562985661.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 2ec4545ebe49c62fdc60b0cf627e3aabe1bca037 by Victor Stinner in branch '3.8':
bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14334)
https://github.com/python/cpython/commit/2ec4545ebe49c62fdc60b0cf627e3aabe1bca037


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:02:11 2019
From: report at bugs.python.org (Christian Heimes)
Date: Mon, 24 Jun 2019 11:02:11 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561374131.97.0.133141855025.issue37384@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

Could you please file separate issues for each problem? The curses and uuid issues are probably unrelated.

The curses issue seems to be caused by a problem with C code coverage profiling. Are you trying to build Python with PGO or profiling?

----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:04:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:04:54 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561374294.5.0.821875453715.issue37359@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14156
pull_request: https://github.com/python/cpython/pull/14336

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:16:09 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Mon, 24 Jun 2019 11:16:09 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561374969.22.0.420163123411.issue37250@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:

1. If sdist consumers will need to regenerate an sdist?

They would need to compile from the source, e.g. clone from Git and make an sdist (or install) from that.

2. How many sdist consumers will likely be impacted?

I don't know. Depends on how fast people migrate to Python 3.8.

3. If impacted, how difficult would the regeneration be for a scientist who is moderately comfortable with compilation?

See (1.)

4. Is there any guidance or information that can be given to sdist consumers?

"Raise the issue with the sdist maintainers" is probably their best bet.

---

Realistically, I expect those people to stay on Python 3.7- until their dependencies are updated to (and also tested with!) 3.8.

I've seen anecdotal evidence of this hitting people who want to use real-world projects to benchmark Python 3.8+: https://mail.python.org/archives/list/python-dev at python.org/message/TF2JI7G5ZMCGUMM3AWNSCQDYVFNRPMQ4/

If we "stop discussing and just [Apply PR 14193]", people wen't be blocked from trying out 3.8, even if sdist maintainers don't care about 3.8 yet.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:16:12 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Mon, 24 Jun 2019 11:16:12 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561374972.75.0.337957072654.issue37347@roundup.psfhosted.org>


Aleksandr Balezin <gescheit12 at gmail.com> added the comment:

At my point of view, dererencing from sqlite destructor has next flaws:
- relying on external library which can has bugs
- using different routine for reference-counting(complicates code)
- loosing support for old sqlite version

Of cause, if it's necessary to use sqlite3_create_function_v2, I'm ready to make appropriate changes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:19:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:19:51 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561375191.56.0.101420386177.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 9bbf4d7083a819cbcee2a6cd3df2802d4c50f734 by Victor Stinner in branch 'master':
bpo-37359: Fix regrtest --cleanup (GH-14336)
https://github.com/python/cpython/commit/9bbf4d7083a819cbcee2a6cd3df2802d4c50f734


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:19:59 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:19:59 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561375199.47.0.691364546445.issue37359@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14157
pull_request: https://github.com/python/cpython/pull/14337

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:20:09 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:20:09 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561375209.31.0.651160747986.issue37359@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14158
pull_request: https://github.com/python/cpython/pull/14338

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:21:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:21:21 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561375281.72.0.573160805749.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 9d55bf440cd0b8b06509318d7676c0744147c5b2 by Victor Stinner in branch '2.7':
bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14333)
https://github.com/python/cpython/commit/9d55bf440cd0b8b06509318d7676c0744147c5b2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:23:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:23:49 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561375429.63.0.730331233014.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I deployed the new buildbot configuration. New builds should run "make cleanup" (Unix) or "python -m test --cleanup" (Windows) on Python 2.7, 3.7, 3.8 and master, but not on custom branches.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:28:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:28:39 +0000
Subject: [issue37385] test_multiprocessing fails on AMD64 FreeBSD CURRENT
 Shared 2.7
Message-ID: <1561375719.2.0.947159095259.issue37385@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

AMD64 FreeBSD CURRENT Shared 2.7:
https://buildbot.python.org/all/#/builders/169/builds/146

0:02:22 load avg: 3.64 [119/404/1] test_multiprocessing failed
Process Process-16:
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1797, in _writefd
    fd = reduction.recv_handle(conn)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/reduction.py", line 83, in recv_handle
    return _multiprocessing.recvfd(conn.fileno())
RuntimeError: No file descriptor received
Process Process-17:
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1797, in _writefd
    fd = reduction.recv_handle(conn)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/reduction.py", line 83, in recv_handle
    return _multiprocessing.recvfd(conn.fileno())
RuntimeError: No file descriptor received
test test_multiprocessing failed -- multiple errors occurred; run in verbose mode for details

...

test_duplex_false (test.test_multiprocessing.WithProcessesTestConnection) ... ok
Process Process-16:
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1797, in _writefd
    fd = reduction.recv_handle(conn)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/reduction.py", line 83, in recv_handle
    return _multiprocessing.recvfd(conn.fileno())
RuntimeError: No file descriptor received
test_fd_transfer (test.test_multiprocessing.WithProcessesTestConnection) ... FAIL
Process Process-17:
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 267, in _bootstrap
    self.run()
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/process.py", line 114, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1797, in _writefd
    fd = reduction.recv_handle(conn)
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/multiprocessing/reduction.py", line 83, in recv_handle
    return _multiprocessing.recvfd(conn.fileno())
RuntimeError: No file descriptor received
test_large_fd_transfer (test.test_multiprocessing.WithProcessesTestConnection) ... FAIL

======================================================================
FAIL: test_fd_transfer (test.test_multiprocessing.WithProcessesTestConnection)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1819, in test_fd_transfer
    self.assertEqual(f.read(), b"foo")
AssertionError: '' != 'foo'

======================================================================
FAIL: test_large_fd_transfer (test.test_multiprocessing.WithProcessesTestConnection)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/2.7.koobs-freebsd-current/build/Lib/test/test_multiprocessing.py", line 1851, in test_large_fd_transfer
    self.assertEqual(f.read(), b"bar")
AssertionError: '' != 'bar'

----------------------------------------------------------------------

----------
components: Tests
messages: 346378
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_multiprocessing fails on AMD64 FreeBSD CURRENT Shared 2.7
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37385>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:29:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:29:27 +0000
Subject: [issue28724] Add method send_io, recv_io to the socket module.
In-Reply-To: <1479395133.65.0.0720889900419.issue28724@psf.upfronthosting.co.za>
Message-ID: <1561375767.63.0.0837070234808.issue28724@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-37385: "test_multiprocessing fails on AMD64 FreeBSD CURRENT Shared 2.7".

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28724>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:29:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:29:49 +0000
Subject: [issue37385] test_multiprocessing fails on AMD64 FreeBSD CURRENT
 Shared 2.7
In-Reply-To: <1561375719.2.0.947159095259.issue37385@roundup.psfhosted.org>
Message-ID: <1561375789.85.0.521517053175.issue37385@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-28724: Add method send_io, recv_io to the socket module.

----------
nosy: +nanjekyejoannah, pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37385>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:31:26 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:31:26 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1561375886.47.0.0865686937188.issue37124@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14159
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14339

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:33:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:33:38 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1561376018.43.0.828522297783.issue37124@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14160
pull_request: https://github.com/python/cpython/pull/14340

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:36:30 2019
From: report at bugs.python.org (Guido Imperiale)
Date: Mon, 24 Jun 2019 11:36:30 +0000
Subject: [issue36456] task.cancel unbound recursion
In-Reply-To: <1553741574.55.0.426835875653.issue36456@roundup.psfhosted.org>
Message-ID: <1561376190.38.0.90190028813.issue36456@roundup.psfhosted.org>


Change by Guido Imperiale <crusaderky at gmail.com>:


----------
nosy: +crusaderky

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36456>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:37:58 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:37:58 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561376278.17.0.212552841394.issue37359@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 366dac99c0c0c416a37874140696f59178db4e43 by Miss Islington (bot) in branch '3.8':
bpo-37359: Fix regrtest --cleanup (GH-14336)
https://github.com/python/cpython/commit/366dac99c0c0c416a37874140696f59178db4e43


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:43:19 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:43:19 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561376599.93.0.212538232164.issue37359@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5779898a1f2e959d4064c34ab3c655f785795322 by Miss Islington (bot) in branch '3.7':
bpo-37359: Fix regrtest --cleanup (GH-14336)
https://github.com/python/cpython/commit/5779898a1f2e959d4064c34ab3c655f785795322


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:44:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:44:29 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
Message-ID: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The fix seems to be simple: skip the test if write() fails with errno.ENOSPC: "OSError: [Errno 28] No space left on device".


AMD64 Windows7 SP1 3.x:
https://buildbot.python.org/all/#/builders/40/builds/2628

======================================================================
ERROR: test_large_file_ops (test.test_io.CIOTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_io.py", line 608, in test_large_file_ops
    self.large_file_ops(f)
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_io.py", line 389, in large_file_ops
    self.assertEqual(f.write(b"xxx"), 3)
OSError: [Errno 28] No space left on device

======================================================================
ERROR: test_large_file_ops (test.test_io.PyIOTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_io.py", line 608, in test_large_file_ops
    self.large_file_ops(f)
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_io.py", line 389, in large_file_ops
    self.assertEqual(f.write(b"xxx"), 3)
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\_pyio.py", line 1698, in write
    return os.write(self._fd, b)
OSError: [Errno 28] No space left on device


No idea if the following test_asyncio failure is related.

======================================================================
ERROR: test_huge_content (test.test_asyncio.test_sock_lowlevel.SelectEventLoopTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 170, in test_huge_content
    self.loop.run_until_complete(
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\asyncio\base_events.py", line 608, in run_until_complete
    return future.result()
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\test\test_asyncio\test_sock_lowlevel.py", line 157, in _basetest_huge_content
    data = await self.loop.sock_recv(sock, DATA_SIZE)
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\asyncio\selector_events.py", line 362, in sock_recv
    return await fut
  File "C:\buildbot.python.org\3.x.kloth-win64\build\lib\asyncio\selector_events.py", line 373, in _sock_recv
    data = sock.recv(n)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host

----------
keywords: easy
messages: 346383
nosy: vstinner
priority: normal
severity: normal
status: open
title: [EASY] test_io: test_large_file_ops() failed on AMD64 Windows7 SP1 3.x with: [Errno 28] No space left on device

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:45:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:45:11 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561376711.69.0.456289883647.issue37386@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
components: +Tests
versions: +Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:52:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 11:52:20 +0000
Subject: [issue33694] test_asyncio: test_start_tls_server_1() fails on Python
 on x86 Windows7 3.7 and 3.x
In-Reply-To: <1527679178.26.0.682650639539.issue33694@psf.upfronthosting.co.za>
Message-ID: <1561377140.16.0.920549580597.issue33694@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14161
pull_request: https://github.com/python/cpython/pull/14336

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33694>
_______________________________________

From report at bugs.python.org  Mon Jun 24 07:56:21 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 11:56:21 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1561377381.87.0.143877592597.issue37124@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c9015a7228029bb22fa581b31c4c1ebdc2882814 by Miss Islington (bot) in branch '3.7':
bpo-37124: Fix reference leak in test_msilib (GH-13750)
https://github.com/python/cpython/commit/c9015a7228029bb22fa581b31c4c1ebdc2882814


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun 24 08:04:55 2019
From: report at bugs.python.org (Shlomi Fish)
Date: Mon, 24 Jun 2019 12:04:55 +0000
Subject: [issue37371] Optimize and refactor readline().
In-Reply-To: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>
Message-ID: <1561377895.49.0.986280429579.issue37371@roundup.psfhosted.org>


Shlomi Fish <shlomif at shlomifish.org> added the comment:

@Serhiy: I used https://github.com/shlomif/freecell-pro-0fc-deals/blob/master/collect-stats.py .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Mon Jun 24 08:13:57 2019
From: report at bugs.python.org (Eryk)
Date: Mon, 24 Jun 2019 12:13:57 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561378437.75.0.212716886559.issue37384@roundup.psfhosted.org>


Eryk <eryklok at gmail.com> added the comment:

I am unsure, the uuid issue is already solved I was just saying that before I changed the uuid module I didn't get the 'failed to build curses' error, I am unsure of the difference I guess both, basically I am trying to make it as complete of an installation as possible with all optional modules installed and no errors so I can learn from A-Z without worrying about compiling again, getting more modules etc.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Mon Jun 24 08:28:27 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 12:28:27 +0000
Subject: [issue36732] test_asyncio: test_huge_content_recvinto() fails randomly
In-Reply-To: <1556264661.54.0.31283754406.issue36732@roundup.psfhosted.org>
Message-ID: <1561379307.68.0.87114957531.issue36732@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

There is an interesting discussion: https://stackoverflow.com/questions/14499593/can-the-infamous-error-netname-deleted-error-be-considered-an-error-at-all

"[WinError 64] The specified network name is no longer available" is raised on pending reads from closed socket.

Looks like we can just drop these reads without error reporting, it is safe and easy.

Victor, what do you think?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36732>
_______________________________________

From report at bugs.python.org  Mon Jun 24 08:31:52 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Mon, 24 Jun 2019 12:31:52 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561379512.46.0.644692839152.issue37250@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

There's also the question of complying with our own deprecation policy, as the approval to ditch tp_print API compatibility in PEP 590 relied on the fact that it has been deprecated since Python 3.0.

However, it turns out the associated programmatic deprecation had never actually been implemented, which means it is now appropriate to provide that deprecation warning belatedly in Python 3.8, and then upgrade to full removal in Python 3.9.

That way the folks building affected sdists from source will get the additional warnings to tell them "Hey, you have a looming maintainability problem to solve (and a year or two to solve it)", rather than the current situation, which is "You have a dependency management crisis *now*, and until you solve it, you can't even start testing on Python 3.8, since you won't even be able to build your dependencies, let alone install them".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Mon Jun 24 08:46:23 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Mon, 24 Jun 2019 12:46:23 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1561380383.62.0.424019937996.issue37221@roundup.psfhosted.org>


Nick Coghlan <ncoghlan at gmail.com> added the comment:

In reviewing https://github.com/cython/cython/pull/3009, Jeroen pointed out that my symbol checking idea wouldn't actually work, since the preprocessor can only see preprocessor definitions, not compiler symbols. If we're going to rely on a preprocessor definition, it may as well be PY_VERSION_HEX, so I've updated the Cython PR accordingly.

That means we're back to either breaking Cython compatibility with CPython master until the release is cut, or else just bumping the release serial a little early. The duration of either state is now a lot shorter though, since the target release date for 3.8.0b2 is next week.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:12:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:12:02 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561381922.7.0.749411074287.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

cleantest was run successfully on the 4 Fedora workers:

3.x: https://buildbot.python.org/all/#/builders/185/builds/641
3.8: https://buildbot.python.org/all/#/builders/218/builds/98
3.7: https://buildbot.python.org/all/#/builders/181/builds/168
2.7: https://buildbot.python.org/all/#/builders/182/builds/42

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:13:58 2019
From: report at bugs.python.org (Martin Teichmann)
Date: Mon, 24 Jun 2019 13:13:58 +0000
Subject: [issue37334] Add a cancel method to asyncio Queues
In-Reply-To: <1560930108.51.0.0633177562649.issue37334@roundup.psfhosted.org>
Message-ID: <1561382038.28.0.980136594988.issue37334@roundup.psfhosted.org>


Martin Teichmann <martin.teichmann at gmail.com> added the comment:

Given the reactions I gather "close" is a better name for the method, so I changed it accordingly.

In the current implementation, items that had been put on the queue but not processed yet still get processed after the close, and I think this is the desired behavior. I added a test such that this won't unexpectedly change in the future.

To be precise, the current implementation of the queue does not even put new items on the queue if there is already a waiting consumer. The item will directly be handed over to said consumer, which may hang around on the event loop for a bit longer, but during this time the item is not in the queue. This also answers the questions about catching the CancelledError: if there are waiting consumers, there is nothing on the queue, so the problem of processing leftover items does not exist. The same holds for the task_done.

As for the "why don't I just cancel the task?", well, if you know it. There may be many consumer or producer tasks waiting for their turn. Sure, you can keep a list of all those tasks. But that's exactly the point of the proposed change: the Queue already knows all the waiting tasks, no need to keep another list up-to-date!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37334>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:14:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:14:40 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561382080.32.0.593531371114.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

cleantest was also run on Windows buildbots. Example a Windows 2.7 buildbot:
https://buildbot.python.org/all/#/builders/70/builds/415

D:\buildarea\2.7.ware-win81-release.nondebug\build>"D:\buildarea\2.7.ware-win81-release.nondebug\build\PCbuild\amd64\python"  -Wd -3 -E -tt "D:\buildarea\2.7.ware-win81-release.nondebug\build\PCbuild\..\Lib\test\regrtest.py"  -uall -rwW --slowest -j2 -j4 --cleanup 
Cleanup D:\buildarea\2.7.ware-win81-release.nondebug\build\build directory
Remove directory: D:\buildarea\2.7.ware-win81-release.nondebug\build\build\test_python_4824

So a previous test job leaked "test_python_4824" directory.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:16:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:16:29 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561382189.26.0.317530979076.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I am not 100% sure that my change will fix the following warning on x86 Gentoo Installed with X 3.x, but I'm quite confident :-)

RuntimeWarning: tests may fail, unable to create temporary directory '/buildbot/tmp/tmpdir/test_python_28144': [Errno 17] File exists: '/buildbot/tmp/tmpdir/test_python_28144'"

I close the issue. Reopen it if the bug strikes back.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 2.7, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:17:53 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:17:53 +0000
Subject: [issue37181] fix test_regrtest failures on Windows arm64
In-Reply-To: <1559930332.06.0.798599689966.issue37181@roundup.psfhosted.org>
Message-ID: <1561382273.46.0.408774893179.issue37181@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I see two merged changes, so I close the issue. I don't think that ARM64 is supported on Python 3.7 and older.

----------
nosy: +vstinner
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37181>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:18:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:18:50 +0000
Subject: [issue15629] Add to regrtest the ability to run Lib and Doc doctests
In-Reply-To: <1344779660.84.0.741331364071.issue15629@psf.upfronthosting.co.za>
Message-ID: <1561382330.41.0.305914169412.issue15629@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The issue has been fixed by bpo-35240.

commit a22df4896f6b83c8741203118790ae281716bca5
Author: Victor Stinner <vstinner at redhat.com>
Date:   Wed Nov 28 10:24:08 2018 +0100

    bpo-35240: Add "doctest" job to Travis CI (GH-10753)
    
    Create a new "doctest" job in Travis CI to run "make doctest".

----------
nosy: +vstinner
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Travis CI: xvfb-run: error: Xvfb failed to start

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue15629>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:19:22 2019
From: report at bugs.python.org (Cooper Lees)
Date: Mon, 24 Jun 2019 13:19:22 +0000
Subject: [issue34556] Add --upgrade to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561382362.28.0.974637006518.issue34556@roundup.psfhosted.org>


Cooper Lees <me at cooperlees.com> added the comment:

That?s very disappointing. I had the very small PR ready to merge ~3 weeks before beta1. I now have to wait ~1.5years to be able to use this anywhere that I won?t be back porting it.

I am happy to be on the hook and forward fix anything it causes, but as a new CLI argument that does nothing unless specified, I can?t really see any disadvantages of merging this into 3.8. Is there any way other than discussing with the release manager to have this considered?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:22:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:22:09 +0000
Subject: [issue32246] test_regrtest alters the execution environment on Android
In-Reply-To: <1512662502.3.0.213398074469.issue32246@psf.upfronthosting.co.za>
Message-ID: <1561382529.42.0.755960317029.issue32246@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This issue should be fixed by bpo-32252:

commit 48d4dd974f0c8d47c54990eedd322b96b19c60ec
Author: Victor Stinner <victor.stinner at gmail.com>
Date:   Mon Dec 11 13:57:12 2017 +0100

    bpo-32252: Fix faulthandler_suppress_crash_report() (#4794)
    
    Fix faulthandler_suppress_crash_report() used to prevent core dump files
    when testing crashes. getrlimit() returns zero on success.


If it's not the case. Please open the issue.

----------
resolution:  -> duplicate
stage: needs patch -> resolved
status: open -> closed
superseder:  -> test_regrtest  leaves a test_python_* directory in TEMPDIR

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32246>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:23:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:23:55 +0000
Subject: [issue31088] regrtest.py: "${test_file_name} skipped" message printed
 twice for each ${test_file_name}
In-Reply-To: <1501505990.76.0.255583071807.issue31088@psf.upfronthosting.co.za>
Message-ID: <1561382635.88.0.464481083608.issue31088@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

To be clear: the output is expected, it was a deliberate choice. I close the issue.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31088>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:31:03 2019
From: report at bugs.python.org (Omer Katz)
Date: Mon, 24 Jun 2019 13:31:03 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1561383063.96.0.364930390669.issue7946@roundup.psfhosted.org>


Omer Katz <omer.drow at gmail.com> added the comment:

Celery 5 is going async and in order to isolate the main event loop from task execution, the tasks are going to be executed in a different thread with it's own event loop.

This thread may or may not be CPU bound.
The main thread is I/O bound.

This patch should help a lot.

I like Nir's approach a lot (although I haven't looked into the patch itself yet). It's pretty novel.
David's patch is also very interesting.

I'm willing to help.

----------
nosy: +Omer.Katz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:32:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:32:08 +0000
Subject: [issue31098] test target of Makefile always run tests in parallel mode
In-Reply-To: <1501613858.46.0.0685506045585.issue31098@psf.upfronthosting.co.za>
Message-ID: <1561383128.66.0.711762921345.issue31098@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

To run tests sequentially, you can run regrtest using:

./python -m test

I don't use "make test".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31098>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:34:48 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:34:48 +0000
Subject: [issue31098] test target of Makefile always run tests in parallel mode
In-Reply-To: <1501613858.46.0.0685506045585.issue31098@psf.upfronthosting.co.za>
Message-ID: <1561383288.95.0.575436183345.issue31098@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I close the issue as "not a bug". Reopen if you disagree.

IMHO it's a bad practice to run tests sequentially: a test can change th behavior of the following test. Spawning a new process per test file is safer. Even if we are working hard to fix all side effects.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31098>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:40:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:40:26 +0000
Subject: [issue37387] test_compileall fails randomly on Windows when tests are
 run in parallel
Message-ID: <1561383626.08.0.320504464802.issue37387@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

I'm not sure that it's a good practice to rewrite .pyc files of the stdlib while tests are run in parallel.

Maybe the test should copy all .py files of the stdlib into a temporary directory and work there, to not impact other tests run in parallel.

Example on AMD64 Windows7 SP1 3.8:
https://buildbot.python.org/all/#/builders/208/builds/105

======================================================================
FAIL: test_no_args_respects_force_flag (test.test_compileall.CommmandLineTestsWithSourceEpoch)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_py_compile.py", line 30, in wrapper
    return fxn(*args, **kwargs)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_py_compile.py", line 20, in wrapper
    return fxn(*args, **kwargs)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_compileall.py", line 322, in test_no_args_respects_force_flag
    self.assertRunOK('-f', PYTHONPATH=self.directory)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\test_compileall.py", line 271, in assertRunOK
    rc, out, err = script_helper.assert_python_ok(
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\support\script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\support\script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "C:\buildbot.python.org\3.8.kloth-win64\build\lib\test\support\script_helper.py", line 70, in fail
    raise AssertionError("Process return code is %d\n"
AssertionError: Process return code is 1
command line: ['C:\\buildbot.python.org\\3.8.kloth-win64\\build\\PCbuild\\amd64\\python_d.exe', '-X', 'faulthandler', '-S', '-m', 'compileall', '-f']

stdout:
---
(... truncated stdout ...)ling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\ipaddress.py'...
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\keyword.py'...
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\linecache.py'...
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\locale.py'...
(...)
*** PermissionError: [WinError 5] Access is denied: 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\__pycache__\\site.cpython-38.pyc.25436544' -> 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\__pycache__\\site.cpython-38.pyc'
(...)
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\zipapp.py'...
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\zipfile.py'...
Compiling 'C:\\buildbot.python.org\\3.8.kloth-win64\\build\\lib\\zipimport.py'...
---

stderr:
---

---

----------------------------------------------------------------------

Ran 81 tests in 25.827s

FAILED (failures=1, skipped=2)
test test_compileall failed

----------
components: Tests
messages: 346402
nosy: pablogsal, vstinner
priority: normal
severity: normal
status: open
title: test_compileall fails randomly on Windows when tests are run in parallel
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37387>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:48:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:48:19 +0000
Subject: [issue36732] test_asyncio: test_huge_content_recvinto() fails randomly
In-Reply-To: <1556264661.54.0.31283754406.issue36732@roundup.psfhosted.org>
Message-ID: <1561384099.45.0.379173656539.issue36732@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

We get a ConnectionResetError exception thanks to IocpProactor.recv() callback:

        def finish_recv(trans, key, ov):
            try:
                return ov.getresult()
            except OSError as exc:
                if exc.winerror in (_overlapped.ERROR_NETNAME_DELETED,
                                    _overlapped.ERROR_OPERATION_ABORTED):
                    raise ConnectionResetError(*exc.args)
                else:
                    raise

Would it be legit to convert ConnectionResetError to returning b'' in sock_recv()? Example with the test:

        while True:
            data = await self.loop.sock_recv(sock, DATA_SIZE)
            if not data:
                break
            expected = bytes(islice(checker, len(data)))
            self.assertEqual(data, expected)
            size -= len(data)
        self.assertEqual(size, 0)

"if not data:" is a common test to check if we reached the end of file or if a socket has been closed by the peer, no?

Proposed patch:

diff --git a/Lib/asyncio/proactor_events.py b/Lib/asyncio/proactor_events.py
index 9b8ae064a8..14b7f10729 100644
--- a/Lib/asyncio/proactor_events.py
+++ b/Lib/asyncio/proactor_events.py
@@ -687,10 +687,16 @@ class BaseProactorEventLoop(base_events.BaseEventLoop):
         super().close()
 
     async def sock_recv(self, sock, n):
-        return await self._proactor.recv(sock, n)
+        try:
+            return await self._proactor.recv(sock, n)
+        except (ConnectionResetError, ConnectionAbortedError):
+            return b''
 
     async def sock_recv_into(self, sock, buf):
-        return await self._proactor.recv_into(sock, buf)
+        try:
+            return await self._proactor.recv_into(sock, buf)
+        except (ConnectionResetError, ConnectionAbortedError):
+            return 0
 
     async def sock_sendall(self, sock, data):
         return await self._proactor.send(sock, data)


I'm not sure about this change.

I'm not sure about sock_recv_info(): are you suppose to truncate buf to 0 bytes in this case?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36732>
_______________________________________

From report at bugs.python.org  Mon Jun 24 09:49:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 13:49:54 +0000
Subject: [issue36732] test_asyncio: test_huge_content_recvinto() fails randomly
In-Reply-To: <1556264661.54.0.31283754406.issue36732@roundup.psfhosted.org>
Message-ID: <1561384194.98.0.262856228562.issue36732@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The failing test was added by:

commit 74387926072abf338a4c1cec1bf0501fc65bbee5
Author: Andrew Svetlov <andrew.svetlov at gmail.com>
Date:   Mon Nov 12 19:00:22 2018 +0200

    bpo-30064: Refactor sock_* asyncio API (#10419)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36732>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:06:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:06:55 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1561385215.24.0.934114856502.issue37221@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> That means we're back to either breaking Cython compatibility with CPython master until the release is cut

Yeah, that was my plan: merge PR 13959 "just before" beta2, and try to get a Cython release ASAP.

The best case would be to get a Cython release with the fix *before* beta2 is released. Would it be possible Stefan?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:10:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:10:05 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1561385405.59.0.0253834174003.issue37124@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 6cbff564f00fbe17b5443f6986a44ce116d32aee by Victor Stinner in branch '2.7':
bpo-37124: Fix reference leak in test_msilib (GH-13750) (GH-14340)
https://github.com/python/cpython/commit/6cbff564f00fbe17b5443f6986a44ce116d32aee


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:10:52 2019
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Mon, 24 Jun 2019 14:10:52 +0000
Subject: [issue37388] unknown error handlers should be reported early
Message-ID: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>


New submission from Miro Hron?ok <miro at hroncok.cz>:

I was just bit by specifying an nonexisitng error handler for bytes.decode() without noticing.

Consider this code:

>>> 'a'.encode('cp1250').decode('utf-8', errors='Boom, Shaka Laka, Boom!')
'a'

Nobody notices that the error handler doesn't exist.

However:

>>> '?'.encode('cp1250').decode('utf-8', errors='Boom, Shaka Laka, Boom!')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
LookupError: unknown error handler name 'Boom, Shaka Laka, Boom!'


The error is only noticeable once there is an error in the data.

While nobody could possibly mistake 'Boom, Shaka Laka, Boom!' for a valid error handler, I was bit by this:

>>> b.decode('utf-8', errors='surrogate')

Which in fact should have been

>>> b.decode('utf-8', errors='surrogateescape')

Yet I wasn't notified, because the bytes in question were actually decodeable as valid utf-8.

I suggest that unknown error handler should rise an exception immediately like this:

>>> 'b'.encode('cp1250').decode('utf-8', errors='Boom, Shaka Laka, Boom!')
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
LookupError: unknown error handler name 'Boom, Shaka Laka, Boom!'

----------
components: Unicode
messages: 346407
nosy: ezio.melotti, hroncok, vstinner
priority: normal
severity: normal
status: open
title: unknown error handlers should be reported early
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:11:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:11:16 +0000
Subject: [issue37124] test_msilib is potentially leaking references and memory
 blocks
In-Reply-To: <1559405726.45.0.528544648803.issue37124@roundup.psfhosted.org>
Message-ID: <1561385476.04.0.824411799083.issue37124@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I backported Pablo's fix to 2.7 and 3.7 to attempt to fix Windows Refleak 2.7 and Windows Refleak 3.7 buildbots.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37124>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:15:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:15:11 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561385711.6.0.00802558925599.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Getting an error handler is expensive compared to the time to encode text/decode bytes. Python loads the error handler lazily to provide best performances. Text codecs are performance critical for Python.

If we add a check, it should only be enabled in development (python3 -X dev) and/or debug mode (./configure --with-pydebug).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:15:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:15:19 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561385719.53.0.980038049995.issue37388@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +inada.naoki, serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:33:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 14:33:51 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561386831.6.0.476467456135.issue37388@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14162
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14341

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:40:39 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 14:40:39 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1561387239.78.0.466291852345.issue36974@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14163
pull_request: https://github.com/python/cpython/pull/14342

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:53:55 2019
From: report at bugs.python.org (Daniel W Forsyth)
Date: Mon, 24 Jun 2019 14:53:55 +0000
Subject: [issue37389] Memory Leak - ThreadingUDPServer
Message-ID: <1561388035.56.0.684097558848.issue37389@roundup.psfhosted.org>


New submission from Daniel W Forsyth <danf at dataforge.on.ca>:

After putting a basic ThreadingUDPServer under load (500 messages per/second)  I noticed that after a night it was consuming a lot of RAM given it does nothing with the data.

On inception, I noticed the _thread count inside the server was growing forever even though the sub-threads are done.

Setup a basic ThreadingUDPSever with handler that does nothing and check the request_queue_size, it seems to grow without limit.

----------
components: Library (Lib)
messages: 346410
nosy: danf at dataforge.on.ca
priority: normal
severity: normal
status: open
title: Memory Leak - ThreadingUDPServer
type: performance
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37389>
_______________________________________

From report at bugs.python.org  Mon Jun 24 10:59:58 2019
From: report at bugs.python.org (Daniel W Forsyth)
Date: Mon, 24 Jun 2019 14:59:58 +0000
Subject: [issue37389] Memory Leak - ThreadingUDPServer
In-Reply-To: <1561388035.56.0.684097558848.issue37389@roundup.psfhosted.org>
Message-ID: <1561388398.02.0.998339394531.issue37389@roundup.psfhosted.org>


Daniel W Forsyth <danf at dataforge.on.ca> added the comment:

The only way I could figure out to control it was to do this in a thread;

        for thread in server._threads:  # type: Thread
            if not thread.is_alive():
                server._threads.remove(thread)

Shouldn't the server process do this when the thread is done?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37389>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:01:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 15:01:07 +0000
Subject: [issue37389] Memory Leak - ThreadingUDPServer
In-Reply-To: <1561388035.56.0.684097558848.issue37389@roundup.psfhosted.org>
Message-ID: <1561388467.23.0.494421929605.issue37389@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This issue is a duplicate of bpo-37193.

----------
nosy: +vstinner
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37389>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:01:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 15:01:41 +0000
Subject: [issue37193] Memory leak while running TCP/UDPServer with
 socketserver.ThreadingMixIn
In-Reply-To: <1559908419.41.0.390422965351.issue37193@roundup.psfhosted.org>
Message-ID: <1561388501.06.0.00350688167645.issue37193@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I marked bpo-37389 as a duplicate of this issue:

"""
msg346410 - (view) 	Author: Daniel W Forsyth (danf at dataforge.on.ca) 	Date: 2019-06-24 14:53

After putting a basic ThreadingUDPServer under load (500 messages per/second)  I noticed that after a night it was consuming a lot of RAM given it does nothing with the data.

On inception, I noticed the _thread count inside the server was growing forever even though the sub-threads are done.

Setup a basic ThreadingUDPSever with handler that does nothing and check the request_queue_size, it seems to grow without limit.

msg346411 - (view) 	Author: Daniel W Forsyth (danf at dataforge.on.ca) 	Date: 2019-06-24 14:59

The only way I could figure out to control it was to do this in a thread;

        for thread in server._threads:  # type: Thread
            if not thread.is_alive():
                server._threads.remove(thread)

Shouldn't the server process do this when the thread is done?
"""

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37193>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:10:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 15:10:19 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561389019.86.0.725624130622.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

bench.py: microbenchmark to measure the overhead of PR 14341.

----------
Added file: https://bugs.python.org/file48435/bench.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:28:27 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 15:28:27 +0000
Subject: [issue37378] FatalError: initfsencoding python couldn't find codec
 Module not found: Encodings
In-Reply-To: <1561298259.69.0.399868439526.issue37378@roundup.psfhosted.org>
Message-ID: <1561390107.85.0.811506026605.issue37378@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Also, just one question: how could python -m pip work but not pip? What are the differences in them?

To answer this, "pip" on its own is essentially like writing the full path to a specific python.exe and passing "-m pip". If that Python install has been removed or (more likely in this case) is broken, then you'll get the error you're seeing.

Fixing your PATH as suggested should do it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37378>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:30:16 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 15:30:16 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1561390216.69.0.907652518436.issue35621@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +14164
pull_request: https://github.com/python/cpython/pull/14344

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:43:08 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 15:43:08 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561390988.73.0.331210219356.issue37363@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14165
pull_request: https://github.com/python/cpython/pull/14345

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:42:59 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 15:42:59 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561390979.78.0.431544250848.issue37363@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 60419a7e96577cf783b3b45bf3984f9fb0d7ddff by Steve Dower in branch 'master':
bpo-37363: Add audit events for a range of modules (GH-14301)
https://github.com/python/cpython/commit/60419a7e96577cf783b3b45bf3984f9fb0d7ddff


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Mon Jun 24 11:46:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 15:46:04 +0000
Subject: [issue37390] Generate table of audit events for docs
Message-ID: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>


New submission from Steve Dower <steve.dower at python.org>:

All audit events are marked in the docs with the ".. audit-event:: <name> <args>" syntax.

We should automatically collate these into a single table and generate a new doc page as part of docs build.

----------
assignee: docs at python
components: Documentation
messages: 346417
nosy: christian.heimes, docs at python, steve.dower
priority: normal
severity: normal
stage: needs patch
status: open
title: Generate table of audit events for docs
type: enhancement
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 12:09:53 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 16:09:53 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561392593.42.0.24076863737.issue37363@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 8763d43a9558b345af6a3a298afa18e7d3b42fd0 by Miss Islington (bot) in branch '3.8':
bpo-37363: Add audit events for a range of modules (GH-14301)
https://github.com/python/cpython/commit/8763d43a9558b345af6a3a298afa18e7d3b42fd0


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Mon Jun 24 12:11:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 24 Jun 2019 16:11:29 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561392689.24.0.414260091192.issue37390@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 12:14:43 2019
From: report at bugs.python.org (Jeremy Kloth)
Date: Mon, 24 Jun 2019 16:14:43 +0000
Subject: [issue37387] test_compileall fails randomly on Windows when tests are
 run in parallel
In-Reply-To: <1561383626.08.0.320504464802.issue37387@roundup.psfhosted.org>
Message-ID: <1561392883.75.0.711794106333.issue37387@roundup.psfhosted.org>


Change by Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com>:


----------
nosy: +jkloth

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37387>
_______________________________________

From report at bugs.python.org  Mon Jun 24 12:14:58 2019
From: report at bugs.python.org (Jeremy Kloth)
Date: Mon, 24 Jun 2019 16:14:58 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561392898.59.0.850180503537.issue37386@roundup.psfhosted.org>


Change by Jeremy Kloth <jeremy.kloth+python-tracker at gmail.com>:


----------
nosy: +jkloth

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 12:27:43 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 16:27:43 +0000
Subject: [issue37363] Additional PEP578 hooks
In-Reply-To: <1561131749.05.0.996884755083.issue37363@roundup.psfhosted.org>
Message-ID: <1561393663.01.0.94996861041.issue37363@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

FWIW, I tried looking into how we can prevent or detect monkeypatching of "sys.audit", and the answer seems to be that we need to define a custom type for the sys module and for sys.__dict__.

I'm not prepared to do that yet, and IMHO there are enough way to detect someone patching it to nothing (all your logs disappear) or patching it more cleverly (someone ran some pretty complex code to redefine it) and events from native code can't be suppressed either, so I think it's fine. 

But I won't refuse a contribution if someone thinks this is a critical scenario (though I will push hard to make sure the implementation is solid, as I think this is pretty hard to get right).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37363>
_______________________________________

From report at bugs.python.org  Mon Jun 24 13:27:59 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Mon, 24 Jun 2019 17:27:59 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561397279.83.0.0156926525467.issue37359@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

The issue strikes back:

https://buildbot.python.org/all/#/builders/103/builds/2698

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 13:32:22 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 17:32:22 +0000
Subject: [issue37351] Drop libpython38.a from Windows release
In-Reply-To: <1561049656.76.0.375565616699.issue37351@roundup.psfhosted.org>
Message-ID: <1561397542.25.0.31249703344.issue37351@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Fixing --compiler=mingw32 is left for another bug, if anyone is so motivated.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37351>
_______________________________________

From report at bugs.python.org  Mon Jun 24 13:57:39 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 24 Jun 2019 17:57:39 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561399059.2.0.094042193838.issue37384@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

The uuid issue is described in Issue32627 and there is a PR fix for it awaiting review (PR 11751).  As Christian notes, the curses issues seems to be related to some configure option.  If you haven't already, suggest you start with the simplest configure options, so something like:

./configure && make -j2

or 

./configure --prefix=/path/to/installed/location && make -j2 && make install

and, once that is working, then try adding other options.  Please feel free to reopen this issue if you find a failing issue and please include all relevant details, in particular the exact configure command used and platform details.

----------
nosy: +ned.deily
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> Header dependent _uuid build failure on Fedora 27

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Mon Jun 24 13:59:57 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 24 Jun 2019 17:59:57 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561399197.04.0.943948888262.issue32627@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset 6ffd9b05dfade9e3a101fe039157856eb855f82e by Ned Deily (ziheng) in branch 'master':
bpo-32627: Fix compile error when conflicting `_uuid` headers included (GH-11751)
https://github.com/python/cpython/commit/6ffd9b05dfade9e3a101fe039157856eb855f82e


----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:00:22 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:00:22 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561399222.54.0.442676052735.issue32627@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14166
pull_request: https://github.com/python/cpython/pull/14347

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:00:28 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:00:28 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561399228.83.0.321574722928.issue32627@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14167
pull_request: https://github.com/python/cpython/pull/14348

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:11:57 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Mon, 24 Jun 2019 18:11:57 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561399917.68.0.213777478592.issue37250@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

Thank you, Petr, for bringing this discussion back on a solid basis, actually twice already.

And sorry for causing this problem in the first place. The "tp_print = 0" was necessary to fix misbehaviour in Py2, and we should have restricted it to Py2 back then (that line has been there since late 2013).

I think keeping some kind of a "tp_print" named field in PyTypeObject for now is the best we can do. I like Jeroen's PR (thanks for taking care of so many things at a time, Jeroen!), and I think we should just go with it.

I'm happy to release a new point release for Cython, as soon as it's clear what CPython will do, and how Cython can detect the change to adapt to it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:17:05 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 18:17:05 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561400225.05.0.367206196417.issue36889@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset 6793cce155f8875b10efd746cb0b34cb72263af7 by Andrew Svetlov (Xtreak) in branch 'master':
bpo-36889: Document asyncio Stream and StreamServer (GH-14203)
https://github.com/python/cpython/commit/6793cce155f8875b10efd746cb0b34cb72263af7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:17:13 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:17:13 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561400233.23.0.233799381517.issue36889@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14168
pull_request: https://github.com/python/cpython/pull/14349

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:18:27 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:18:27 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561400307.36.0.217140901308.issue32627@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 742b16edd692f58a06e0d55bedfffb77a112b205 by Miss Islington (bot) in branch '3.7':
bpo-32627: Fix compile error when conflicting `_uuid` headers included (GH-11751)
https://github.com/python/cpython/commit/742b16edd692f58a06e0d55bedfffb77a112b205


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:20:26 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Mon, 24 Jun 2019 18:20:26 +0000
Subject: [issue37221] PyCode_New API change breaks backwards compatibility
 policy
In-Reply-To: <1560209067.42.0.855519802872.issue37221@roundup.psfhosted.org>
Message-ID: <1561400426.48.0.798217346052.issue37221@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

I'm really only waiting for bpo-37250 to be resolved, then I can prepare a new point release of Cython, preferably this week.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37221>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:28:03 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:28:03 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561400883.09.0.148785582618.issue32627@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 76b72f6ea26de4280279a01863f30fccd2dde8f3 by Miss Islington (bot) in branch '3.8':
bpo-32627: Fix compile error when conflicting `_uuid` headers included (GH-11751)
https://github.com/python/cpython/commit/76b72f6ea26de4280279a01863f30fccd2dde8f3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:32:23 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 24 Jun 2019 18:32:23 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561401143.35.0.935920634686.issue37390@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I just tried an initial attempt at this and a screenshot as attached. I followed the approach similar to the one at https://www.sphinx-doc.org/en/master/development/tutorials/todo.html to gather all todos. The approach was to append all the audit event directives to a list as they are collected. I then created an AuditEventListDirective for post processing once rst files were read and created an empty page with only the audit-event-list-table directive. I rendered the audit items in the list into a table and then replaced the audit-event-list-table directive in the page with the table content. Unfortunately, I couldn't proceed further due to some odd sphinx error during builds on moving this to a new index and limited sphinx skills. 

+1 to the idea. It would be helpful to have all the audit events under one page for reference.

https://github.com/python/cpython/compare/master...tirkarthi:bpo37390

----------
Added file: https://bugs.python.org/file48436/Screen Shot 2019-06-24 at 11.54.58 pm.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:32:24 2019
From: report at bugs.python.org (Ned Deily)
Date: Mon, 24 Jun 2019 18:32:24 +0000
Subject: [issue32627] Header dependent _uuid build failure on Fedora 27
In-Reply-To: <1516672443.95.0.467229070634.issue32627@psf.upfronthosting.co.za>
Message-ID: <1561401144.6.0.969126439658.issue32627@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Thanks, @adam, for the analysis and thanks, zihengCat, for the PR.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32627>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:33:14 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 18:33:14 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561401194.82.0.416034917315.issue36889@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7268fd0d212e870103ae052697b32ba54d3f6299 by Miss Islington (bot) in branch '3.8':
bpo-36889: Document asyncio Stream and StreamServer (GH-14203)
https://github.com/python/cpython/commit/7268fd0d212e870103ae052697b32ba54d3f6299


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:38:19 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Mon, 24 Jun 2019 18:38:19 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561401499.85.0.723307986666.issue36889@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thanks, Karthikeyan!

The only thing that needs to be documented is Stream class itself.
Would you finish this job, please?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:38:50 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Mon, 24 Jun 2019 18:38:50 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561401530.08.0.0929300676971.issue37347@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

The _sqlite3 module clearly is not free of bugs in this area. Binding the Python function to the exact lifetime of the sqlite function seems less likely to be buggy than replicating sqlite's function reference management independently. sqlite3_create_function_v2 was added in 2010; I think we can depend on it. Also, won't the callback pretty much be Py_DECREF(something)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:46:02 2019
From: report at bugs.python.org (Eryk)
Date: Mon, 24 Jun 2019 18:46:02 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561401962.64.0.143492354092.issue37384@roundup.psfhosted.org>


Eryk <eryklok at gmail.com> added the comment:

yeah i managed to fix the uuid already and used:
./configure --enable-optimizations
followed by
make -j 4
and then using
sudo make altinstall

but the issue comes up during the make -j 4 process, strange thing is before using thee 'uuid' fix i mentioned and found on here I didn't have the curses issue and now I do, how could I fix this so it compiles without errors? Thanks a lot for replying guys :)

----------
resolution: duplicate -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:46:21 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 24 Jun 2019 18:46:21 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561401981.23.0.293843532501.issue36889@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Sure, I think I missed it somehow though you mentioned it's around combining StreamReader and StreamWriter and to have appropriate signatures for the methods. I will try to raise a PR this week. I also realize there are no docstrings for the new functions like connect, connect_read_pipe, connect_write_pipe etc. Is it worthy enough of adding them too in the PR?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Mon Jun 24 14:52:52 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 18:52:52 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561402372.47.0.500611170138.issue37390@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Awesome! I was just making a start on this too, and it looks like we were doing nearly identical work. Happy to let you keep going on it!

Some things that I thought would be worth doing:
* combine equivalent events (warn if names match but arguments are different)
* include links back to the section where they came from
* include a "CPython implementation detail" message, and maybe mention that the table is generated from the docs

I think for the formatting, we'll have to rearrange how the *args* variable is created initially (so that we store the original names, not the `` marked ones) and then use nodes.literal() when adding them later. But this is pushing the boundaries of my Sphinx/docutils skills as well :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 15:08:04 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 24 Jun 2019 19:08:04 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561403284.84.0.368020061971.issue37390@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I think my approach suffers from the drawback where duplicate items cannot be separated correctly as you have mentioned. Example as below where socket.connect and socket.connect_ex emit same event and I am not able to retrieve the function at which the audit event block is present thus generating the same entry twice in the table. Maybe I need to store some more metadata.

1153:.. method:: socket.connect(address)
1165:   .. audit-event:: socket.connect "self address"
1174:.. method:: socket.connect_ex(address)
1183:   .. audit-event:: socket.connect "self address"

> * include links back to the section where they came from

Sphinx doesn't seem to support hyperlinking to line numbers. One approach would be to just link to the functions that emit the events that could solve the above problem too.

I did this as a PoC and kind of stuck with moving the file to a separate to a different table of content. I also seemed to have hit a sphinx bug that I couldn't get out of and my skills are limited too in Sphinx. I will give it another try over this week to see if I can come up with something mergeable :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 16:05:43 2019
From: report at bugs.python.org (Carol Willing)
Date: Mon, 24 Jun 2019 20:05:43 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561406743.02.0.476270362265.issue37250@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Thank you Petr. Looking at your response, the full discussion here, and the fact that we don't have an easy way to put a number on who would be impacted, I agree that merging the PR seems the best course of action.


Thanks Stefan for additional follow up with Cython too.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Mon Jun 24 16:12:43 2019
From: report at bugs.python.org (Paul Monson)
Date: Mon, 24 Jun 2019 20:12:43 +0000
Subject: [issue37370] AF_UNIX should be supported on Windows
In-Reply-To: <1561165130.02.0.287912372249.issue37370@roundup.psfhosted.org>
Message-ID: <1561407163.62.0.633905650395.issue37370@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

Thanks Zackery.  Closing as duplicate

----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37370>
_______________________________________

From report at bugs.python.org  Mon Jun 24 16:14:05 2019
From: report at bugs.python.org (Paul Monson)
Date: Mon, 24 Jun 2019 20:14:05 +0000
Subject: [issue33408] AF_UNIX is now supported in Windows
In-Reply-To: <1525257332.06.0.682650639539.issue33408@psf.upfronthosting.co.za>
Message-ID: <1561407245.87.0.751230251982.issue33408@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
nosy: +Paul Monson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33408>
_______________________________________

From report at bugs.python.org  Mon Jun 24 16:31:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 20:31:37 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561408297.94.0.389498998065.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> The issue strikes back:
> https://buildbot.python.org/all/#/builders/103/builds/2698

Not good. This build was run after I deployed the new buildbot configuraiton, with the new "cleantest" step, but it has no "cleantest" step. Maybe this job was scheduled before the new configuration was deployed?

I rebuilt this build to see if it gets "cleantest" step:
https://buildbot.python.org/all/#/builders/103/builds/2701

Note: I'm not surprised that the issue strikes back. It happens all the time with buildbots...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 16:38:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 20:38:55 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561408735.84.0.937894679841.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh I see, this specific buildbot uses a different buildbot configuration that I forgot to patch. It should now be fixed as well:
https://github.com/python/buildmaster-config/commit/f546fa0cfa0bf1ac77970c2eaa001923d8df7cbf

New build which should use this configuration:
https://buildbot.python.org/all/#/builders/103/builds/2702

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Mon Jun 24 17:08:24 2019
From: report at bugs.python.org (Cooper Lees)
Date: Mon, 24 Jun 2019 21:08:24 +0000
Subject: [issue34556] Add --upgrade-deps to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561410504.21.0.527812568864.issue34556@roundup.psfhosted.org>


Change by Cooper Lees <me at cooperlees.com>:


----------
title: Add --upgrade to venv module -> Add --upgrade-deps to venv module

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Mon Jun 24 18:04:32 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Mon, 24 Jun 2019 22:04:32 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561413872.83.0.417763448175.issue37386@roundup.psfhosted.org>


Giovanni Cappellotto <potomak84 at gmail.com> added the comment:

Hi,

I'd like to claim this task if nobody else already started working on it.

----------
nosy: +potomak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 18:10:26 2019
From: report at bugs.python.org (aeros167)
Date: Mon, 24 Jun 2019 22:10:26 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561414226.18.0.703698384682.issue19696@roundup.psfhosted.org>


aeros167 <aeros167 at gmail.com> added the comment:

Created a PR for moving and renaming "test_pkimport". An initial approval was made, now it is awaiting core review (https://github.com/python/cpython/pull/14303).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Mon Jun 24 18:23:36 2019
From: report at bugs.python.org (George Pantazes)
Date: Mon, 24 Jun 2019 22:23:36 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
Message-ID: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>


New submission from George Pantazes <georgepantazes at gmail.com>:

IDLE crashes if the user scrolls with the Mac mousepad (using two fingers, either up or down).

```$ python -m idlelib # Then I use the mousepad to scroll in the IDLE window
Traceback (most recent call last):
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/idlelib/__main__.py", line 7, in <module>
    idlelib.pyshell.main()
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/idlelib/pyshell.py", line 1572, in main
    root.mainloop()
  File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/tkinter/__init__.py", line 1283, in mainloop
    self.tk.mainloop(n)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
```

System Info: MacOS Mojave 10.14.5 (18F132)

Python:
3.7.3 (default, Mar 27 2019, 09:23:15) 
[Clang 10.0.1 (clang-1001.0.46.3)]
sys.version_info(major=3, minor=7, micro=3, releaselevel='final', serial=0)

----------
assignee: terry.reedy
components: IDLE
messages: 346445
nosy: George Pantazes, terry.reedy
priority: normal
severity: normal
status: open
title: MacOS Touchpad scrolling crashes IDLE
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Mon Jun 24 18:28:51 2019
From: report at bugs.python.org (George Pantazes)
Date: Mon, 24 Jun 2019 22:28:51 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561415331.06.0.601162174865.issue37391@roundup.psfhosted.org>


George Pantazes <georgepantazes at gmail.com> added the comment:

Also happens when I plug in a conventional mouse and use the mouse scrollwheel (so it's not just the touchpad scrolling!).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:01:38 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:01:38 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561417298.41.0.134175523549.issue37390@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I took your code and made some improvements:

https://github.com/python/cpython/compare/master...zooba:bpo37390

In particular, I added the backlinks from the table (but unfortunately they all go to the line of text we generate for the ..audit-event directive, and not the top of the section :( ) and debugged some of the weirdness of generating tables in docutils.

Feel free to pull my changes and take back over if there's more you want to do!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:22:17 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:22:17 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561418537.49.0.722511650001.issue35360@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 7fd2ba354ec2304743ffd9ba620e07d113532264 by Steve Dower (animalize) in branch 'master':
bpo-35360: Update Windows builds to use SQLite 3.28.0 (GH-14179)
https://github.com/python/cpython/commit/7fd2ba354ec2304743ffd9ba620e07d113532264


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:22:27 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 23:22:27 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561418547.08.0.236812904218.issue35360@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14169
pull_request: https://github.com/python/cpython/pull/14352

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:22:35 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 23:22:35 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561418555.39.0.0125867537334.issue35360@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14170
pull_request: https://github.com/python/cpython/pull/14353

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:25:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 23:25:24 +0000
Subject: [issue33408] AF_UNIX is now supported in Windows
In-Reply-To: <1525257332.06.0.682650639539.issue33408@psf.upfronthosting.co.za>
Message-ID: <1561418724.51.0.382312381409.issue33408@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33408>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:26:23 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:26:23 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561418783.74.0.459751655758.issue35360@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14171
pull_request: https://github.com/python/cpython/pull/14354

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:27:06 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:27:06 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561418826.17.0.547815919461.issue35360@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 0fc14b373398767b4323a7bc2c2310b6218c5b74 by Steve Dower (animalize) in branch '2.7':
bpo-35360: Update Windows builds to use SQLite 3.28.0 (GH-14182)
https://github.com/python/cpython/commit/0fc14b373398767b4323a7bc2c2310b6218c5b74


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:28:54 2019
From: report at bugs.python.org (Ali McMaster)
Date: Mon, 24 Jun 2019 23:28:54 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561418934.49.0.080116385395.issue37386@roundup.psfhosted.org>


Ali McMaster <alimcmaster1 at gmail.com> added the comment:

To check - do we definitely want to just skip the test if the below OSError is thrown? Could we attempt to clean wherever the test is writing to before the test is run/figure out what is using all the space?

----------
nosy: +Ali McMaster

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:40:13 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:40:13 +0000
Subject: [issue37140] ctypes change made clang fail to build
In-Reply-To: <1559553697.78.0.201685591504.issue37140@roundup.psfhosted.org>
Message-ID: <1561419613.6.0.346268714937.issue37140@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> According to serge_sans_paille: if ``self->b_ptr`` contains pointer, the ``memcpy`` creates sharing, and this is dangerous: if a ``__del__`` happens to free the original pointer, we end up with a dangling reference in ``new_ptr``. As far as I can tell, this is what happens in the clang bindings code.

We probably need a second parg->obj to keep self alive for as long as copied_self. Or pack it into a tuple.

Having a repro test for this would be ideal, especially if we can make it happen (even crash) on all platforms. The double-free issue would seem to be real, and I don't want it to crash on Windows either.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37140>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:43:29 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:43:29 +0000
Subject: [issue25361] Is python-3-5-0.exe compiled with SSE2 instrutions? If
 so should we mention this?
In-Reply-To: <1444473804.35.0.126289501902.issue25361@psf.upfronthosting.co.za>
Message-ID: <1561419809.58.0.313624206469.issue25361@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 8bd2872adbbc7ed5dd0a7593193c52431ae34c8d by Steve Dower (animalize) in branch 'master':
bpo-25361: Enable SSE2 instructions for Windows 32-bit build (GH-12438)
https://github.com/python/cpython/commit/8bd2872adbbc7ed5dd0a7593193c52431ae34c8d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue25361>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:43:34 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 23:43:34 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561419814.31.0.139121176202.issue35360@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dad8f79cfd83b824decb15eac4c0d5723edd4bf1 by Miss Islington (bot) in branch '3.8':
bpo-35360: Update Windows builds to use SQLite 3.28.0 (GH-14179)
https://github.com/python/cpython/commit/dad8f79cfd83b824decb15eac4c0d5723edd4bf1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:43:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 23:43:47 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
Message-ID: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

sys.getcheckinterval() and sys.setcheckinterval() are deprecated since Python 3.2, it's now time to remove them!

----------
components: Interpreter Core
messages: 346454
nosy: vstinner
priority: normal
severity: normal
status: open
title: Remove sys.setcheckinterval()
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:44:10 2019
From: report at bugs.python.org (miss-islington)
Date: Mon, 24 Jun 2019 23:44:10 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561419850.33.0.0614848093879.issue35360@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 14c179f97dbb7047cb30e4a610b5d5b531a4f6f7 by Miss Islington (bot) in branch '3.7':
bpo-35360: Update Windows builds to use SQLite 3.28.0 (GH-14179)
https://github.com/python/cpython/commit/14c179f97dbb7047cb30e4a610b5d5b531a4f6f7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:44:30 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:44:30 +0000
Subject: [issue35360] Update SQLite to 3.28 in Windows and macOS installer
 builds
In-Reply-To: <1543580070.45.0.788709270274.issue35360@psf.upfronthosting.co.za>
Message-ID: <1561419870.53.0.081432553671.issue35360@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35360>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:47:02 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:47:02 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561420022.62.0.228415241519.issue4963@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 9fc720e5e4f772598013ea48a3f0d22b2b6b04fa by Steve Dower (David K. Hess) in branch 'master':
bpo-4963: Fix for initialization and non-deterministic behavior issues in mimetypes (GH-3062)
https://github.com/python/cpython/commit/9fc720e5e4f772598013ea48a3f0d22b2b6b04fa


----------
nosy: +steve.dower

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:48:21 2019
From: report at bugs.python.org (Steve Dower)
Date: Mon, 24 Jun 2019 23:48:21 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561420101.12.0.13175275882.issue4963@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Sorry for the delays!

I've merged into master. The backports (3.7, 3.8) are going to need some help, so I'll take a look at them soon unless someone else gets there first.

----------
stage: needs patch -> backport needed
versions: +Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:51:38 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 24 Jun 2019 23:51:38 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
Message-ID: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

C:\CPython\cpython>python.bat -Werror -m test test_ntpath
Running Debug|x64 interpreter...
Run tests sequentially
0:00:00 load avg: 0.00 [1/1] test_ntpath
test test_ntpath failed -- Traceback (most recent call last):
  File "C:\CPython\cpython\\lib\ntpath.py", line 518, in abspath
    return normpath(_getfullpathname(path))
OSError: [WinError 123] The filename, directory name, or volume label syntax is
incorrect: b''

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\CPython\cpython\lib\test\test_ntpath.py", line 285, in test_abspath
    tester('ntpath.abspath("")', cwd_dir)
  File "C:\CPython\cpython\lib\test\test_ntpath.py", line 41, in tester
    gotResult = eval(fn)
  File "<string>", line 1, in <module>
  File "C:\CPython\cpython\\lib\ntpath.py", line 520, in abspath
    return _abspath_fallback(path)
  File "C:\CPython\cpython\\lib\ntpath.py", line 501, in _abspath_fallback
    cwd = os.getcwdb()
DeprecationWarning: The Windows bytes API has been deprecated, use Unicode filenames
instead

test_ntpath failed

== Tests result: FAILURE ==

1 test failed:
    test_ntpath

Total duration: 1 sec 297 ms
Tests result: FAILURE


It seems that eval() is called an extra time without a warning filter in the tester() function.

----------
components: Tests, Windows
messages: 346458
nosy: ZackerySpytz, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Deprecation warnings in test_ntpath
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:53:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 23:53:04 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561420384.71.0.966951412435.issue37392@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14172
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14355

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:53:08 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Mon, 24 Jun 2019 23:53:08 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561420388.7.0.591787223935.issue37386@roundup.psfhosted.org>


Change by Giovanni Cappellotto <potomak84 at gmail.com>:


----------
keywords: +patch
pull_requests: +14173
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14356

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:57:22 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Mon, 24 Jun 2019 23:57:22 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561420642.11.0.949783183564.issue37393@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +14174
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14357

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Mon Jun 24 19:58:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Mon, 24 Jun 2019 23:58:16 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561420696.06.0.255310622942.issue37392@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Attached PR 14355 removes these functions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 20:02:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 00:02:20 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561420940.08.0.398739744904.issue37392@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

These functions were deprecated by this change:

commit 074e5ed974be65fbcfe75a4c0529dbc53f13446f
Author: Antoine Pitrou <solipsis at pitrou.net>
Date:   Tue Nov 10 19:50:40 2009 +0000

    Merge in the new GIL.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 20:14:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 00:14:04 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561421644.95.0.838981906163.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> 2) ignore EBADF(OSError: [WinError 6] The handle is invalid) in terminate() and probably some other methods

That sounds like a bad idea. We should avoid using a handle if it can become invalid out of our control. A handle might be recycled, no?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Mon Jun 24 20:36:08 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 00:36:08 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561422968.87.0.718516858378.issue37391@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

FWIW, I can't reproduce the failure using either Python 3.7.3 from either the python.org binary installer or a current MacPorts 3.7.3.  But that's not surprising as the issue is most likely in Tk rather than IDLE or Python itself.  Can you supply the output from the following commands in a terminal session, assuming python3 is the same interpreter used to run IDLE?

python3 -m test.pythoninfo
otool -L $(python3 -c 'import _tkinter;print(_tkinter.__file__)')

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Mon Jun 24 20:55:12 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 00:55:12 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561424112.45.0.87986776666.issue37335@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

test_c_locale_coerce should use "codecs.lookup(encoding).name" to get the normalized name of an encoding, rather than fragile:

        data = data.replace(b"ANSI_X3.4-1968", b"ascii")
        data = data.replace(b"US-ASCII", b"ascii")

the proposed pattern is even more dangerous:

         data = data.replace(b"646", b"ascii")

I'm not sure where encodings should be normalized. Maybe around _check_child_encoding_details().

For the PR, please write it for the master branch.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Mon Jun 24 20:56:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 00:56:15 +0000
Subject: [issue21822] KeyboardInterrupt during Thread.join hangs that Thread
In-Reply-To: <1403365475.16.0.757881205569.issue21822@psf.upfronthosting.co.za>
Message-ID: <1561424175.88.0.834016344219.issue21822@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue21822>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:01:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 01:01:15 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561424475.36.0.890672624948.issue37392@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 36456df13843c5b8a1fb5a6022ab9ed1fe2a11c5 by Victor Stinner in branch 'master':
bpo-37392: Remove sys.setcheckinterval() (GH-14355)
https://github.com/python/cpython/commit/36456df13843c5b8a1fb5a6022ab9ed1fe2a11c5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:01:38 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 01:01:38 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561424498.45.0.0930276052316.issue37392@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I prefer to remove deprecated functions early in the 3.9 dev cycle, so we have more time for feedback. If something goes wrong, we can discuss reverting this removal before 3.9.0 final release.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:07:26 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 01:07:26 +0000
Subject: [issue37394] Fix pure Python implementation of queue
Message-ID: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>


New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

The test for the queue module are not testing correctly both the C and the Python implementation of the queue. A consequence is that some errors are being overseed (like the fact that an AttributeError is used instead of an ImportError to catch when importing _queue fails).

----------
components: Extension Modules, Interpreter Core, Tests
messages: 346466
nosy: pablogsal
priority: normal
severity: normal
status: open
title: Fix pure Python implementation of queue
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:07:48 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 01:07:48 +0000
Subject: [issue37394] Fix pure Python implementation of queue
In-Reply-To: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>
Message-ID: <1561424868.2.0.443979469175.issue37394@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
keywords: +patch
pull_requests: +14175
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14351

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:08:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 01:08:47 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561424927.12.0.869779351189.issue37386@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> To check - do we definitely want to just skip the test if the below OSError is thrown?

Note: I don't propose to ignore any OSError, only if exc.errno == errno.ENOSPC.

> Could we attempt to clean wherever the test is writing to before the test is run/figure out what is using all the space?

Maybe some tests can be enhanced, but that's not directly related to this issue.

In general, Python tests don't leak any resource: memory, files, etc. If there is a leak, it must be fixed.

The test creates a file which can take up to 2 GiB on the disk. It's a big file. I don't think that other tests leak such huge file.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:09:41 2019
From: report at bugs.python.org (Ruslan Kuprieiev)
Date: Tue, 25 Jun 2019 01:09:41 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561424981.89.0.666775248376.issue37380@roundup.psfhosted.org>


Change by Ruslan Kuprieiev <kupruser at gmail.com>:


----------
pull_requests: +14176
pull_request: https://github.com/python/cpython/pull/14360

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:09:57 2019
From: report at bugs.python.org (Zack Weinberg)
Date: Tue, 25 Jun 2019 01:09:57 +0000
Subject: [issue37395] Core interpreter should be linked with libgcc_s.so on
 Linux
Message-ID: <1561424997.44.0.201874439202.issue37395@roundup.psfhosted.org>


New submission from Zack Weinberg <zackw at panix.com>:

There are several existing issues (e.g. #18748 and #35866) where at least part of the problem is that GNU libc tried to dlopen() `libgcc_s.so` at a moment when that's not safe, e.g. during thread or process shutdown.  This converts a recoverable error into a deadlock or crash.

This is arguably a bug in glibc, but Python can easily work around it by linking the core interpreter (the `python` executable and/or `libpython.so`) with libgcc_s at build time (`-lgcc_s`) on Linux.  It will then be loaded already if and when it's needed, and glibc won't try to load it on demand.

In order for this to be 100% reliable, it needs to be at least theoretically possible for code within the interpreter to call a function defined in libgcc_s.so. `_Unwind_Backtrace` is probably the most practical option.  (See https://refspecs.linuxfoundation.org/LSB_5.0.0/LSB-Core-generic/LSB-Core-generic/baselib--unwind-backtrace.html .)

----------
components: Interpreter Core
messages: 346468
nosy: zwol
priority: normal
severity: normal
status: open
title: Core interpreter should be linked with libgcc_s.so on Linux
type: crash

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37395>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:20:33 2019
From: report at bugs.python.org (Ruslan Kuprieiev)
Date: Tue, 25 Jun 2019 01:20:33 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561425633.29.0.577884816847.issue37380@roundup.psfhosted.org>


Ruslan Kuprieiev <kupruser at gmail.com> added the comment:

Thanks for pointing that out! I've submitted a tiny patch to skip ``_collect()`` and ``__del__``. Please find it in the Github PR attached. Looking forward to your feedback!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:23:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 01:23:57 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
Message-ID: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

x86 Windows XP 2.7:
https://buildbot.python.org/all/#/builders/45/builds/429

Killing any running python.exe instances...
...
C:\Program Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.CppClean.targets(74,5): warning : Access to the path 'd:\cygwin\home\db3l\buildarea\2.7.bolen-windows\build\PCBuild\python_d.exe' is denied. [d:\cygwin\home\db3l\buildarea\2.7.bolen-windows\build\PCbuild\python.vcxproj]

It's a debug build: it should kill python_d.exe, not python.exe.

--

PCbuild/pythoncore.vcxproj uses:

  <PropertyGroup>
    <MakeVersionInfoBeforeTarget>ClCompile</MakeVersionInfoBeforeTarget>
    <KillPython>true</KillPython>
  </PropertyGroup>

which comes from PCbuild/pyproject.vcxproj:

  <Target Name="KillPython" BeforeTargets="PrepareForBuild" Condition="'$(KillPython)' == 'true'">
    <Message Text="Killing any running python.exe instances..." Importance="high" />
    <KillPython FileName="$(OutDir)python$(PyDebugExt).exe" />
  </Target>

Problem: it seems like $(PyDebugExt) is not set to "_d" in PCbuild/pyproject.vcxproj.

Should PCbuild/pyproject.vcxproj explicitly import python.props which defines it?

    <!-- Suffix for all binaries when building for debug -->
    <PyDebugExt Condition="'$(PyDebugExt)' == '' and $(Configuration) == 'Debug'">_d</PyDebugExt>

Note: this issue is about Python 2.7.

----------
components: Build
messages: 346471
nosy: steve.dower, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
versions: Python 2.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:42:03 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 01:42:03 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561426923.57.0.934362257034.issue35224@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset b51b7137faa22e12c570c70fe0462c662ccd935e by Pablo Galindo in branch 'master':
bpo-35224: Add What's new entry for evaluation order in dict comprehensions (GH-14319)
https://github.com/python/cpython/commit/b51b7137faa22e12c570c70fe0462c662ccd935e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:42:12 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 01:42:12 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561426932.35.0.0871780534551.issue35224@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14178
pull_request: https://github.com/python/cpython/pull/14361

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:49:11 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 01:49:11 +0000
Subject: [issue35224] PEP 572: Assignment Expressions
In-Reply-To: <1542070337.94.0.788709270274.issue35224@psf.upfronthosting.co.za>
Message-ID: <1561427351.11.0.0453455538874.issue35224@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ced9e11931a7a1c5cf4eef08d0dd4a4886723b43 by Miss Islington (bot) in branch '3.8':
bpo-35224: Add What's new entry for evaluation order in dict comprehensions (GH-14319)
https://github.com/python/cpython/commit/ced9e11931a7a1c5cf4eef08d0dd4a4886723b43


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35224>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:53:40 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 01:53:40 +0000
Subject: [issue37394] Fix pure Python implementation of queue
In-Reply-To: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>
Message-ID: <1561427620.5.0.536847552747.issue37394@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14179
pull_request: https://github.com/python/cpython/pull/14362

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:53:46 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 01:53:46 +0000
Subject: [issue37394] Fix pure Python implementation of queue
In-Reply-To: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>
Message-ID: <1561427626.92.0.379064266218.issue37394@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 21:53:33 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 01:53:33 +0000
Subject: [issue37394] Fix pure Python implementation of queue
In-Reply-To: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>
Message-ID: <1561427613.12.0.723049920833.issue37394@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset 3f5b9088b0ed08e1442cca37df78f609d5cd8c3c by Pablo Galindo in branch 'master':
bpo-37394: Fix pure Python implementation of the queue module (GH-14351)
https://github.com/python/cpython/commit/3f5b9088b0ed08e1442cca37df78f609d5cd8c3c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:14:41 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 02:14:41 +0000
Subject: [issue37394] Fix pure Python implementation of queue
In-Reply-To: <1561424846.93.0.51562872877.issue37394@roundup.psfhosted.org>
Message-ID: <1561428881.33.0.129512607624.issue37394@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5bf3b89dfb57e705733851ec31131c985feeca62 by Miss Islington (bot) in branch '3.8':
bpo-37394: Fix pure Python implementation of the queue module (GH-14351)
https://github.com/python/cpython/commit/5bf3b89dfb57e705733851ec31131c985feeca62


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37394>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:16:14 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 25 Jun 2019 02:16:14 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1561428974.1.0.468914855063.issue36546@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
pull_requests: +14180
pull_request: https://github.com/python/cpython/pull/14363

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:29:17 2019
From: report at bugs.python.org (JOMO WILLACY)
Date: Tue, 25 Jun 2019 02:29:17 +0000
Subject: [issue37397] Trap in Python 3.5 under Apache 2.2 when Django database
 returns 'None'.
Message-ID: <1561429757.65.0.591916944081.issue37397@roundup.psfhosted.org>


New submission from JOMO WILLACY <JOMO_WILLACY at HOTMAIL.COM>:

I am using Python 3.5 with Django and the Python web server and Apache 2.2 web server.
I am querying the database for a "drug_name" and an "insurer" - # and minimum "price".

Here is what works and what does not work

Valid Drug Name   Valid Insurer     Works    Python web Server  Apache

Epipen               2               Yes        Yes               Yes

Lisenopril           2               Yes        Yes               Yes

Naftin               7               Yes        Yes               Yes



Invalid Drug Name    Insurer          Works     Python Server   Apache

Licenopril                            Yes        Yes              Yes

Licenopril             2                         Yes              No


In the last case up above it traps and the server logs at /var/www/logs/error.log say "Unhandled Exception".

This is where it traps ans what it says :

 Cannot convert str to float  :  'None'

File "/usr/local/lib64/python3.5/site-packages/django/db/models/fields/__init__.py"  line 1747, in get_prep_value

   return float( output_value )


I then went into the file where the trap occurred and I added a try catch like the function after line 1747 and the problem went away.

The trap only happens under Apache.

If you wish to reproduce this problem then go to these links and try the input listed above :

Python Web Server :

   http://34.200.216.166:8000/health_insurer2/minimum_price_for_drug/


Apache Web Server :

   http://34.200.216.166/health_insurer2/minimum_price_for_drug/


As an aid I have left debug=on in django so you will be able to trace the trap in the browser

The file that I am running is views.py
I am running Amazon AMI Linux in the cloud.


Sincerely Yours,


Jomo Willacy

----------
messages: 346476
nosy: jomo_willacy at hotmail.com
priority: normal
severity: normal
status: open
title: Trap in Python 3.5 under Apache 2.2 when Django database returns 'None'.
type: crash
versions: Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37397>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:38:15 2019
From: report at bugs.python.org (Zachary Ware)
Date: Tue, 25 Jun 2019 02:38:15 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561430295.45.0.428011412524.issue37396@roundup.psfhosted.org>


Zachary Ware <zachary.ware at gmail.com> added the comment:

How can you tell that $(PyDebugExt) is not set?  Note that the "Killing any running python.exe instances..." line is hard-coded, it does not currently include $(PyDebugExt) (though it probably should).  Adding that to the message would be a good first step; backporting GH-9901 to 2.7 would probably also be good even though it was solving a different issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:39:25 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 25 Jun 2019 02:39:25 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1561430365.55.0.169590629751.issue36546@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 1791128677e71f3b93cae4bbed66ac3c6e4b5110 by Raymond Hettinger in branch 'master':
 bpo-36546: Mark first argument as position only (GH-14363)
https://github.com/python/cpython/commit/1791128677e71f3b93cae4bbed66ac3c6e4b5110


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:39:33 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 02:39:33 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1561430373.37.0.0607105908035.issue36546@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14181
pull_request: https://github.com/python/cpython/pull/14364

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:53:11 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 02:53:11 +0000
Subject: [issue37397] Trap in Python 3.5 under Apache 2.2 when Django database
 returns 'None'.
In-Reply-To: <1561429757.65.0.591916944081.issue37397@roundup.psfhosted.org>
Message-ID: <1561431191.5.0.497601386692.issue37397@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This tracker deals with CPython development and this doesn't seem like am issue in CPython but rather an error in your program. I assume you might be passing None somewhere in the django ORM query that is expecting a number. Also please don't post open web server endpoints with debug mode on. The debug server is not meant to be exposed to the internet. This question could find better answer from stackoverflow.

----------
nosy: +xtreak
resolution:  -> third party
stage:  -> resolved
status: open -> closed
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37397>
_______________________________________

From report at bugs.python.org  Mon Jun 24 22:59:18 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Tue, 25 Jun 2019 02:59:18 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561431558.53.0.444274782686.issue37391@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

For future reference: an exception is not a crash.  A crash is a core dump or the Mac equivalent.

Anyway, I also cannot reproduce with Python.org python on my Macbook.
  python 3.7.3(v3.7.3:ef4e...) Mar 25, 2019 16:52:21
  Clang 6.0 (...) on Darwin
Where did you get your Python installer?  Did it include tck/tk?  If not, perhaps python3.exe and the tcl/tk being used do not match.

Does IDLE work at all?  Can you click Help and About IDLE?  If so, what is the tk version? 

I used the pad to move the cursor over the scrollbar slider, held my left finger down on the left side of the pad, and moved the slider and file display with my right finger.  Is this what you did?

>From the traceback it appears that the exception occurred in the C code of  _tkinter or more likely, the C code of tcl/tk, before any of IDLE's python-coded event handlers are called.  Hence, Ned's comment.

----------
assignee: terry.reedy -> 
components: +Tkinter -IDLE
type: crash -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Mon Jun 24 23:07:03 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Tue, 25 Jun 2019 03:07:03 +0000
Subject: [issue36546] Add quantiles() to the statistics module
In-Reply-To: <1554585736.61.0.903931747573.issue36546@roundup.psfhosted.org>
Message-ID: <1561432023.63.0.13212584341.issue36546@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:


New changeset 210358b25cf6425c81a341a074be6cd897c2d43d by Raymond Hettinger (Miss Islington (bot)) in branch '3.8':
bpo-36546: Mark first argument as position only (GH-14363) (GH-14364)
https://github.com/python/cpython/commit/210358b25cf6425c81a341a074be6cd897c2d43d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36546>
_______________________________________

From report at bugs.python.org  Tue Jun 25 00:26:47 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 25 Jun 2019 04:26:47 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561436807.83.0.46447547983.issue37391@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Hi George,

What language and encoding are you using on your system? Are you using UTF-16?

I haven't been able to reproduce this on my Mac Mojave with an Anaconda Python 3.7.3 install.

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 00:33:19 2019
From: report at bugs.python.org (Jelle Zijlstra)
Date: Tue, 25 Jun 2019 04:33:19 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561437199.9.0.145371119071.issue37384@roundup.psfhosted.org>


Jelle Zijlstra <jelle.zijlstra at gmail.com> added the comment:

As Ned and Christian hinted, the issue might be related to --enable-optimizations. Have you tried compiling without that flag?

----------
nosy: +Jelle Zijlstra

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Tue Jun 25 00:39:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 04:39:29 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561437569.38.0.00708472650572.issue37392@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +14182
pull_request: https://github.com/python/cpython/pull/14365

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Tue Jun 25 01:10:58 2019
From: report at bugs.python.org (Eryk)
Date: Tue, 25 Jun 2019 05:10:58 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561439458.59.0.591249442888.issue37384@roundup.psfhosted.org>


Eryk <eryklok at gmail.com> added the comment:

root at Debza:/home/anubis/Python-3.7.3# ./configure --enable-optimizations
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking for python3.7... python3.7
checking for --enable-universalsdk... no
checking for --with-universal-archs... no
checking MACHDEP... checking for --without-gcc... no
checking for --with-icc... no
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking how to run the C preprocessor... gcc -E
checking for grep that handles long lines and -e... /bin/grep
checking for a sed that does not truncate output... /bin/sed
checking for --with-cxx-main=<compiler>... no
checking for g++... no
configure:

  By default, distutils will build C++ extension modules with "g++".
  If this is not intended, then set CXX on the configure command line.
  
checking for the platform triplet based on compiler characteristics... x86_64-linux-gnu
checking for -Wl,--no-as-needed... yes
checking for egrep... /bin/grep -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking minix/config.h usability... no
checking minix/config.h presence... no
checking for minix/config.h... no
checking whether it is safe to define __EXTENSIONS__... yes
checking for the Android API level... not Android
checking for --with-suffix... 
checking for case-insensitive build directory... no
checking LIBRARY... libpython$(VERSION)$(ABIFLAGS).a
checking LINKCC... $(PURIFY) $(MAINCC)
checking for GNU ld... yes
checking for --enable-shared... no
checking for --enable-profiling... no
checking LDLIBRARY... libpython$(VERSION)$(ABIFLAGS).a
checking for ar... ar
checking for readelf... readelf
checking for a BSD-compatible install... /usr/bin/install -c
checking for a thread-safe mkdir -p... /bin/mkdir -p
checking for --with-pydebug... no
checking for --with-assertions... no
checking for --enable-optimizations... yes
checking for --with-lto... no
checking for -llvm-profdata... no
checking for -Wextra... yes
checking whether gcc accepts and needs -fno-strict-aliasing... no
checking if we can turn off gcc unused result warning... yes
checking if we can turn off gcc unused parameter warning... yes
checking if we can turn off gcc missing field initializers warning... yes
checking if we can turn off gcc invalid function cast warning... no
checking if we can turn on gcc mixed sign comparison warning... yes
checking if we can turn on gcc unreachable code warning... no
checking if we can turn on gcc strict-prototypes warning... no
checking if we can make implicit function declaration an error in gcc... yes
checking whether pthreads are available without options... no
checking whether gcc accepts -Kpthread... no
checking whether gcc accepts -Kthread... no
checking whether gcc accepts -pthread... yes
checking whether g++ also accepts flags for thread support... yes
checking for ANSI C header files... (cached) yes
checking asm/types.h usability... yes
checking asm/types.h presence... yes
checking for asm/types.h... yes
checking crypt.h usability... yes
checking crypt.h presence... yes
checking for crypt.h... yes
checking conio.h usability... no
checking conio.h presence... no
checking for conio.h... no
checking direct.h usability... no
checking direct.h presence... no
checking for direct.h... no
checking dlfcn.h usability... yes
checking dlfcn.h presence... yes
checking for dlfcn.h... yes
checking errno.h usability... yes
checking errno.h presence... yes
checking for errno.h... yes
checking fcntl.h usability... yes
checking fcntl.h presence... yes
checking for fcntl.h... yes
checking grp.h usability... yes
checking grp.h presence... yes
checking for grp.h... yes
checking ieeefp.h usability... no
checking ieeefp.h presence... no
checking for ieeefp.h... no
checking io.h usability... no
checking io.h presence... no
checking for io.h... no
checking langinfo.h usability... yes
checking langinfo.h presence... yes
checking for langinfo.h... yes
checking libintl.h usability... yes
checking libintl.h presence... yes
checking for libintl.h... yes
checking process.h usability... no
checking process.h presence... no
checking for process.h... no
checking pthread.h usability... yes
checking pthread.h presence... yes
checking for pthread.h... yes
checking sched.h usability... yes
checking sched.h presence... yes
checking for sched.h... yes
checking shadow.h usability... yes
checking shadow.h presence... yes
checking for shadow.h... yes
checking signal.h usability... yes
checking signal.h presence... yes
checking for signal.h... yes
checking stropts.h usability... yes
checking stropts.h presence... yes
checking for stropts.h... yes
checking termios.h usability... yes
checking termios.h presence... yes
checking for termios.h... yes
checking for unistd.h... (cached) yes
checking utime.h usability... yes
checking utime.h presence... yes
checking for utime.h... yes
checking poll.h usability... yes
checking poll.h presence... yes
checking for poll.h... yes
checking sys/devpoll.h usability... no
checking sys/devpoll.h presence... no
checking for sys/devpoll.h... no
checking sys/epoll.h usability... yes
checking sys/epoll.h presence... yes
checking for sys/epoll.h... yes
checking sys/poll.h usability... yes
checking sys/poll.h presence... yes
checking for sys/poll.h... yes
checking sys/audioio.h usability... no
checking sys/audioio.h presence... no
checking for sys/audioio.h... no
checking sys/xattr.h usability... yes
checking sys/xattr.h presence... yes
checking for sys/xattr.h... yes
checking sys/bsdtty.h usability... no
checking sys/bsdtty.h presence... no
checking for sys/bsdtty.h... no
checking sys/event.h usability... no
checking sys/event.h presence... no
checking for sys/event.h... no
checking sys/file.h usability... yes
checking sys/file.h presence... yes
checking for sys/file.h... yes
checking sys/ioctl.h usability... yes
checking sys/ioctl.h presence... yes
checking for sys/ioctl.h... yes
checking sys/kern_control.h usability... no
checking sys/kern_control.h presence... no
checking for sys/kern_control.h... no
checking sys/loadavg.h usability... no
checking sys/loadavg.h presence... no
checking for sys/loadavg.h... no
checking sys/lock.h usability... no
checking sys/lock.h presence... no
checking for sys/lock.h... no
checking sys/mkdev.h usability... no
checking sys/mkdev.h presence... no
checking for sys/mkdev.h... no
checking sys/modem.h usability... no
checking sys/modem.h presence... no
checking for sys/modem.h... no
checking sys/param.h usability... yes
checking sys/param.h presence... yes
checking for sys/param.h... yes
checking sys/random.h usability... no
checking sys/random.h presence... no
checking for sys/random.h... no
checking sys/select.h usability... yes
checking sys/select.h presence... yes
checking for sys/select.h... yes
checking sys/sendfile.h usability... yes
checking sys/sendfile.h presence... yes
checking for sys/sendfile.h... yes
checking sys/socket.h usability... yes
checking sys/socket.h presence... yes
checking for sys/socket.h... yes
checking sys/statvfs.h usability... yes
checking sys/statvfs.h presence... yes
checking for sys/statvfs.h... yes
checking for sys/stat.h... (cached) yes
checking sys/syscall.h usability... yes
checking sys/syscall.h presence... yes
checking for sys/syscall.h... yes
checking sys/sys_domain.h usability... no
checking sys/sys_domain.h presence... no
checking for sys/sys_domain.h... no
checking sys/termio.h usability... no
checking sys/termio.h presence... no
checking for sys/termio.h... no
checking sys/time.h usability... yes
checking sys/time.h presence... yes
checking for sys/time.h... yes
checking sys/times.h usability... yes
checking sys/times.h presence... yes
checking for sys/times.h... yes
checking for sys/types.h... (cached) yes
checking sys/uio.h usability... yes
checking sys/uio.h presence... yes
checking for sys/uio.h... yes
checking sys/un.h usability... yes
checking sys/un.h presence... yes
checking for sys/un.h... yes
checking sys/utsname.h usability... yes
checking sys/utsname.h presence... yes
checking for sys/utsname.h... yes
checking sys/wait.h usability... yes
checking sys/wait.h presence... yes
checking for sys/wait.h... yes
checking pty.h usability... yes
checking pty.h presence... yes
checking for pty.h... yes
checking libutil.h usability... no
checking libutil.h presence... no
checking for libutil.h... no
checking sys/resource.h usability... yes
checking sys/resource.h presence... yes
checking for sys/resource.h... yes
checking netpacket/packet.h usability... yes
checking netpacket/packet.h presence... yes
checking for netpacket/packet.h... yes
checking sysexits.h usability... yes
checking sysexits.h presence... yes
checking for sysexits.h... yes
checking bluetooth.h usability... no
checking bluetooth.h presence... no
checking for bluetooth.h... no
checking linux/tipc.h usability... yes
checking linux/tipc.h presence... yes
checking for linux/tipc.h... yes
checking linux/random.h usability... yes
checking linux/random.h presence... yes
checking for linux/random.h... yes
checking spawn.h usability... yes
checking spawn.h presence... yes
checking for spawn.h... yes
checking util.h usability... no
checking util.h presence... no
checking for util.h... no
checking alloca.h usability... yes
checking alloca.h presence... yes
checking for alloca.h... yes
checking endian.h usability... yes
checking endian.h presence... yes
checking for endian.h... yes
checking sys/endian.h usability... no
checking sys/endian.h presence... no
checking for sys/endian.h... no
checking sys/sysmacros.h usability... yes
checking sys/sysmacros.h presence... yes
checking for sys/sysmacros.h... yes
checking for dirent.h that defines DIR... yes
checking for library containing opendir... none required
checking whether sys/types.h defines makedev... yes
checking bluetooth/bluetooth.h usability... no
checking bluetooth/bluetooth.h presence... no
checking for bluetooth/bluetooth.h... no
checking for net/if.h... yes
checking for linux/netlink.h... yes
checking for linux/vm_sockets.h... yes
checking for linux/can.h... yes
checking for linux/can/raw.h... yes
checking for linux/can/bcm.h... yes
checking for clock_t in time.h... yes
checking for makedev... yes
checking for le64toh... yes
checking for mode_t... yes
checking for off_t... yes
checking for pid_t... yes
checking for size_t... yes
checking for uid_t in sys/types.h... yes
checking for ssize_t... yes
checking for __uint128_t... yes
checking size of int... 4
checking size of long... 8
checking size of long long... 8
checking size of void *... 8
checking size of short... 2
checking size of float... 4
checking size of double... 8
checking size of fpos_t... 16
checking size of size_t... 8
checking size of pid_t... 4
checking size of uintptr_t... 8
checking for long double support... yes
checking size of long double... 16
checking size of _Bool... 1
checking size of off_t... 8
checking whether to enable large file support... no
checking size of time_t... 8
checking for pthread_t... yes
checking size of pthread_t... 8
checking size of pthread_key_t... 4
checking whether pthread_key_t is compatible with int... yes
checking for --enable-framework... no
checking for dyld... no
checking the extension of shared libraries... .so
checking LDSHARED... $(CC) -shared
checking CCSHARED... -fPIC
checking LINKFORSHARED... -Xlinker -export-dynamic
checking CFLAGSFORSHARED... 
checking SHLIBS... $(LIBS)
checking for sendfile in -lsendfile... no
checking for dlopen in -ldl... yes
checking for shl_load in -ldld... no
checking uuid/uuid.h usability... yes
checking uuid/uuid.h presence... yes
checking for uuid/uuid.h... yes
checking uuid.h usability... no
checking uuid.h presence... no
checking for uuid.h... no
checking for uuid_generate_time_safe... yes
checking for uuid_create... no
checking for uuid_enc_be... no
checking for library containing sem_init... -lpthread
checking for textdomain in -lintl... no
checking aligned memory access is required... no
checking for --with-hash-algorithm... default
checking for --with-address-sanitizer... no
checking for --with-memory-sanitizer... no
checking for --with-undefined-behavior-sanitizer... no
checking for t_open in -lnsl... no
checking for socket in -lsocket... no
checking for --with-libs... no
checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for --with-system-expat... no
checking for --with-system-ffi... yes
checking for --with-system-libmpdec... no
checking for --enable-loadable-sqlite-extensions... no
checking for --with-tcltk-includes... default
checking for --with-tcltk-libs... default
checking for --with-dbmliborder... 
checking if PTHREAD_SCOPE_SYSTEM is supported... yes
checking for pthread_sigmask... yes
checking for pthread_getcpuclockid... yes
checking if --enable-ipv6 is specified... yes
checking if RFC2553 API is available... yes
checking ipv6 stack type... linux-glibc
checking for CAN_RAW_FD_FRAMES... yes
checking for --with-doc-strings... yes
checking for --with-pymalloc... yes
checking for --with-c-locale-coercion... yes
checking for --with-valgrind... no
checking for --with-dtrace... no
checking for dlopen... yes
checking DYNLOADFILE... dynload_shlib.o
checking MACHDEP_OBJS... none
checking for alarm... yes
checking for accept4... yes
checking for setitimer... yes
checking for getitimer... yes
checking for bind_textdomain_codeset... yes
checking for chown... yes
checking for clock... yes
checking for confstr... yes
checking for ctermid... yes
checking for dup3... yes
checking for execv... yes
checking for faccessat... yes
checking for fchmod... yes
checking for fchmodat... yes
checking for fchown... yes
checking for fchownat... yes
checking for fexecve... yes
checking for fdopendir... yes
checking for fork... yes
checking for fpathconf... yes
checking for fstatat... yes
checking for ftime... yes
checking for ftruncate... yes
checking for futimesat... yes
checking for futimens... yes
checking for futimes... yes
checking for gai_strerror... yes
checking for getentropy... no
checking for getgrouplist... yes
checking for getgroups... yes
checking for getlogin... yes
checking for getloadavg... yes
checking for getpeername... yes
checking for getpgid... yes
checking for getpid... yes
checking for getpriority... yes
checking for getresuid... yes
checking for getresgid... yes
checking for getpwent... yes
checking for getspnam... yes
checking for getspent... yes
checking for getsid... yes
checking for getwd... yes
checking for if_nameindex... yes
checking for initgroups... yes
checking for kill... yes
checking for killpg... yes
checking for lchown... yes
checking for lockf... yes
checking for linkat... yes
checking for lstat... yes
checking for lutimes... yes
checking for mmap... yes
checking for memrchr... yes
checking for mbrtowc... yes
checking for mkdirat... yes
checking for mkfifo... yes
checking for mkfifoat... yes
checking for mknod... yes
checking for mknodat... yes
checking for mktime... yes
checking for mremap... yes
checking for nice... yes
checking for openat... yes
checking for pathconf... yes
checking for pause... yes
checking for pipe2... yes
checking for plock... no
checking for poll... yes
checking for posix_fallocate... yes
checking for posix_fadvise... yes
checking for posix_spawn... yes
checking for pread... yes
checking for preadv... yes
checking for preadv2... no
checking for pthread_init... no
checking for pthread_kill... yes
checking for putenv... yes
checking for pwrite... yes
checking for pwritev... yes
checking for pwritev2... no
checking for readlink... yes
checking for readlinkat... yes
checking for readv... yes
checking for realpath... yes
checking for renameat... yes
checking for sem_open... yes
checking for sem_timedwait... yes
checking for sem_getvalue... yes
checking for sem_unlink... yes
checking for sendfile... yes
checking for setegid... yes
checking for seteuid... yes
checking for setgid... yes
checking for sethostname... yes
checking for setlocale... yes
checking for setregid... yes
checking for setreuid... yes
checking for setresuid... yes
checking for setresgid... yes
checking for setsid... yes
checking for setpgid... yes
checking for setpgrp... yes
checking for setpriority... yes
checking for setuid... yes
checking for setvbuf... yes
checking for sched_get_priority_max... yes
checking for sched_setaffinity... yes
checking for sched_setscheduler... yes
checking for sched_setparam... yes
checking for sched_rr_get_interval... yes
checking for sigaction... yes
checking for sigaltstack... yes
checking for siginterrupt... yes
checking for sigpending... yes
checking for sigrelse... yes
checking for sigtimedwait... yes
checking for sigwait... yes
checking for sigwaitinfo... yes
checking for snprintf... yes
checking for strftime... yes
checking for strlcpy... no
checking for symlinkat... yes
checking for sync... yes
checking for sysconf... yes
checking for tcgetpgrp... yes
checking for tcsetpgrp... yes
checking for tempnam... yes
checking for timegm... yes
checking for times... yes
checking for tmpfile... yes
checking for tmpnam... yes
checking for tmpnam_r... yes
checking for truncate... yes
checking for uname... yes
checking for unlinkat... yes
checking for unsetenv... yes
checking for utimensat... yes
checking for utimes... yes
checking for waitid... yes
checking for waitpid... yes
checking for wait3... yes
checking for wait4... yes
checking for wcscoll... yes
checking for wcsftime... yes
checking for wcsxfrm... yes
checking for wmemcmp... yes
checking for writev... yes
checking for _getpty... no
checking whether dirfd is declared... yes
checking for chroot... yes
checking for link... yes
checking for symlink... yes
checking for fchdir... yes
checking for fsync... yes
checking for fdatasync... yes
checking for epoll... yes
checking for epoll_create1... yes
checking for kqueue... no
checking for prlimit... yes
checking for ctermid_r... no
checking for flock declaration... yes
checking for flock... yes
checking for getpagesize... yes
checking for broken unsetenv... no
checking for true... true
checking for inet_aton in -lc... yes
checking for chflags... no
checking for lchflags... no
checking for inflateCopy in -lz... yes
checking for hstrerror... yes
checking for inet_aton... yes
checking for inet_pton... yes
checking for setgroups... yes
checking for openpty... no
checking for openpty in -lutil... yes
checking for forkpty... yes
checking for fseek64... no
checking for fseeko... yes
checking for fstatvfs... yes
checking for ftell64... no
checking for ftello... yes
checking for statvfs... yes
checking for dup2... yes
checking for strdup... yes
checking for getpgrp... yes
checking for setpgrp... (cached) yes
checking for gettimeofday... yes
checking for library containing crypt... -lcrypt
checking for library containing crypt_r... none required
checking for crypt_r... yes
checking for clock_gettime... yes
checking for clock_getres... yes
checking for clock_settime... yes
checking for major... yes
checking for getaddrinfo... yes
checking getaddrinfo bug... no
checking for getnameinfo... yes
checking whether time.h and sys/time.h may both be included... yes
checking whether struct tm is in sys/time.h or time.h... time.h
checking for struct tm.tm_zone... yes
checking for struct stat.st_rdev... yes
checking for struct stat.st_blksize... yes
checking for struct stat.st_flags... no
checking for struct stat.st_gen... no
checking for struct stat.st_birthtime... no
checking for struct stat.st_blocks... yes
checking for struct passwd.pw_gecos... yes
checking for struct passwd.pw_passwd... yes
checking for siginfo_t.si_band... yes
checking for time.h that defines altzone... no
checking whether sys/select.h and sys/time.h may both be included... yes
checking for addrinfo... yes
checking for sockaddr_storage... yes
checking for sockaddr_alg... yes
checking whether char is unsigned... no
checking for an ANSI C-conforming const... yes
checking for working signed char... yes
checking for prototypes... yes
checking for variable length prototypes and stdarg.h... yes
checking for socketpair... yes
checking if sockaddr has sa_len member... no
checking for gethostbyname_r... yes
checking gethostbyname_r with 6 args... yes
checking for __fpu_control... yes
checking for --with-libm=STRING... default LIBM="-lm"
checking for --with-libc=STRING... default LIBC=""
checking for x64 gcc inline assembler... yes
checking whether C doubles are little-endian IEEE 754 binary64... yes
checking whether C doubles are big-endian IEEE 754 binary64... no
checking whether C doubles are ARM mixed-endian IEEE 754 binary64... no
checking whether we can use gcc inline assembler to get and set x87 control word... yes
checking whether we can use gcc inline assembler to get and set mc68881 fpcr... no
checking for x87-style double rounding... no
checking for acosh... yes
checking for asinh... yes
checking for atanh... yes
checking for copysign... yes
checking for erf... yes
checking for erfc... yes
checking for expm1... yes
checking for finite... yes
checking for gamma... yes
checking for hypot... yes
checking for lgamma... yes
checking for log1p... yes
checking for log2... yes
checking for round... yes
checking for tgamma... yes
checking whether isinf is declared... yes
checking whether isnan is declared... yes
checking whether isfinite is declared... yes
checking whether tanh preserves the sign of zero... yes
checking whether log1p drops the sign of negative zero... no
checking whether POSIX semaphores are enabled... yes
checking for broken sem_getvalue... no
checking whether RTLD_LAZY is declared... yes
checking whether RTLD_NOW is declared... yes
checking whether RTLD_GLOBAL is declared... yes
checking whether RTLD_LOCAL is declared... yes
checking whether RTLD_NODELETE is declared... yes
checking whether RTLD_NOLOAD is declared... yes
checking whether RTLD_DEEPBIND is declared... yes
checking whether RTLD_MEMBER is declared... no
checking digit size for Python's longs... no value specified
checking wchar.h usability... yes
checking wchar.h presence... yes
checking for wchar.h... yes
checking size of wchar_t... 4
checking for UCS-4 tcl... no
checking whether wchar_t is signed... yes
checking whether wchar_t is usable... no
checking whether byte ordering is bigendian... no
checking ABIFLAGS... m
checking SOABI... cpython-37m-x86_64-linux-gnu
checking LDVERSION... $(VERSION)$(ABIFLAGS)
checking whether right shift extends the sign bit... yes
checking for getc_unlocked() and friends... yes
checking how to link readline libs... -lreadline
checking for rl_pre_input_hook in -lreadline... yes
checking for rl_completion_display_matches_hook in -lreadline... yes
checking for rl_resize_terminal in -lreadline... yes
checking for rl_completion_matches in -lreadline... yes
checking for append_history in -lreadline... yes
checking for broken nice()... no
checking for broken poll()... no
checking for working tzset()... yes
checking for tv_nsec in struct stat... yes
checking for tv_nsec2 in struct stat... no
checking curses.h usability... yes
checking curses.h presence... yes
checking for curses.h... yes
checking ncurses.h usability... yes
checking ncurses.h presence... yes
checking for ncurses.h... yes
checking for term.h... yes
checking whether mvwdelch is an expression... yes
checking whether WINDOW has _flags... yes
checking for is_pad... yes
checking for is_term_resized... yes
checking for resize_term... yes
checking for resizeterm... yes
checking for immedok... yes
checking for syncok... yes
checking for wchgat... yes
checking for filter... yes
checking for has_key... yes
checking for typeahead... yes
checking for use_env... yes
configure: checking for device files
checking for /dev/ptmx... yes
checking for /dev/ptc... no
checking for %zd printf() format support... yes
checking for socklen_t... yes
checking for broken mbstowcs... no
checking for --with-computed-gotos... no value specified
checking whether gcc -pthread supports computed gotos... yes
checking for build directories... done
checking for -O2... yes
checking for glibc _FORTIFY_SOURCE/memmove bug... no
checking for gcc ipa-pure-const bug... no
checking for stdatomic.h... yes
checking for GCC >= 4.7 __atomic builtins... yes
checking for ensurepip... upgrade
checking if the dirent structure of a d_type field... yes
checking for the Linux getrandom() syscall... yes
checking for the getrandom() function... no
checking for pkg-config... /usr/bin/pkg-config
checking whether compiling and linking against OpenSSL works... yes
checking for X509_VERIFY_PARAM_set1_host in libssl... yes
checking for --with-ssl-default-suites... python
configure: creating ./config.status
config.status: creating Makefile.pre
config.status: creating Misc/python.pc
config.status: creating Misc/python-config.sh
config.status: creating Modules/ld_so_aix
config.status: creating pyconfig.h
config.status: pyconfig.h is unchanged
creating Modules/Setup
creating Modules/Setup.local
creating Makefile
root at Debza:/home/anubis/Python-3.7.3# make -j 4
Rebuilding with profile guided optimizations:
rm -f profile-clean-stamp
make build_all CFLAGS_NODIST=" -fprofile-use -fprofile-correction" LDFLAGS_NODIST=""
make[1]: Entering directory '/home/anubis/Python-3.7.3'
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall    -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction  -I. -I./Include    -DPy_BUILD_CORE \
	-DABIFLAGS='"m"' \
	-DMULTIARCH=\"x86_64-linux-gnu\" \
	-o Python/sysmodule.o ./Python/sysmodule.c
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall    -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction  -I. -I./Include    -DPy_BUILD_CORE \
	-DSOABI='"cpython-37m-x86_64-linux-gnu"' \
	-o Python/dynload_shlib.o ./Python/dynload_shlib.c
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall    -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction  -I. -I./Include    -DPy_BUILD_CORE -o Modules/config.o Modules/config.c
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall    -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction  -I. -I./Include    -DPy_BUILD_CORE -DPYTHONPATH='""' \
	-DPREFIX='"/usr/local"' \
	-DEXEC_PREFIX='"/usr/local"' \
	-DVERSION='"3.7"' \
	-DVPATH='""' \
	-o Modules/getpath.o ./Modules/getpath.c
sed -e "s, at EXENAME@,/usr/local/bin/python3.7m," < ./Misc/python-config.in >python-config.py
LC_ALL=C sed -e 's,\$(\([A-Za-z0-9_]*\)),\$\{\1\},g' < Misc/python-config.sh >python-config
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall    -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Werror=implicit-function-declaration -fprofile-use -fprofile-correction  -I. -I./Include    -DPy_BUILD_CORE \
      -DGITVERSION="\"`LC_ALL=C `\"" \
      -DGITTAG="\"`LC_ALL=C `\"" \
      -DGITBRANCH="\"`LC_ALL=C `\"" \
      -o Modules/getbuildinfo.o ./Modules/getbuildinfo.c
rm -f libpython3.7m.a
ar rcs libpython3.7m.a Modules/getbuildinfo.o Parser/acceler.o Parser/grammar1.o Parser/listnode.o Parser/node.o Parser/parser.o Parser/bitset.o Parser/metagrammar.o Parser/firstsets.o Parser/grammar.o Parser/pgen.o Parser/myreadline.o Parser/parsetok.o Parser/tokenizer.o Objects/abstract.o Objects/accu.o Objects/boolobject.o Objects/bytes_methods.o Objects/bytearrayobject.o Objects/bytesobject.o Objects/call.o Objects/cellobject.o Objects/classobject.o Objects/codeobject.o Objects/complexobject.o Objects/descrobject.o Objects/enumobject.o Objects/exceptions.o Objects/genobject.o Objects/fileobject.o Objects/floatobject.o Objects/frameobject.o Objects/funcobject.o Objects/iterobject.o Objects/listobject.o Objects/longobject.o Objects/dictobject.o Objects/odictobject.o Objects/memoryobject.o Objects/methodobject.o Objects/moduleobject.o Objects/namespaceobject.o Objects/object.o Objects/obmalloc.o Objects/capsule.o Objects/rangeobject.o Objects/setobject.o Objects/sliceobject.o Objects/structseq.o Objects/tupleobject.o Objects/typeobject.o Objects/unicodeobject.o Objects/unicodectype.o Objects/weakrefobject.o Python/_warnings.o Python/Python-ast.o Python/asdl.o Python/ast.o Python/ast_opt.o Python/ast_unparse.o Python/bltinmodule.o Python/ceval.o Python/compile.o Python/codecs.o Python/dynamic_annotations.o Python/errors.o Python/frozenmain.o Python/future.o Python/getargs.o Python/getcompiler.o Python/getcopyright.o Python/getplatform.o Python/getversion.o Python/graminit.o Python/import.o Python/importdl.o Python/marshal.o Python/modsupport.o Python/mysnprintf.o Python/mystrtoul.o Python/pathconfig.o Python/peephole.o Python/pyarena.o Python/pyctype.o Python/pyfpe.o Python/pyhash.o Python/pylifecycle.o Python/pymath.o Python/pystate.o Python/context.o Python/hamt.o Python/pythonrun.o Python/pytime.o Python/bootstrap_hash.o Python/structmember.o Python/symtable.o Python/sysmodule.o Python/thread.o Python/traceback.o Python/getopt.o Python/pystrcmp.o Python/pystrtod.o Python/pystrhex.o Python/dtoa.o Python/formatter_unicode.o Python/fileutils.o Python/dynload_shlib.o    Modules/config.o Modules/getpath.o Modules/main.o Modules/gcmodule.o Modules/posixmodule.o  Modules/errnomodule.o  Modules/pwdmodule.o  Modules/_sre.o  Modules/_codecsmodule.o  Modules/_weakref.o  Modules/_functoolsmodule.o  Modules/_operator.o  Modules/_collectionsmodule.o  Modules/_abc.o  Modules/itertoolsmodule.o  Modules/atexitmodule.o  Modules/signalmodule.o  Modules/_stat.o  Modules/timemodule.o  Modules/_threadmodule.o  Modules/_localemodule.o  Modules/_iomodule.o Modules/iobase.o Modules/fileio.o Modules/bytesio.o Modules/bufferedio.o Modules/textio.o Modules/stringio.o  Modules/zipimport.o  Modules/faulthandler.o  Modules/_tracemalloc.o Modules/hashtable.o  Modules/symtablemodule.o  Modules/xxsubtype.o Python/frozen.o
gcc -pthread     -Xlinker -export-dynamic -o python Programs/python.o libpython3.7m.a -lcrypt -lpthread -ldl  -lutil   -lm  
gcc -pthread     -Xlinker -export-dynamic -o Programs/_testembed Programs/_testembed.o libpython3.7m.a -lcrypt -lpthread -ldl  -lutil   -lm  
./python -E -S -m sysconfig --generate-posix-vars ;\
if test $? -ne 0 ; then \
	echo "generate-posix-vars failed" ; \
	rm -f ./pybuilddir.txt ; \
	exit 1 ; \
fi
 CC='gcc -pthread' LDSHARED='gcc -pthread -shared    ' OPT='-DNDEBUG -g -fwrapv -O3 -Wall' 	_TCLTK_INCLUDES='' _TCLTK_LIBS='' 	./python -E ./setup.py  build
running build
running build_ext

The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
_abc                  atexit                pwd                
time                                                           

running build_scripts
copying and adjusting /home/anubis/Python-3.7.3/Tools/scripts/pydoc3 -> build/scripts-3.7
copying and adjusting /home/anubis/Python-3.7.3/Tools/scripts/idle3 -> build/scripts-3.7
copying and adjusting /home/anubis/Python-3.7.3/Tools/scripts/2to3 -> build/scripts-3.7
copying and adjusting /home/anubis/Python-3.7.3/Tools/scripts/pyvenv -> build/scripts-3.7
changing mode of build/scripts-3.7/pydoc3 from 644 to 755
changing mode of build/scripts-3.7/idle3 from 644 to 755
changing mode of build/scripts-3.7/2to3 from 644 to 755
changing mode of build/scripts-3.7/pyvenv from 644 to 755
renaming build/scripts-3.7/pydoc3 to build/scripts-3.7/pydoc3.7
renaming build/scripts-3.7/idle3 to build/scripts-3.7/idle3.7
renaming build/scripts-3.7/2to3 to build/scripts-3.7/2to3-3.7
renaming build/scripts-3.7/pyvenv to build/scripts-3.7/pyvenv-3.7
make[1]: Leaving directory '/home/anubis/Python-3.7.3

I believe it mysteriously solved itself, maybe the comp. restart?
Does this seem like no errors and everything optional installed?
Anyhow all your replies are much appreciated :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Tue Jun 25 02:50:01 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 06:50:01 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561445401.14.0.868777637536.issue37393@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14183
pull_request: https://github.com/python/cpython/pull/14366

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 02:50:03 2019
From: report at bugs.python.org (John Belmonte)
Date: Tue, 25 Jun 2019 06:50:03 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
Message-ID: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>


New submission from John Belmonte <john at neggie.net>:

A case came up where I'd like a non-async context manager to be able to decorate both regular and async functions.  I wonder why contextlib.ContextDecorator doesn't just support both cases.

The implementation seems straightforward, switching on iscoroutinefunction().

----------
components: Library (Lib)
messages: 346485
nosy: John Belmonte
priority: normal
severity: normal
status: open
title: contextlib.ContextDecorator decorating async functions
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 02:50:08 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 06:50:08 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561445408.19.0.0564946958587.issue37393@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 9fe42b49c79c453d905d0395150ba0607fbab18b by Serhiy Storchaka (Zackery Spytz) in branch 'master':
bpo-37393: Fix deprecation warnings in test_ntpath. (GH-14357)
https://github.com/python/cpython/commit/9fe42b49c79c453d905d0395150ba0607fbab18b


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 02:50:09 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 06:50:09 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561445409.66.0.818602957392.issue37393@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14184
pull_request: https://github.com/python/cpython/pull/14367

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 03:05:16 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 07:05:16 +0000
Subject: [issue37371] Optimize and refactor readline().
In-Reply-To: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>
Message-ID: <1561446316.37.0.657147476392.issue37371@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

What are results of benchmarking? Could you please provide a test data so I could reproduce benchmarking?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Tue Jun 25 03:12:23 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 07:12:23 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561446743.7.0.488682819339.issue37393@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 20372d65243d5573fba17d026681a3b24d95c284 by Miss Islington (bot) in branch '3.8':
bpo-37393: Fix deprecation warnings in test_ntpath. (GH-14357)
https://github.com/python/cpython/commit/20372d65243d5573fba17d026681a3b24d95c284


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 03:12:32 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 07:12:32 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561446752.96.0.918876214429.issue37393@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 695d7ad710de17b33870d34e0fff04a31f0f3e2b by Miss Islington (bot) in branch '3.7':
bpo-37393: Fix deprecation warnings in test_ntpath. (GH-14357)
https://github.com/python/cpython/commit/695d7ad710de17b33870d34e0fff04a31f0f3e2b


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 03:13:22 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 07:13:22 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561446802.5.0.645310615725.issue37393@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Thank you Zackery!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 03:14:27 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 07:14:27 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561446867.78.0.40071553709.issue37398@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +asvetlov, xtreak, yselivanov
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:19:31 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 25 Jun 2019 08:19:31 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561450771.72.0.994886410997.issue37398@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I wonder why do you need it? What is your use case?
A code snippet can help a lot.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:19:39 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 25 Jun 2019 08:19:39 +0000
Subject: [issue36974] Implement PEP 590
In-Reply-To: <1559154718.16.0.347735090162.issue36974@roundup.psfhosted.org>
Message-ID: <1561450779.93.0.493567678097.issue36974@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset 26fe6c35374fa32577b230b856a92a3b094e08ed by Petr Viktorin (Miss Islington (bot)) in branch '3.8':
bpo-36974: inherit tp_vectorcall_offset unconditionally (GH-13858) (GH-14342)
https://github.com/python/cpython/commit/26fe6c35374fa32577b230b856a92a3b094e08ed


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36974>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:48:22 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Tue, 25 Jun 2019 08:48:22 +0000
Subject: [issue37399] XML text behaviour change if there are comments
Message-ID: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>


New submission from Dima Tisnek <dimaqq at gmail.com>:

Example:

# mre.py
from xml.etree import ElementTree

XML = "<a>foo<!-- comment -->bar</a>"

a = ElementTree.fromstring(XML)
print(list(a.itertext()))

# Testing 3.7.3 vs. 3.8.0b1; macOS

? ~> python3.7 mre.py
['foobar']
? ~> python3.8 mre.py
['bar']

----------
components: Library (Lib)
messages: 346493
nosy: Dima.Tisnek
priority: normal
severity: normal
status: open
title: XML text behaviour change if there are comments
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:54:21 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 08:54:21 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561452861.91.0.80343514483.issue24214@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 894263ba80af4b7733c2df95b527e96953922656 by Serhiy Storchaka in branch 'master':
bpo-24214: Fixed the UTF-8 and UTF-16 incremental decoders. (GH-14304)
https://github.com/python/cpython/commit/894263ba80af4b7733c2df95b527e96953922656


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:54:37 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 08:54:37 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561452877.54.0.929245697103.issue24214@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14185
pull_request: https://github.com/python/cpython/pull/14368

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:54:44 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 08:54:44 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561452884.13.0.0619469417997.issue24214@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14186
pull_request: https://github.com/python/cpython/pull/14369

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 04:48:22 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Tue, 25 Jun 2019 08:48:22 +0000
Subject: [issue37399] XML text behaviour change if there are comments
Message-ID: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>


New submission from Dima Tisnek <dimaqq at gmail.com>:

Example:

# mre.py
from xml.etree import ElementTree

XML = "<a>foo<!-- comment -->bar</a>"

a = ElementTree.fromstring(XML)
print(list(a.itertext()))

# Testing 3.7.3 vs. 3.8.0b1; macOS

? ~> python3.7 mre.py
['foobar']
? ~> python3.8 mre.py
['bar']

----------
components: Library (Lib)
messages: 346493
nosy: Dima.Tisnek
priority: normal
severity: normal
status: open
title: XML text behaviour change if there are comments
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:05:44 2019
From: report at bugs.python.org (Armin Rigo)
Date: Tue, 25 Jun 2019 09:05:44 +0000
Subject: [issue7946] Convoy effect with I/O bound threads and New GIL
In-Reply-To: <1266353325.38.0.278549753357.issue7946@psf.upfronthosting.co.za>
Message-ID: <1561453544.75.0.057614705779.issue7946@roundup.psfhosted.org>


Armin Rigo <arigo at users.sourceforge.net> added the comment:

Note that PyPy has implemented a GIL which does not suffer from this problem, possibly using a simpler approach than the patches here do.  The idea is described and implemented here:

https://bitbucket.org/pypy/pypy/src/default/rpython/translator/c/src/thread_gil.c

----------
nosy: +arigo

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7946>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:12:21 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 09:12:21 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561453941.32.0.212782095061.issue24214@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset d32594ad27f48a898d42a0ea30b9d007b1c57de9 by Miss Islington (bot) in branch '3.8':
bpo-24214: Fixed the UTF-8 and UTF-16 incremental decoders. (GH-14304)
https://github.com/python/cpython/commit/d32594ad27f48a898d42a0ea30b9d007b1c57de9


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:27:04 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 09:27:04 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561454824.88.0.962962943729.issue37399@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Bisecting gives me commit 43851a202c (issue36673) before which "foobar" was returned and after the commit "bar" is returned.

----------
nosy: +eli.bendersky, scoder, serhiy.storchaka, xtreak
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:31:25 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 25 Jun 2019 09:31:25 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561455085.93.0.065067452451.issue36889@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Yes, Stream doc should be a combination of StreamReader and StreamWriter with small changes/additions.
StreamReader and StreamWriter should be kept in the doc.

Regarding docstrings: there is no strong requirement (we don't provide docstrings for all asyncio public API) but please don't hesitate to write them.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:42:46 2019
From: report at bugs.python.org (Shlomi Fish)
Date: Tue, 25 Jun 2019 09:42:46 +0000
Subject: [issue37371] Optimize and refactor readline().
In-Reply-To: <1561212660.83.0.219462707141.issue37371@roundup.psfhosted.org>
Message-ID: <1561455766.89.0.0831170152801.issue37371@roundup.psfhosted.org>


Shlomi Fish <shlomif at shlomifish.org> added the comment:

@Serhiy: here is the test data - https://www.shlomifish.org/Files/files/arcs/0fc-log--python-37371-issue.7z (shlomif[0fc]:$this$ sha256sum 0fc-log--python-37371-issue.7z 
aad93f103e255222ab8a06b9cc1c0930c6fc451ea148c46e098c74aa19aec021  0fc-log--python-37371-issue.7z
shlomif[0fc]:$this$ 
).

run it like "time python3 collect-stats.py 0fc-log.txt". I gave the results of a sample run in the main comment.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37371>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:43:28 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 09:43:28 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561455808.15.0.585560698941.issue37399@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
keywords: +3.8regression
stage:  -> needs patch
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 05:43:37 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 09:43:37 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561455817.11.0.0891312753184.issue37399@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
components: +XML

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:17:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:17:34 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561457854.44.0.563465660945.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

x86 Gentoo Installed with X 3.x is fixed as well. I close again the issue.

----------
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:23:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:23:03 +0000
Subject: [issue18906] Create a way to always run tests in subprocesses within
 regrtest
In-Reply-To: <1378142237.02.0.163660197957.issue18906@psf.upfronthosting.co.za>
Message-ID: <1561458183.05.0.545231182312.issue18906@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Since 2013, the Python test suite evolved a lot. First, we fixed hundreds of bugs where tests leaked various kinds of resources: processes, threads, file descriptors, memory, etc. Second, python3 -m test -j0 now runs each test file in a subprocess. Maybe we should emit a warning when tests are run sequentially, without -j0. Maybe it should be an opt-in option, rather than the default. But I prefer to close this old issue. Please open a new issue if you want to make further changes in regrtest.

----------
resolution:  -> fixed
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18906>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:24:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:24:25 +0000
Subject: [issue17554] Compact output for regrtest
In-Reply-To: <1364331735.49.0.0652208703783.issue17554@psf.upfronthosting.co.za>
Message-ID: <1561458265.83.0.300989913057.issue17554@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

This issue has no activity for 5 years. regrtest output evolved a lot since that one. I like "verbose" output on buildbots to be able to debug when something goes wrong.

----------
resolution:  -> out of date
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17554>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:29:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:29:28 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561458568.01.0.82611476313.issue24214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c755ca89c75252a7aae9beae82fd47787a76b9e2 by Victor Stinner (Miss Islington (bot)) in branch '3.7':
[3.7] bpo-24214: Fixed the UTF-8 and UTF-16 incremental decoders. (GH-14304) (GH-14369)
https://github.com/python/cpython/commit/c755ca89c75252a7aae9beae82fd47787a76b9e2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:30:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:30:35 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561458635.58.0.766314432347.issue24214@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Karthikeyan Singaravelan for the bug report of the regression. You're right that I misunderstood it. Thanks Serhiy for the second fix. The regression should now be fixed as well, I close the issue again.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:32:40 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 10:32:40 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561458760.92.0.351323719066.issue37399@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Just to add the Python implementation seems to return "foobar" on commenting the C accelerators imports. So I guess it's a problem with the C implementation in the commit being different from Python implementation.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:37:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:37:03 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561459023.13.0.94178065167.issue37396@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14187
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14370

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:38:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 10:38:36 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561459116.66.0.739442467259.issue37396@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> How can you tell that $(PyDebugExt) is not set?  Note that the "Killing any running python.exe instances..." line is hard-coded, it does not currently include $(PyDebugExt) (though it probably should).  Adding that to the message would be a good first step; ...

Oh... I didn't notice :-) I wrote PR 14370 to fix that.


> ...; backporting GH-9901 to 2.7 would probably also be good even though it was solving a different issue.

I'm not brave enough yet to make such large changes into Python 2.7 build system on Windows. I'm unable to build Python 2.7 for Windows for at least one year...

----------
stage: patch review -> 

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 06:59:02 2019
From: report at bugs.python.org (Petr Viktorin)
Date: Tue, 25 Jun 2019 10:59:02 +0000
Subject: [issue37250] C files generated by Cython set tp_print to 0:
 PyTypeObject.tp_print removed
In-Reply-To: <1560344910.52.0.698180941152.issue37250@roundup.psfhosted.org>
Message-ID: <1561460342.2.0.381270015253.issue37250@roundup.psfhosted.org>


Petr Viktorin <encukou at gmail.com> added the comment:


New changeset d917cfe4051d45b2b755c726c096ecfcc4869ceb by Petr Viktorin (Jeroen Demeyer) in branch '3.8':
[3.8] bpo-37250: put back tp_print for backwards compatibility (GH-14193)
https://github.com/python/cpython/commit/d917cfe4051d45b2b755c726c096ecfcc4869ceb


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37250>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:07:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 11:07:09 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
Message-ID: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

https://buildbot.python.org/all/#/builders/167/builds/1265

test_chown (test.test_os.ChownFileTests) ... ERROR

======================================================================
ERROR: test_chown (test.test_os.ChownFileTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd10.nondebug/build/Lib/test/test_os.py", line 1327, in test_chown
    os.chown(support.TESTFN, uid, gid_1)
PermissionError: [Errno 1] Operation not permitted: '@test_95158_tmp'

Extract of the test:

    import grp
    groups = [g.gr_gid for g in grp.getgrall() if getpass.getuser() in g.gr_mem]
    if hasattr(os, 'getgid'):
        process_gid = os.getgid()
        if process_gid not in groups:
            groups.append(process_gid)

    @unittest.skipUnless(len(groups) > 1, "test needs more than one group")
    def test_chown(self):
        gid_1, gid_2 = groups[:2]
        uid = os.stat(support.TESTFN).st_uid
        os.chown(support.TESTFN, uid, gid_1)  # <======== FAIL HERE
        gid = os.stat(support.TESTFN).st_gid
        self.assertEqual(gid, gid_1)
        os.chown(support.TESTFN, uid, gid_2)
        gid = os.stat(support.TESTFN).st_gid
        self.assertEqual(gid, gid_2)

Extract of test.pythoninfo:

os.uid: 1002
os.umask: 077
os.gid: 1002
os.groups: 1002


I'm not sure that the code to manually get groups from grp.getgrall() is correct. Why not relying on the *current* groups, os.getgroups()?

Note: there is also os.getgrouplist(), I'm not sure of the difference between os.getgroups() and os.getgrouplist(). I know that os.getgrouplist() was modified recently to use:

    /*
     * NGROUPS_MAX is defined by POSIX.1 as the maximum
     * number of supplimental groups a users can belong to.
     * We have to increment it by one because
     * getgrouplist() returns both the supplemental groups
     * and the primary group, i.e. all of the groups the
     * user belongs to.
     */
    ngroups = 1 + MAX_GROUPS;

----------
components: Tests
messages: 346508
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_os: test_chown() started to fail on AMD64 FreeBSD 10-STABLE Non-Debug 3.* buildbots
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:09:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 11:09:35 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561460975.76.0.881231601936.issue37400@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14188
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14373

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:14:11 2019
From: report at bugs.python.org (John Belmonte)
Date: Tue, 25 Jun 2019 11:14:11 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561461251.92.0.654565639786.issue37398@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

I have a context manager used for timing sections of code or whole functions (when used as a decorator).  It's aware of the Trio async/await scheduler and is able to exclude periods of time where the task is not executing.  The context manager itself is not async.

Synopsis of decorator case:

  @PerfTimer('query')
  async def query_or_throw(self, q):
      return _parse_result(await self._send_query(q))

I'd like to just use the existing ContextDecorator to define the PerfTimer context manager, and have it wrap coroutine functions properly.  New API is not required.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:17:39 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 25 Jun 2019 11:17:39 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561461459.45.0.458655703239.issue37400@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

This looks like a reincarnation of #27838

----------
nosy: +koobs

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:21:42 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 25 Jun 2019 11:21:42 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561461702.38.0.7793075351.issue37398@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Sorry, I still have no idea what is the code for PerfTimer class.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:25:13 2019
From: report at bugs.python.org (Kubilay Kocak)
Date: Tue, 25 Jun 2019 11:25:13 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561461913.18.0.413597174764.issue37400@roundup.psfhosted.org>


Kubilay Kocak <koobs.freebsd at gmail.com> added the comment:

And I just remembered that I had to restart the build worker service on that host (koobs-freebsd10) this morning as I was receiving messaging that the worker had gone missing.

I ran `[koobs at 10-STABLE-amd64:~] sudo /usr/local/etc/rc.d/buildslave restart`

which is the same as the prevailing reproduction case in #27838

I could restart the worker to make the issue go away, but I think the underlying issue should be fixed instead.

Should we close this as a dupe and reopen the original?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:35:22 2019
From: report at bugs.python.org (John Belmonte)
Date: Tue, 25 Jun 2019 11:35:22 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561462522.77.0.767552862828.issue37398@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

PerfTimer is a reusable, non-reentrant context manager implemented as a class.

There are already use cases of ContextDecorator described in the contextlib documentation, such as the track_entry_and_exit logger.  What reason would you have for such context managers to *not* wrap async functions properly?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:37:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 11:37:21 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561462641.27.0.362545709063.issue37396@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 49032fa7e1cc1b6dc12b898daac24b75bae7572c by Victor Stinner in branch '2.7':
bpo-37396, PCbuild: Include "_d" in "Killing any running ..." message (GH-14370)
https://github.com/python/cpython/commit/49032fa7e1cc1b6dc12b898daac24b75bae7572c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 07:37:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 11:37:30 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561462650.67.0.91575958652.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 9cb274114c844f9b1c13028f812926c987a7b4a7 by Victor Stinner in branch 'master':
bpo-37400: pythoninfo logs getpwuid and getgrouplist (GH-14373)
https://github.com/python/cpython/commit/9cb274114c844f9b1c13028f812926c987a7b4a7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:17:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 12:17:01 +0000
Subject: [issue37392] Remove sys.setcheckinterval()
In-Reply-To: <1561419827.4.0.622376086867.issue37392@roundup.psfhosted.org>
Message-ID: <1561465021.45.0.208553148361.issue37392@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 080b6b40fa6c6ddc79dcfcadab575bb1be3f47e9 by Victor Stinner (Xtreak) in branch 'master':
bpo-37392: Update the dir(sys) in module tutorial (GH-14365)
https://github.com/python/cpython/commit/080b6b40fa6c6ddc79dcfcadab575bb1be3f47e9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37392>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:17:15 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Tue, 25 Jun 2019 12:17:15 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561465035.79.0.0141726709176.issue37398@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Got you.

iscoroutinefunction() is not reliable: it detects async functions only but fails if we have a regular function that returns awaitable object.

I think AsyncContextDecorator is needed here to explicitly point that you want to wrap async function.

Another question is: sync or async context manager should be applied? I see use cases for both variants

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:21:32 2019
From: report at bugs.python.org (=?utf-8?q?Andreas_G=C3=A4er?=)
Date: Tue, 25 Jun 2019 12:21:32 +0000
Subject: [issue34606] Unable to read zip file with extra
In-Reply-To: <1536331319.28.0.56676864532.issue34606@psf.upfronthosting.co.za>
Message-ID: <1561465292.57.0.0636643061809.issue34606@roundup.psfhosted.org>


Andreas G?er <a.gaeer at googlemail.com> added the comment:

I'm a little bit puzzled that this bug is closed as "not a bug" despite the fact that all versions of python allow the user to create "invalid" ZIP files and all version up to 3.7 are able to read those "invalid" files.

Currently we're stuck with a lot of already created ZIP files that cannot be read or fixed after an update to 3.7.

Would it be an option to make decoding of extra data optional eg. with an extra keyword arg to __init__?

----------
nosy: +Andreas.G?er

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34606>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:36:43 2019
From: report at bugs.python.org (John Belmonte)
Date: Tue, 25 Jun 2019 12:36:43 +0000
Subject: [issue37398] contextlib.ContextDecorator decorating async functions
In-Reply-To: <1561445403.56.0.10750759042.issue37398@roundup.psfhosted.org>
Message-ID: <1561466203.37.0.165083265217.issue37398@roundup.psfhosted.org>


John Belmonte <john at neggie.net> added the comment:

My use case is for a non-async context manager, and if we take track_entry_and_exit as an example that's non-async as well.

The explicit approach (e.g. separate base class for decorators applied to sync vs. async functions) doesn't seem ideal, because it precludes having a single context manager for both cases.  track_entry_and_exit is an example where a context manager would want to decorate both types of functions.

I'm not sure how big of a problem the iscoroutinefunction() limitation is-- in Trio style we don't pass around coroutines by normal functions.  The `async` qualifier exists to make it clear when a function returns a coroutine, and ContextDecorator already doesn't work for the case of a regular function returning a coroutine.  I think the scope here is to enhance ContextDecorator to work with async functions which are properly qualified with `async`.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37398>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:46:52 2019
From: report at bugs.python.org (Borja)
Date: Tue, 25 Jun 2019 12:46:52 +0000
Subject: [issue37401] pygrib install error
Message-ID: <1561466812.68.0.502076749733.issue37401@roundup.psfhosted.org>


New submission from Borja <saszalez at gmail.com>:

Installing Pygrib with pip (pip install pygrib):

Collecting pygrib
  Using cached https://files.pythonhosted.org/packages/f8/10/c0d22eafec62fb5413799a7034ac45f26bfa77405c8527c17869e4c3ee4d/pygrib-2.0.4.tar.gz
Requirement already satisfied: numpy in ./lib/python3.7/site-packages (from pygrib) (1.16.4)
Installing collected packages: pygrib
  Running setup.py install for pygrib ... error
    ERROR: Complete output from command /home/python3/bin/python3.7 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-qcxz0945/pygrib/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-qd474uhl/install-record.txt --single-version-externally-managed --compile:
    ERROR: /tmp/pip-install-qcxz0945/pygrib/setup.py:41: DeprecationWarning: The SafeConfigParser class has been renamed to ConfigParser in Python 3.2. This alias will be removed in future versions. Use ConfigParser directly instead.
      config = _ConfigParser()
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.7
    copying ncepgrib2.py -> build/lib.linux-x86_64-3.7
    running build_ext
    building 'pygrib' extension
    creating build/temp.linux-x86_64-3.7
    gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -I/home/python3/lib/python3.7/site-packages/numpy/core/include -Ig2clib_src -I/home/python3/include/python3.7m -c pygrib.c -o build/temp.linux-x86_64-3.7/pygrib.o
    In file included from /home/python3/lib/python3.7/site-packages/numpy/core/include/numpy/ndarraytypes.h:1822:0,
                     from /home/python3/lib/python3.7/site-packages/numpy/core/include/numpy/ndarrayobject.h:12,
                     from /home/python3/lib/python3.7/site-packages/numpy/core/include/numpy/arrayobject.h:4,
                     from pygrib.c:613:
    /home/python3/lib/python3.7/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: aviso: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
     #warning "Using deprecated NumPy API, disable it with " \
      ^
    pygrib.c:614:22: error fatal: grib_api.h: No existe el fichero o el directorio
     #include "grib_api.h"
                          ^
    compilaci?n terminada.
    error: command 'gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command "/home/python3/bin/python3.7 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-qcxz0945/pygrib/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-qd474uhl/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-qcxz0945/pygrib/

Numpy (1.16.4)
Python (3.7.3)
Pip (19.1.1)

----------
components: Extension Modules
messages: 346520
nosy: Saszalez
priority: normal
severity: normal
status: open
title: pygrib install error
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37401>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:55:08 2019
From: report at bugs.python.org (Andreas Jung)
Date: Tue, 25 Jun 2019 12:55:08 +0000
Subject: [issue37402] Fatal Python error: Cannot recover from stack overflow
 issues on Python 3.6 and 3.7
Message-ID: <1561467308.7.0.878273526771.issue37402@roundup.psfhosted.org>


New submission from Andreas Jung <ajung at users.sourceforge.net>:

I am using Python 3.6 and 3.7 (always latest minor releases) with Plone 5.2 and I various issues with 

Fatal Python error: Cannot recover from stack overflow.

and do not make much sense to me.

Some related tracebacks are documented here

https://github.com/plone/Products.CMFPlone/issues/2874

https://community.plone.org/t/fatal-python-error-cannot-recover-from-stack-overflow/8589

There are no patterns directly visible what may typically cause the error. 

The errors occur at least with Python 3.6 system Python on Fedora 26 and a self-compiled Python 3.7.3 on a fresh Debian 9 system.

----------
components: Interpreter Core
messages: 346521
nosy: ajung
priority: normal
severity: normal
status: open
title: Fatal Python error: Cannot recover from stack overflow issues on Python 3.6 and 3.7
type: crash
versions: Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37402>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:56:03 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Tue, 25 Jun 2019 12:56:03 +0000
Subject: [issue37401] pygrib install error
In-Reply-To: <1561466812.68.0.502076749733.issue37401@roundup.psfhosted.org>
Message-ID: <1561467363.97.0.822342507977.issue37401@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This tracker deals with issues in CPython. pygrib is not a part of the standard library. This could have better discussion at https://github.com/jswhit/pygrib. I am closing this as third party.

----------
nosy: +xtreak
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37401>
_______________________________________

From report at bugs.python.org  Tue Jun 25 08:56:56 2019
From: report at bugs.python.org (Andreas Jung)
Date: Tue, 25 Jun 2019 12:56:56 +0000
Subject: [issue37402] Fatal Python error: Cannot recover from stack overflow
 issues on Python 3.6 and 3.7
In-Reply-To: <1561467308.7.0.878273526771.issue37402@roundup.psfhosted.org>
Message-ID: <1561467416.45.0.838821201714.issue37402@roundup.psfhosted.org>


Andreas Jung <ajung at users.sourceforge.net> added the comment:

Typical traceback:

WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/fotos-specialist-course2018.htm/demo10-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/fotos-specialist-course2018.htm/kick-off2-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/fotos-specialist-course2018.htm/kick-off3-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/fotos-specialist-course2018.htm/kick-off6-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/fotos-specialist-course2018.htm/kick-off5-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/toon-jpg If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/wf.htm If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/toon.htm If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/unite.htm If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/microscopycentre/img/spt If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/openuniversiteit/nl/contact/studiegids2015.pdf If renaming or importing please reindex!
WARNING:plone.app.contenttypes.indexers:Lookup of PrimaryField failed for http://nohost/plone_portal/openuniversiteit/nl/contact/studiegids2015.pdf If renaming or importing please reindex!
Fatal Python error: Cannot recover from stack overflow.

Thread 0x00007fe43f8b0700 (most recent call first):
  File "/opt/python-3.7.3/lib/python3.7/selectors.py", line 468 in select
  File "/opt/python-3.7.3/lib/python3.7/asyncio/base_events.py", line 1739 in _run_once
  File "/opt/python-3.7.3/lib/python3.7/asyncio/base_events.py", line 539 in run_forever
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/ZEO-5.2.1-py3.7.egg/ZEO/asyncio/client.py", line 861 in run
  File "/opt/python-3.7.3/lib/python3.7/threading.py", line 865 in run
  File "/opt/python-3.7.3/lib/python3.7/threading.py", line 917 in _bootstrap_inner
  File "/opt/python-3.7.3/lib/python3.7/threading.py", line 885 in _bootstrap

Current thread 0x00007fe44e046500 (most recent call first):
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/zope.component-4.5-py3.7.egg/zope/component/hooks.py", line 103 in getSiteManager
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/zope.component-4.5-py3.7.egg/zope/component/_api.py", line 157 in queryUtility
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFCore-2.4.0b8-py3.7.egg/Products/CMFCore/DynamicType.py", line 71 in getTypeInfo
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 96 in getLayout
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 75 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
  ...
Aborted

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37402>
_______________________________________

From report at bugs.python.org  Tue Jun 25 09:03:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 13:03:08 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561467788.06.0.17615586089.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 3939c321c90283b49eddde762656e4b1940e7150 by Victor Stinner in branch 'master':
bpo-20443: _PyConfig_Read() gets the absolute path of run_filename (GH-14053)
https://github.com/python/cpython/commit/3939c321c90283b49eddde762656e4b1940e7150


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Tue Jun 25 09:13:22 2019
From: report at bugs.python.org (Shivaram Lingamneni)
Date: Tue, 25 Jun 2019 13:13:22 +0000
Subject: [issue31711] ssl.SSLSocket.send(b"") fails
In-Reply-To: <1507282980.19.0.213398074469.issue31711@psf.upfronthosting.co.za>
Message-ID: <1561468402.55.0.86766456115.issue31711@roundup.psfhosted.org>


Shivaram Lingamneni <slingamn at cs.stanford.edu> added the comment:

Are there any possible next steps on this?

This issue is very counterintuitive and challenging to debug --- it commonly presents as a nondeterministic edge case, and it appears to be a failed system call but doesn't show up in strace.

Thanks for your time.

----------
nosy: +slingamn

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31711>
_______________________________________

From report at bugs.python.org  Tue Jun 25 09:23:21 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 13:23:21 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561469001.17.0.853063353694.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I merged my pythoninfo change, more complete pythoninfo from the buildbot:

os.getgid: 1002
os.getgrouplist: 1002
os.getgroups: 1002
os.getuid: 1002

pwd.getpwuid(1002): pwd.struct_passwd(pw_name='buildbot', pw_passwd='*', pw_uid=1002, pw_gid=1002, pw_gecos='FreeBSD BuildBot', pw_dir='/home/buildbot', pw_shell='/bin/sh')

IMHO the test is wrong: it should rely on os.getgroups() rather tan "discover" groups from pw.getpwall().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 09:49:52 2019
From: report at bugs.python.org (Rakesh Singh)
Date: Tue, 25 Jun 2019 13:49:52 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561470592.34.0.409138982329.issue37391@roundup.psfhosted.org>


Rakesh Singh <rakesh at sysras.com> added the comment:

Same behaviour experienced here on Mojave Kernel Version 18.6.0.
Homebrew Python 3.7.3

Python 3.7.3 (default, Jun 19 2019, 07:38:49) 
[Clang 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license()" for more information.
WARNING: The version of Tcl/Tk (8.5.9) in use may be unstable. Visit
http://www.python.org/download/mac/tcltk/ for current information.
>>> 

It seems to be compiled using Tcl 8.5 that is installed with the system.
IDLE shipped with Anaconda works correctly.



```
brew linkage python
System libraries:
  /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
  /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon
  /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
  /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
  /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
  /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
  /System/Library/Frameworks/Tcl.framework/Versions/8.5/Tcl
  /System/Library/Frameworks/Tk.framework/Versions/8.5/Tk
  /usr/lib/libSystem.B.dylib
  /usr/lib/libbz2.1.0.dylib
  /usr/lib/libncurses.5.4.dylib
  /usr/lib/libobjc.A.dylib
  /usr/lib/libpanel.5.4.dylib
  /usr/lib/libz.1.dylib
Homebrew libraries:
  /usr/local/opt/gdbm/lib/libgdbm.6.dylib (gdbm)
  /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (openssl)
  /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (openssl)
  /usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/Python (python)
  /usr/local/opt/readline/lib/libreadline.8.dylib (readline)
  /usr/local/opt/sqlite/lib/libsqlite3.0.dylib (sqlite)
  /usr/local/opt/xz/lib/liblzma.5.dylib (xz)
```

----------
nosy: +Rakesh Singh

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:03:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 14:03:52 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561471432.69.0.499586350322.issue37400@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14189
pull_request: https://github.com/python/cpython/pull/14374

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:20:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 14:20:39 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561472439.76.0.380853719084.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I'm connected to the FreeBSD CURRENT buildbot as the user "haypo". I'm unable to reproduce the bug:

CURRENT-amd64% id
uid=1003(haypo) gid=1003(haypo) groups=1003(haypo)

CURRENT-amd64% ./python -m test test_os -m test_chown
(...)
Tests result: SUCCESS

Moreover, it seems like something changes on the buildbot, since the user "buildbot" now has 0 group!?

$ ./python
>>> [g.gr_gid for g in grp.getgrall() if 'buildbot' in g.gr_mem]
[]

Or maybe as the user "haypo", I cannot see *all* groups.

In case of doubt, I will blindly apply my fix PR 14374.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:32:07 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Tue, 25 Jun 2019 14:32:07 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561473127.29.0.722872071978.issue37276@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

Initial post: https://stackoverflow.com/q/56587166/2326961

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:37:49 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 14:37:49 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561473469.08.0.210529235014.issue4963@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14190
stage: backport needed -> patch review
pull_request: https://github.com/python/cpython/pull/14375

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:38:00 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 14:38:00 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561473480.28.0.255642712287.issue4963@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14191
pull_request: https://github.com/python/cpython/pull/14376

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 10:44:26 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 14:44:26 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561473866.83.0.524970322588.issue37396@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> Should PCbuild/pyproject.vcxproj explicitly import python.props which defines it?

It already does :)

This is more likely because the previous build on that buildbot crashed(?) or because it was aborted during test_multiprocessing:

https://buildbot.python.org/all/#/builders/45/builds/428

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:02:17 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 15:02:17 +0000
Subject: [issue37393] Deprecation warnings in test_ntpath
In-Reply-To: <1561420298.16.0.54765045768.issue37393@roundup.psfhosted.org>
Message-ID: <1561474937.5.0.346349599312.issue37393@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

We should also remove that deprecation warning, as PEP 528 (or was it PEP 529) undeprecated bytes paths.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37393>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:06:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 15:06:28 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561475188.16.0.496069878559.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset d7c87d982d4ec4ba201bcee14324ae5e0e90581f by Victor Stinner in branch 'master':
bpo-37400: Fix test_os.test_chown() (GH-14374)
https://github.com/python/cpython/commit/d7c87d982d4ec4ba201bcee14324ae5e0e90581f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:06:39 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 15:06:39 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561475199.41.0.948631158718.issue37400@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14192
pull_request: https://github.com/python/cpython/pull/14377

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:06:46 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 15:06:46 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561475206.67.0.148075090656.issue37400@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14193
pull_request: https://github.com/python/cpython/pull/14378

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:14:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 15:14:06 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561475646.32.0.858622210176.issue37396@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Aaaah, CIs are funny.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:20:52 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 15:20:52 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561476052.8.0.0930464325902.issue4963@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 25fbe33b92cd938e809839feaa3fda97e6ad0980 by Steve Dower in branch '3.8':
bpo-4963: Fix for initialization and non-deterministic behavior issues in mimetypes (GH-14375)
https://github.com/python/cpython/commit/25fbe33b92cd938e809839feaa3fda97e6ad0980


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:27:06 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 15:27:06 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561476426.98.0.470370703481.issue37400@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 12d174bed9960ded1d072035c57f82e10a89f0d6 by Miss Islington (bot) in branch '3.8':
bpo-37400: Fix test_os.test_chown() (GH-14374)
https://github.com/python/cpython/commit/12d174bed9960ded1d072035c57f82e10a89f0d6


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:42:02 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 15:42:02 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561477322.22.0.542856611875.issue37391@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> It seems to be compiled using Tcl 8.5 that is installed with the system.

Yes, and that is almost certainly the original poster's problem, as well.  In fact, this same issue was reported in Issue10731 in 2010. The Tcl/Tk 8.5 supplied by Apple in macOS is terribly out-of-date and dangerously buggy; it should never be used.  You should even be seeing a warning message from IDLE when using that system Tcl/Tk. I'm not familiar with how Homebrew manages the Tcl/Tk that their Pythons link with but, if necessary, you should follow up with them to ensure that none of their recipes use the system Tcl/Tk.

More details here:
https://www.python.org/download/mac/tcltk/

----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> UnicodeDecodeError in OS X tkinter when binding to <MouseWheel>

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:44:21 2019
From: report at bugs.python.org (David K. Hess)
Date: Tue, 25 Jun 2019 15:44:21 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561477461.16.0.450263048308.issue4963@roundup.psfhosted.org>


David K. Hess <david_k_hess at mac.com> added the comment:

Thank you Steve!

Nice to see this one make it across the finish line.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:47:00 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 15:47:00 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561477620.79.0.550778669329.issue37276@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

@maggyero, Please do not spam a list of people by add their names to issues; it will not speed a resolution.  Let the people doing bug triage evaluate the issue and, if necessary, nosy the appropriate developers.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 11:47:54 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 15:47:54 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561477674.24.0.346038146506.issue37276@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy:  -ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 12:12:18 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 16:12:18 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561479138.83.0.188875414036.issue4963@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 2a99fd911ebeecedbb250a05667cd46eca4735b9 by Steve Dower in branch '3.7':
bpo-4963: Fix for initialization and non-deterministic behavior issues in mimetypes (GH-14376)
https://github.com/python/cpython/commit/2a99fd911ebeecedbb250a05667cd46eca4735b9


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 12:14:49 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 16:14:49 +0000
Subject: [issue4963] mimetypes.guess_extension result changes after
 mimetypes.init()
In-Reply-To: <1232107494.83.0.0570958889295.issue4963@psf.upfronthosting.co.za>
Message-ID: <1561479289.55.0.628547281279.issue4963@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
assignee:  -> steve.dower
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue4963>
_______________________________________

From report at bugs.python.org  Tue Jun 25 13:03:33 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Tue, 25 Jun 2019 17:03:33 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1561482213.57.0.240206271855.issue33972@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset 02257012f6d3821d816cb6a7e8461a88a05b9a08 by Barry Warsaw (Abhilash Raj) in branch 'master':
bpo-33972: Fix EmailMessage.iter_attachments raising AttributeError. (GH-14119)
https://github.com/python/cpython/commit/02257012f6d3821d816cb6a7e8461a88a05b9a08


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Tue Jun 25 13:07:04 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Tue, 25 Jun 2019 17:07:04 +0000
Subject: [issue37402] Fatal Python error: Cannot recover from stack overflow
 issues on Python 3.6 and 3.7
In-Reply-To: <1561467308.7.0.878273526771.issue37402@roundup.psfhosted.org>
Message-ID: <1561482424.43.0.686368220311.issue37402@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
components: +asyncio -Interpreter Core
nosy: +asvetlov, yselivanov
versions: +Python 3.8, Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37402>
_______________________________________

From report at bugs.python.org  Tue Jun 25 13:31:37 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 25 Jun 2019 17:31:37 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561483897.39.0.0918985788413.issue37391@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

Thanks for the additional information Rakesh.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 13:54:34 2019
From: report at bugs.python.org (George Pantazes)
Date: Tue, 25 Jun 2019 17:54:34 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561485274.73.0.255842760447.issue37391@roundup.psfhosted.org>


George Pantazes <georgepantazes at gmail.com> added the comment:

Alright folks, sorry there's going to be a lot of pasted blocks of output, so just look for where I @ your name to address your questions.

@ned.deily, here is the output of those info commands.

```
? python3 -m test.pythoninfo                                       
Python debug information
========================

CC.version: Apple LLVM version 10.0.1 (clang-1001.0.46.4)
Py_DEBUG: No (sys.gettotalrefcount() missing)
_decimal.__libmpdec_version__: 2.4.2
builtins.float.double_format: IEEE, little-endian
builtins.float.float_format: IEEE, little-endian
core_config[_disable_importlib]: 0
core_config[allocator]: None
core_config[argv]: ['-m']
core_config[base_exec_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
core_config[base_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
core_config[coerce_c_locale]: 0
core_config[coerce_c_locale_warn]: 0
core_config[dev_mode]: 0
core_config[dump_refs]: 0
core_config[exec_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
core_config[executable]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/python3'
core_config[faulthandler]: 0
core_config[hash_seed]: 0
core_config[home]: None
core_config[ignore_environment]: 0
core_config[import_time]: 0
core_config[install_signal_handlers]: 1
core_config[malloc_stats]: 0
core_config[module_search_path_env]: None
core_config[module_search_paths]: ['/Users/georgep/Documents/workspace/r-tester/venv/bin/../lib/python37.zip', '/Users/georgep/Documents/workspace/r-tester/venv/bin/../lib/python3.7', '/Users/georgep/Documents/workspace/r-tester/venv/bin/../lib/python3.7/lib-dynload']
core_config[prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
core_config[program]: 'python3'
core_config[program_name]: 'python3'
core_config[show_alloc_count]: 0
core_config[show_ref_count]: 0
core_config[tracemalloc]: 0
core_config[use_hash_seed]: 0
core_config[utf8_mode]: 0
core_config[warnoptions]: []
core_config[xoptions]: []
datetime.datetime.now: 2019-06-25 10:50:02.453944
expat.EXPAT_VERSION: expat_2.2.6
global_config[Py_BytesWarningFlag]: 0
global_config[Py_DebugFlag]: 0
global_config[Py_DontWriteBytecodeFlag]: 0
global_config[Py_FileSystemDefaultEncodeErrors]: 'surrogateescape'
global_config[Py_FileSystemDefaultEncoding]: 'utf-8'
global_config[Py_FrozenFlag]: 0
global_config[Py_HasFileSystemDefaultEncoding]: 1
global_config[Py_HashRandomizationFlag]: 1
global_config[Py_IgnoreEnvironmentFlag]: 0
global_config[Py_InspectFlag]: 0
global_config[Py_InteractiveFlag]: 0
global_config[Py_IsolatedFlag]: 0
global_config[Py_NoSiteFlag]: 0
global_config[Py_NoUserSiteDirectory]: 0
global_config[Py_OptimizeFlag]: 0
global_config[Py_QuietFlag]: 0
global_config[Py_UTF8Mode]: 0
global_config[Py_UnbufferedStdioFlag]: 0
global_config[Py_VerboseFlag]: 0
locale.encoding: UTF-8
main_config[argv]: ['/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/test/pythoninfo.py']
main_config[base_exec_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
main_config[base_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
main_config[exec_prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
main_config[executable]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/python3'
main_config[install_signal_handlers]: 1
main_config[module_search_path]: ['/Users/georgep/Documents/workspace/r-tester', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python37.zip', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7/lib-dynload', '/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7/site-packages']
main_config[prefix]: '/Users/georgep/Documents/workspace/r-tester/venv/bin/..'
main_config[warnoptions]: []
main_config[xoptions]: {}
os.cpu_count: 8
os.cwd: /Users/georgep/Documents/workspace/r-tester
os.environ[DISPLAY]: /private/tmp/com.apple.launchd.iXqE5VioqF/org.macosforge.xquartz:0
os.environ[HOME]: /Users/georgep
os.environ[LC_CTYPE]: en_US.UTF-8
os.environ[PATH]: /Users/georgep/Documents/workspace/r-tester/venv/bin:/Users/georgep/.rvm/gems/ruby-2.5.1/bin:/Users/georgep/.rvm/gems/ruby-2.5.1 at global/bin:/Users/georgep/.rvm/rubies/ruby-2.5.1/bin:/Users/georgep/bin:/Users/georgep/.jenv/shims:/Users/georgep/.jenv/bin:/Users/georgep/.jenv/shims:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Library/TeX/texbin:/usr/local/munki:/opt/X11/bin:/Applications/Postgres.app/Contents/Versions/latest/bin:/Users/georgep/.rvm/bin
os.environ[SHELL]: /bin/zsh
os.environ[TERM]: xterm-256color
os.environ[TMPDIR]: /var/folders/sv/5gh4tk990539nzhdt311pg0h000_fp/T/
os.environ[VIRTUAL_ENV]: /Users/georgep/Documents/workspace/r-tester/venv
os.gid: 20
os.groups: 20, 12, 61, 80, 33, 98, 100, 204, 250, 395, 398, 399
os.loadavg: (2.02685546875, 1.79248046875, 1.787109375)
os.login: georgep
os.name: posix
os.supports_bytes_environ: True
os.supports_effective_ids: ['access']
os.supports_fd: ['chdir', 'chmod', 'chown', 'listdir', 'pathconf', 'scandir', 'stat', 'statvfs', 'truncate', 'utime']
os.supports_follow_symlinks: ['access', 'chflags', 'chmod', 'chown', 'link', 'stat', 'utime']
os.uid: 10710
os.umask: 022
os.uname: posix.uname_result(sysname='Darwin', nodename='georgepmaclap.local', release='18.6.0', version='Darwin Kernel Version 18.6.0: Thu Apr 25 23:16:27 PDT 2019; root:xnu-4903.261.4~2/RELEASE_X86_64', machine='x86_64')
platform.architecture: 64bit
platform.platform: Darwin-18.6.0-x86_64-i386-64bit
platform.python_implementation: CPython
pymem.allocator: pymalloc
pymem.with_pymalloc: True
readline._READLINE_LIBRARY_VERSION: 8.0
readline._READLINE_RUNTIME_VERSION: 0x800
readline._READLINE_VERSION: 0x800
resource.RLIMIT_AS: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_CORE: (0, 9223372036854775807)
resource.RLIMIT_CPU: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_DATA: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_FSIZE: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_MEMLOCK: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_NOFILE: (10240, 9223372036854775807)
resource.RLIMIT_NPROC: (1418, 2128)
resource.RLIMIT_RSS: (9223372036854775807, 9223372036854775807)
resource.RLIMIT_STACK: (8388608, 67104768)
resource.pagesize: 4096
socket.hostname: georgepmaclap.local
sqlite3.sqlite_version: 3.28.0
sqlite3.version: 2.6.0
ssl.HAS_SNI: True
ssl.OPENSSL_VERSION: OpenSSL 1.0.2s  28 May 2019
ssl.OPENSSL_VERSION_INFO: (1, 0, 2, 19, 15)
ssl.OP_ALL: 0x800003ff
ssl.OP_NO_TLSv1_1: 0x10000000
sys._framework: Python
sys.abiflags: m
sys.api_version: 1013
sys.builtin_module_names: ('_abc', '_ast', '_codecs', '_collections', '_functools', '_imp', '_io', '_locale', '_operator', '_signal', '_sre', '_stat', '_string', '_symtable', '_thread', '_tracemalloc', '_warnings', '_weakref', 'atexit', 'builtins', 'errno', 'faulthandler', 'gc', 'itertools', 'marshal', 'posix', 'pwd', 'sys', 'time', 'xxsubtype', 'zipimport')
sys.byteorder: little
sys.dont_write_bytecode: False
sys.executable: /Users/georgep/Documents/workspace/r-tester/venv/bin/python3
sys.filesystem_encoding: utf-8/surrogateescape
sys.flags: sys.flags(debug=0, inspect=0, interactive=0, optimize=0, dont_write_bytecode=0, no_user_site=0, no_site=0, ignore_environment=0, verbose=0, bytes_warning=0, quiet=0, hash_randomization=1, isolated=0, dev_mode=False, utf8_mode=0)
sys.float_info: sys.float_info(max=1.7976931348623157e+308, max_exp=1024, max_10_exp=308, min=2.2250738585072014e-308, min_exp=-1021, min_10_exp=-307, dig=15, mant_dig=53, epsilon=2.220446049250313e-16, radix=2, rounds=1)
sys.float_repr_style: short
sys.hash_info: sys.hash_info(width=64, modulus=2305843009213693951, inf=314159, nan=0, imag=1000003, algorithm='siphash24', hash_bits=64, seed_bits=128, cutoff=0)
sys.hexversion: 50791408
sys.implementation: namespace(_multiarch='darwin', cache_tag='cpython-37', hexversion=50791408, name='cpython', version=sys.version_info(major=3, minor=7, micro=3, releaselevel='final', serial=0))
sys.int_info: sys.int_info(bits_per_digit=30, sizeof_digit=4)
sys.maxsize: 9223372036854775807
sys.maxunicode: 1114111
sys.path: ['/Users/georgep/Documents/workspace/r-tester', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python37.zip', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7/lib-dynload', '/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7', '/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7/site-packages']
sys.platform: darwin
sys.prefix: /Users/georgep/Documents/workspace/r-tester/venv/bin/..
sys.stderr.encoding: UTF-8/backslashreplace
sys.stdin.encoding: UTF-8/strict
sys.stdout.encoding: UTF-8/strict
sys.thread_info: sys.thread_info(name='pthread', lock='mutex+cond', version=None)
sys.version: 3.7.3 (default, Mar 27 2019, 09:23:15)  [Clang 10.0.1 (clang-1001.0.46.3)]
sys.version_info: sys.version_info(major=3, minor=7, micro=3, releaselevel='final', serial=0)
sysconfig[ABIFLAGS]: m
sysconfig[CC]: clang
sysconfig[CFLAGS]: -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers
sysconfig[CONFIG_ARGS]: '--prefix=/usr/local/opt/python' '--enable-ipv6' '--datarootdir=/usr/local/opt/python/share' '--datadir=/usr/local/opt/python/share' '--enable-framework=/usr/local/opt/python/Frameworks' '--enable-loadable-sqlite-extensions' '--without-ensurepip' '--with-dtrace' '--with-openssl=/usr/local/opt/openssl' '--without-gcc' 'MACOSX_DEPLOYMENT_TARGET=10.14' 'CFLAGS=-isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers' 'LDFLAGS=-isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk' 'CC=clang' 'PKG_CONFIG_PATH=/usr/local/opt/openssl/lib/pkgconfig:/usr/local/opt/readline/lib/pkgconfig:/usr/local/opt/sqlite/lib/pkgconfig:/usr/local/opt/xz/lib/pkgconfig' 'PKG_CONFIG_LIBDIR=/usr/lib/pkgconfig:/usr/local/Homebrew/Library/Homebrew/os/mac/pkgconfig/10.14'
sysconfig[HOST_GNU_TYPE]: x86_64-apple-darwin18.2.0
sysconfig[MACHDEP]: darwin
sysconfig[MULTIARCH]: darwin
sysconfig[OPT]: -DNDEBUG -g -fwrapv -O3 -Wall
sysconfig[PY_CFLAGS]: -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers
sysconfig[PY_CFLAGS_NODIST]: -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration
sysconfig[PY_CORE_LDFLAGS]: -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk
sysconfig[PY_LDFLAGS]: -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk
sysconfig[PY_STDMODULE_CFLAGS]: -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration -I. -I./Include
sysconfig[Py_DEBUG]: 0
sysconfig[Py_ENABLE_SHARED]: 0
sysconfig[SHELL]: /bin/sh
sysconfig[SOABI]: cpython-37m-darwin
sysconfig[prefix]: /usr/local/opt/python/Frameworks/Python.framework/Versions/3.7
test_socket.HAVE_SOCKET_ALG: False
test_socket.HAVE_SOCKET_CAN: False
test_socket.HAVE_SOCKET_CAN_ISOTP: False
test_socket.HAVE_SOCKET_RDS: False
test_socket.HAVE_SOCKET_VSOCK: False
test_support.IPV6_ENABLED: True
test_support._is_gui_available: False
test_support.python_is_optimized: True
time.altzone: 18000
time.daylight: 1
time.get_clock_info(perf_counter): namespace(adjustable=False, implementation='mach_absolute_time()', monotonic=True, resolution=1e-09)
time.get_clock_info(time): namespace(adjustable=True, implementation='clock_gettime(CLOCK_REALTIME)', monotonic=False, resolution=1.0000000000000002e-06)
time.time: 1561477802.453899
time.timezone: 21600
time.tzname: ('CST', 'CDT')
tkinter.TCL_VERSION: 8.5
tkinter.TK_VERSION: 8.5
tkinter.info_patchlevel: 8.5.9
zlib.ZLIB_RUNTIME_VERSION: 1.2.11
zlib.ZLIB_VERSION: 1.2.11


? otool -L $(python3 -c 'import _tkinter;print(_tkinter.__file__)')
/Users/georgep/Documents/workspace/r-tester/venv/lib/python3.7/lib-dynload/_tkinter.cpython-37m-darwin.so:
        /System/Library/Frameworks/Tcl.framework/Versions/8.5/Tcl (compatibility version 8.5.0, current version 8.5.9)
        /System/Library/Frameworks/Tk.framework/Versions/8.5/Tk (compatibility version 8.5.0, current version 8.5.9)
        /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1252.250.1)
```


@ terry.reedy, sorry to mislabel as a crash. IDLE itself just sorta died, so I interpreted it as an IDLE crash even though it's just an exception in the actual Python interpreter. Oops!
Addressing your questions here:

> Where did you get your Python installer?  Did it include tck/tk?  If not, perhaps python3.exe and the tcl/tk being used do not match.
Got the python installer via Homebrew. 
It appears to include tck/tk. Not 100% sure but I'm guessing based on this line in the traceback that the python installation has TK
`File "/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7/lib/python3.7/tkinter/__init__.py",`
Here is the brew info:

```
?  ~ brew info python
python: stable 3.7.3 (bottled), HEAD
Interpreted, interactive, object-oriented programming language
https://www.python.org/
/usr/local/Cellar/python/3.7.3 (4,094 files, 62.5MB) *
  Poured from bottle on 2019-04-19 at 14:02:45
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/python.rb
==> Dependencies
Build: pkg-config ?
Required: gdbm ?, openssl ?, readline ?, sqlite ?, xz ?
==> Options
--HEAD
	Install HEAD version
==> Caveats
Python has been installed as
  /usr/local/bin/python3

Unversioned symlinks `python`, `python-config`, `pip` etc. pointing to
`python3`, `python3-config`, `pip3` etc., respectively, have been installed into
  /usr/local/opt/python/libexec/bin

If you need Homebrew's Python 2.7 run
  brew install python at 2

You can install Python packages with
  pip3 install <package>
They will install into the site-package directory
  /usr/local/lib/python3.7/site-packages

See: https://docs.brew.sh/Homebrew-and-Python
==> Analytics
install: 347,669 (30 days), 1,285,928 (90 days), 4,302,103 (365 days)
install_on_request: 166,131 (30 days), 625,120 (90 days), 2,423,737 (365 days)
build_error: 0 (30 days)
```

> Does IDLE work at all?  Can you click Help and About IDLE?  If so, what is the tk version?
IDLE works otherwise, yes. It's just the scrolling bug that's causing any issue.
Python Version: 3.7.3
Tk version: 8.5.9
IDLE version: 3.7.3

> I used the pad to move the cursor over the scrollbar slider, held my left finger down on the left side of the pad, and moved the slider and file display with my right finger.  Is this what you did?
I can break down the steps to reproduce on a more physical level
To really break down the steps to reproduce on a physical level:
   
STEPS TO REPRODUCE:
1. Open the IDLE application
    * These steps work regardless of opening Idle 3.app via the finder GUI, or by running `python -m idlelib`
2. Before scrolling, do either of the following so IDLE receives the scroll
    1. Focus on the IDLE application so it's the foreground app (you can do this by clicking on the IDLE app window). The cursor can be over the IDLE app, or outside of it. It doesn't matter since the app is focused.
    2. OR, focus on a different application (IDLE is not foreground anymore) but have IDLE be visible still. Hover the cursor over IDLE. Take care not to click, which would bring IDLE back to the foreground.
3. Scroll. To scroll, do either of the following:
    1. Scroll using the scrollwheel on a conventional external mouse.
    2. Scroll using the touchpad on the Mac. Using two fingers, set them on the touchpad and slide both fingers vertically. A picture is worth a thousand words, so here is a video showing the motion: https://www.youtube.com/watch?v=GV9GDPsO730
4. The IDLE app will "crash" (close). If run from the command line, the UnicodeDecodeError exception will be shown.


@willingc

> What language and encoding are you using on your system? Are you using UTF-16?
I'm on UTF-8, here's some proof
```
? echo $LC_CTYPE
en_US.UTF-8
? echo $LANG

? locale charmap
UTF-8
? python -c "import sys; print(sys.stdout.encoding)"
UTF-8
```

And now finally, back to @Rakesh Singh and @ned.deily,
As given in the otool output above, TK is given as `/System/Library/Frameworks/Tk.framework/Versions/8.5/Tk (compatibility version 8.5.0, current version 8.5.9)`
so what you're saying certainly makes sense.

I can try uninstalling and resintalling python with homebrew and if the problem persists, then is the issue on their end and their reliance on the default Apple TK?
I imagine then the bug would be on their plate.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:03:07 2019
From: report at bugs.python.org (George Pantazes)
Date: Tue, 25 Jun 2019 18:03:07 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561485787.69.0.252829459601.issue37391@roundup.psfhosted.org>


George Pantazes <georgepantazes at gmail.com> added the comment:

Checked against the python.org installation. In that installation's IDLE, About IDLE > Tk version 8.6.8.

So my question is: 
- Is it on me to fix this for my own machine because I should have gotten my own more-up-to-date TK before installing Python via Homebrew?
- Or is this a Homebrew installation bug? And should they include a more up-to-dat TK with their installation?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:09:56 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 25 Jun 2019 18:09:56 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561486196.09.0.611568772006.issue37276@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

I've run the code snippet several times on Mac 10.14.5 with Python 3.7.3. I'm not able to replicate your result for the `ProcessPoolExecutor` but can replicate results for `ThreadPoolExecutor`. Do you have another example where you are seeing this behavior?

----------
nosy: +willingc

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:21:11 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Tue, 25 Jun 2019 18:21:11 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1561486871.25.0.824625661114.issue33972@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +14194
pull_request: https://github.com/python/cpython/pull/14380

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:21:37 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Tue, 25 Jun 2019 18:21:37 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1561486897.39.0.1467666712.issue33972@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +14195
pull_request: https://github.com/python/cpython/pull/14381

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:29:21 2019
From: report at bugs.python.org (Carol Willing)
Date: Tue, 25 Jun 2019 18:29:21 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561487361.16.0.0455874760082.issue37391@roundup.psfhosted.org>


Carol Willing <willingc at gmail.com> added the comment:

George,

This is a Homebrew build issue (see additional notes on the Brew forum https://discourse.brew.sh/t/cannot-get-python-to-use-tcl-tk-version-8-6/3563.

You may wish to try the suggestions found there. My recommendation would be to use the official Python from python.org or the Anaconda distribution for Mac.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:38:56 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 18:38:56 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1561487936.73.0.565223648975.issue33972@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c6e32824cf038386174fe2b9e7273e4779c9958c by Miss Islington (bot) (Abhilash Raj) in branch '3.8':
[3.8] bpo-33972: Fix EmailMessage.iter_attachments raising AttributeError (GH-14119) (GH-14380)
https://github.com/python/cpython/commit/c6e32824cf038386174fe2b9e7273e4779c9958c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:40:45 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 18:40:45 +0000
Subject: [issue33972] AttributeError in email.message.iter_attachments()
In-Reply-To: <1530024211.47.0.56676864532.issue33972@psf.upfronthosting.co.za>
Message-ID: <1561488044.99.0.20738097959.issue33972@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 01b23948038d35b119cededd149110231ecce00d by Miss Islington (bot) (Abhilash Raj) in branch '3.7':
[3.7] bpo-33972: Fix EmailMessage.iter_attachments raising AttributeError. (GH-14119) (GH-14381)
https://github.com/python/cpython/commit/01b23948038d35b119cededd149110231ecce00d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33972>
_______________________________________

From report at bugs.python.org  Tue Jun 25 14:57:21 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Tue, 25 Jun 2019 18:57:21 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561489041.35.0.814687302838.issue37276@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Ned Deily

Okay, I did not know if I had to list the potentially interested people (according to their Github contribution on the module for instance) or let them do it themselves. Thank you for clarifying.

@Carol Willing

The number of RUNNING futures is always `max_workers + 1` for `ProcessPoolExecutor` but only on Windows (CPython 3.7, Windows 10). On MacOS, this number varies, depending on the time you wait before calling `print(future.running())`.
So to reproduce you could add the expression `time.sleep(n)` right after  the statement `futures = [executor.submit(call) for _ in range(8)]` and see if the number of RUNNING futures varies with n.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:11:52 2019
From: report at bugs.python.org (Brett Cannon)
Date: Tue, 25 Jun 2019 19:11:52 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
Message-ID: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

I've been asked enough times about what directory name to use for virtual environments I'm going to update https://docs.python.org/3/library/venv.html#module-venv to suggest `.venv` if you don't have a specific name (`.env` clashes with environment variable definition files which is a common issue I see users run into).

----------
assignee: brett.cannon
components: Documentation
messages: 346549
nosy: brett.cannon
priority: low
severity: normal
stage: needs patch
status: open
title: Recommend .venv for virtual environment names
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:36:21 2019
From: report at bugs.python.org (Akshay Takkar)
Date: Tue, 25 Jun 2019 19:36:21 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
Message-ID: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>


New submission from Akshay Takkar <akshay.takkar101 at gmail.com>:

I'm working on a server that uses sock_recv from asyncio.
await sock_recv(socket, n) never returns if socket is wrapped in ssl using the wrap_socket function from the ssl module.
I think the problem stated in this stackoverflow question could be the reason: https://stackoverflow.com/questions/40346619/behavior-of-pythons-select-with-partial-recv-on-ssl-socket

----------
assignee: christian.heimes
components: SSL, asyncio
files: server_client
messages: 346550
nosy: AkshayTakkar, asvetlov, christian.heimes, yselivanov
priority: normal
severity: normal
status: open
title: asyncio sock_recv blocks on ssl sockets.
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48437/server_client

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:38:28 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 19:38:28 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561491508.78.0.952661055192.issue37391@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

As @willingc notes, it is a Homebrew build issue that should be addressed by Homebrew.  That said, it is also possible that Homebrew builds have been affected by changes in Mojave as mentioned in Issue34956.  I plan to look into that shortly to see if we can make building with a third-party Tk easier on macOS.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:42:40 2019
From: report at bugs.python.org (Christian Heimes)
Date: Tue, 25 Jun 2019 19:42:40 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
In-Reply-To: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>
Message-ID: <1561491760.64.0.00294166973496.issue37404@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

You can't use sock_recv() with a wrapped SSL socket. A SSLSocket behaves differently because there is user-level buffering. The connection operates on TLS frames and only hands off data after it has been decrypted and verified. asyncio uses wrap_bio().

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:45:53 2019
From: report at bugs.python.org (Ned Deily)
Date: Tue, 25 Jun 2019 19:45:53 +0000
Subject: [issue37384] Compiling Python 3.7.3 from source and getting all sorts
 of errors on Debian?
In-Reply-To: <1561373293.1.0.347031657318.issue37384@roundup.psfhosted.org>
Message-ID: <1561491953.92.0.67606481064.issue37384@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Glad it finally worked for you.  It's hard to tell at this point what went wrong originally.  Perhaps there was an "unclean" build as a result of trying to fix the uuid header issue?  In any case, the most recent result you posted looks fine, so unless there is some reproducible problem here, let's close this issue.

----------
resolution:  -> works for me
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37384>
_______________________________________

From report at bugs.python.org  Tue Jun 25 15:57:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 19:57:03 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561492623.26.0.432925921047.issue37396@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Me:
> Should PCbuild/pyproject.vcxproj explicitly import python.props which defines it?

Steve:
> It already does :) 


Well, I was confused by the message. I just fixed the message.

I suggest to close the issue and see if the bug comes back.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 16:18:26 2019
From: report at bugs.python.org (Aleksandr Balezin)
Date: Tue, 25 Jun 2019 20:18:26 +0000
Subject: [issue37347] Reference-counting problem in sqlite
In-Reply-To: <1561029299.63.0.688173181801.issue37347@roundup.psfhosted.org>
Message-ID: <1561493906.57.0.117720375924.issue37347@roundup.psfhosted.org>


Aleksandr Balezin <gescheit12 at gmail.com> added the comment:

I've pushed changes https://github.com/python/cpython/pull/14268/commits/bce7fdc952b14c23821e184e82b3944f6e10aaa9. 
Could I ask for clarification on callback and Py_DECREF(something)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37347>
_______________________________________

From report at bugs.python.org  Tue Jun 25 16:25:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 20:25:13 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561494313.16.0.572180549048.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 1d4b6ba19466aba0eb91c4ba01ba509acf18c723 by Victor Stinner (Miss Islington (bot)) in branch '3.7':
bpo-37400: Fix test_os.test_chown() (GH-14374) (GH-14378)
https://github.com/python/cpython/commit/1d4b6ba19466aba0eb91c4ba01ba509acf18c723


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 16:26:55 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 20:26:55 +0000
Subject: [issue37400] test_os: test_chown() started to fail on AMD64 FreeBSD
 10-STABLE Non-Debug 3.* buildbots
In-Reply-To: <1561460829.65.0.100916954906.issue37400@roundup.psfhosted.org>
Message-ID: <1561494415.46.0.394170270177.issue37400@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I merged my fix. I close the issue and hope that the test will not fail again ;-)

Python 2.7 is not affected: it doesn't have test_chown().

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37400>
_______________________________________

From report at bugs.python.org  Tue Jun 25 16:44:29 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 20:44:29 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1561495469.79.0.178839927743.issue36888@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14196
pull_request: https://github.com/python/cpython/pull/14382

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Tue Jun 25 16:44:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 20:44:31 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1561495471.69.0.0195765505905.issue36888@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 594d9b9f58e1ef0a60b5ce9e590e0f45cd684f26 by Victor Stinner (Pierre Glaser) in branch 'master':
bpo-36888, test_multiprocessing: Increase test_parent_process timeout (GH-14286)
https://github.com/python/cpython/commit/594d9b9f58e1ef0a60b5ce9e590e0f45cd684f26


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Tue Jun 25 17:01:17 2019
From: report at bugs.python.org (Brent Gardner)
Date: Tue, 25 Jun 2019 21:01:17 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
Message-ID: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>


New submission from Brent Gardner <bggardner at gmail.com>:

In Python 3.5.3, a socket with type AF_CAN returns a tuple in the form `(interface, )` from getsockname().  In Python 3.7.3, getsockname() returns a string (the name of the interface).  The documentation states "a tuple is used for the AF_CAN address family".  The string will break code that worked in 3.5.3 by raising errors such as "Value Error: too many values to unpack (expected 2)".

Example:

#3.5.3
import socket
s = socket.socket(socket.AF_CAN, socket.SOCK_RAW, socket.CAN_RAW)
s.bind(('vcan0',)) # requires tuple
s.getsockname() # returns tuple: ('vcan0', 29)

#3.7.3
import socket
s = socket.socket(socket.AF_CAN, socket.SOCK_RAW, socket.CAN_RAW)
s.bind(('vcan0',)) # requires tuple
s.getsockname() # returns string: 'vcan0'

----------
assignee: docs at python
components: Documentation
messages: 346559
nosy: Brent Gardner, docs at python
priority: normal
severity: normal
status: open
title: socket.getsockname() returns string instead of tuple
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Tue Jun 25 17:01:33 2019
From: report at bugs.python.org (Brent Gardner)
Date: Tue, 25 Jun 2019 21:01:33 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
In-Reply-To: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>
Message-ID: <1561496493.14.0.335172149716.issue37405@roundup.psfhosted.org>


Change by Brent Gardner <bggardner at gmail.com>:


----------
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Tue Jun 25 17:12:50 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 21:12:50 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1561497170.76.0.809514809655.issue36888@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4adc38e79495bd06878355fd5270c3f84b77f528 by Miss Islington (bot) in branch '3.8':
bpo-36888, test_multiprocessing: Increase test_parent_process timeout (GH-14286)
https://github.com/python/cpython/commit/4adc38e79495bd06878355fd5270c3f84b77f528


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Tue Jun 25 17:29:37 2019
From: report at bugs.python.org (George Pantazes)
Date: Tue, 25 Jun 2019 21:29:37 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561498177.13.0.344973402389.issue37391@roundup.psfhosted.org>


George Pantazes <georgepantazes at gmail.com> added the comment:

In case anyone would like to weigh in on the Homebrew side, I've filed the homebrew issue here: https://github.com/Homebrew/homebrew-core/issues/41338 .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:20:36 2019
From: report at bugs.python.org (Tyler Wince)
Date: Tue, 25 Jun 2019 22:20:36 +0000
Subject: [issue36917] ast.NodeVisitor no longer calls visit_Str
In-Reply-To: <1557843682.58.0.0807679622364.issue36917@roundup.psfhosted.org>
Message-ID: <1561501236.79.0.507896780817.issue36917@roundup.psfhosted.org>


Tyler Wince <tyler at wince.dev> added the comment:

Another example of the breaking change here is in the security linter `PyCQA/bandit`. It may be a simple addition of a check in the meta parser for the ast but I would tend to agree with Anthony around whether or not it is worth it. 

Anyone else have any thoughts on this since the conversation ended last month?

----------
nosy: +Tyler Wince

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36917>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:27:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 22:27:51 +0000
Subject: [issue36888] Create a way to check that the parent process is alive
 for deamonized processes
In-Reply-To: <1557588992.87.0.32954176975.issue36888@roundup.psfhosted.org>
Message-ID: <1561501671.86.0.563925071191.issue36888@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Pierre Glaser. Let's see if it's enough to make the test more reliable on buildbots ;-)

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36888>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:30:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 22:30:20 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1561501820.07.0.464591694945.issue37244@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset e1a63c4f21011a3ae77dff624196561070c83446 by Victor Stinner (Pierre Glaser) in branch 'master':
bpo-37244: Fix test_multiprocessing.test_resource_tracker() (GH-14288)
https://github.com/python/cpython/commit/e1a63c4f21011a3ae77dff624196561070c83446


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:30:33 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 22:30:33 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1561501833.5.0.0495943754083.issue37244@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14197
pull_request: https://github.com/python/cpython/pull/14383

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:31:23 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 22:31:23 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561501883.41.0.287306764813.issue37276@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

All the pending work items are added to a call queue that the processes consume (_add_call_item_to_queue) and the status is set before adding it to said queue (by calling set_running_or_notify_cancel()). Notice that the fact that future.running() == True does not mean that a worker has picked up the work item. The worker function (_process_worker for the ProcessPoolExecutor) gets items for this queue and then sends back results in another queue (result queue). If you add extra debugging you will see that only two items are dequeued from the call_queue:


--- a/Lib/concurrent/futures/process.py
+++ b/Lib/concurrent/futures/process.py
@@ -231,6 +231,7 @@ def _process_worker(call_queue, result_queue, initializer, initargs):
             return
     while True:
         call_item = call_queue.get(block=True)
+        print("Worker: Getting a new item")
         if call_item is None:
             # Wake up queue management thread
             result_queue.put(os.getpid())
@@ -277,6 +278,7 @@ def _add_call_item_to_queue(pending_work_items,
             work_item = pending_work_items[work_id]
 
             if work_item.future.set_running_or_notify_cancel():
+                print("Adding a new item to the call_queue")
                 call_queue.put(_CallItem(work_id,
                                          work_item.fn,
                                          work_item.args,
(END)


Executing your script:

import time, concurrent.futures

def call():
    while True:
        time.sleep(1)


if __name__ == "__main__":
    with concurrent.futures.ProcessPoolExecutor(max_workers=2) as executor:
        futures = [executor.submit(call) for _ in range(8)]
        time.sleep(2)

        for future in futures:
            print(future.running())

Prints:

Adding a new item to the call_queue
Adding a new item to the call_queue
Adding a new item to the call_queue
Worker: Getting a new item
Worker: Getting a new item
True
True
True
False
False
False
False
False

----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:41:26 2019
From: report at bugs.python.org (Steve Dower)
Date: Tue, 25 Jun 2019 22:41:26 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561502486.73.0.496239299773.issue37396@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I suggest to close the issue and see if the bug comes back.

You opened it, so sure :)

----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:49:34 2019
From: report at bugs.python.org (miss-islington)
Date: Tue, 25 Jun 2019 22:49:34 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1561502974.91.0.0783870006268.issue37244@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset dd4edbc5ad4cdb47e051e7cc0801d31d3786588b by Miss Islington (bot) in branch '3.8':
bpo-37244: Fix test_multiprocessing.test_resource_tracker() (GH-14288)
https://github.com/python/cpython/commit/dd4edbc5ad4cdb47e051e7cc0801d31d3786588b


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:49:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 22:49:47 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561502987.33.0.181782063072.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> See issue 36067 for a related discussion. The _active list and _cleanup function are not required in Windows. When a process exits, it gets rundown to free its handle table and virtual memory. Only the kernel object remains, which is kept alive by pointer and handle references to it that can query information such as the exit status code. As soon as the last reference is closed, the Process object is automatically reaped. It doesn't have to be waited on.

Linux (for example) has the same design: the kernel doesn't keep a "full process" alive, but a lightweight structure just for its parent process which gets the exit status. That's the concept of "zombie process".

One issue on Linux is that the zombie process keeps the pid used until the parent reads the child exit status, and Linux pids are limited to 32768 by default.

Now I'm not sure that I understand what it means on Windows. The subprocess module uses a magic Handle object which calls CloseHandle(handle) in its __del__() method. I dislike relying on destructors. If an object is kept alive by a reference cycle, it's never released: CloseHandle() isn't called.

So code spawning process should wait until subprocesses complete to ensure that CloseHandle() is called, no?

Except that Popen._internal_poll() doesn't clear the handle even after the process completes.

If Popen.__del__() doesn't add active processes to the _active list, it should at least explicitly call CloseHandle(), no?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Tue Jun 25 18:51:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 22:51:08 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561503068.37.0.166709336524.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 22eb689cf3de7972a2789db3ad01a86949508ab7 by Victor Stinner in branch 'master':
bpo-37388: Development mode check encoding and errors (GH-14341)
https://github.com/python/cpython/commit/22eb689cf3de7972a2789db3ad01a86949508ab7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:16:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:16:31 +0000
Subject: [issue37406] Disable runtime checks in release mode
Message-ID: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

A Python debug build is ABI compatible with a Python release build since Python 3.8 on most platforms (except Windows, Cygwin and Android):
https://docs.python.org/3.8/whatsnew/3.8.html#debug-build-uses-the-same-abi-as-release-build

It should now be way easier to debug an application with a debug build.

I propose to remove runtime debug checks in release mode. assert() is already widely used in the C code base, but there are many runtime checks using PyErr_BadInternalCall() or PyErr_BadArgument. Example:

Py_ssize_t
PyUnicode_GetLength(PyObject *unicode)
{
    if (!PyUnicode_Check(unicode)) {
        PyErr_BadArgument();
        return -1;
    }
    if (PyUnicode_READY(unicode) == -1)
        return -1;
    return PyUnicode_GET_LENGTH(unicode);
}

Attached PR removes these checks when Python is compiled in release mode: when Py_DEBUG is not defined.

Even if I marked this issue as "performance", I don't expect a significant speedup.

----------
components: Interpreter Core
messages: 346570
nosy: vstinner
priority: normal
severity: normal
status: open
title: Disable runtime checks in release mode
type: performance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:19:30 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:19:30 +0000
Subject: [issue37406] Disable debug runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <1561504770.5.0.851084878149.issue37406@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: Disable runtime checks in release mode -> Disable debug runtime checks in release mode

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:21:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:21:17 +0000
Subject: [issue37406] Disable debug runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <1561504877.49.0.223651926734.issue37406@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14198
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14384

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:24:06 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 23:24:06 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561505046.35.0.677485839182.issue37163@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:25:29 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Tue, 25 Jun 2019 23:25:29 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561505129.96.0.70157272497.issue37163@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:28:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:28:20 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561505300.67.0.477499359887.issue37388@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14199
pull_request: https://github.com/python/cpython/pull/14385

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:37:37 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:37:37 +0000
Subject: [issue37244] test_multiprocessing_forkserver: test_resource_tracker()
 failed on x86 Gentoo Refleaks 3.8
In-Reply-To: <1560339911.07.0.931464630019.issue37244@roundup.psfhosted.org>
Message-ID: <1561505857.38.0.730074347982.issue37244@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Thanks Pierre Glaser. I close the issue.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37244>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:39:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:39:32 +0000
Subject: [issue37396] [2.7] PCbuild/pythoncore.vcxproj kills the wrong program
In-Reply-To: <1561425837.76.0.674598790418.issue37396@roundup.psfhosted.org>
Message-ID: <1561505972.84.0.0580360613259.issue37396@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My question was more for Zachary who proposed: "backporting GH-9901 to 2.7 would probably also be good even though it was solving a different issue".

But as I wrote, I'm not comfortable to backport such change in Python 2.7. I prefer to avoid changes except if we really have to fix it.

So yeah, let's see if the bug strikes back. At least, we should now see if the build systems attempt to kill python.exe or python_d.exe.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37396>
_______________________________________

From report at bugs.python.org  Tue Jun 25 19:49:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Tue, 25 Jun 2019 23:49:35 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561506575.55.0.548168412952.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ed076ed467264b43ed01a8223ca65b133b590919 by Victor Stinner in branch 'master':
bpo-37388: Add PyUnicode_Decode(str, 0) fast-path (GH-14385)
https://github.com/python/cpython/commit/ed076ed467264b43ed01a8223ca65b133b590919


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Tue Jun 25 20:12:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 00:12:39 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561507959.04.0.166549502632.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I compared ref (commit e1a63c4f21011a3ae77dff624196561070c83446) to patch (commit ed076ed467264b43ed01a8223ca65b133b590919). I ran bench.py using:

# edit Makefile.pre.in to use:
PROFILE_TASK=-m test.regrtest --pgo test_unicode test_codecs

./configure --enable-optimizations && make
./python -m venv env && env/bin/python -m pip install -U pyperf
./env/bin/python bench.py -o <file>.json

$ python3 -m pyperf compare_to ref_e1a63c4f2.json patch_ed076ed4.json 
0B: Mean +- std dev: [ref_e1a63c4f2] 76.7 ns +- 0.9 ns -> [patch_ed076ed4] 77.5 ns +- 2.9 ns: 1.01x slower (+1%)
1B: Mean +- std dev: [ref_e1a63c4f2] 92.9 ns +- 0.8 ns -> [patch_ed076ed4] 94.0 ns +- 2.4 ns: 1.01x slower (+1%)
5B: Mean +- std dev: [ref_e1a63c4f2] 106 ns +- 2 ns -> [patch_ed076ed4] 110 ns +- 2 ns: 1.04x slower (+4%)
10B: Mean +- std dev: [ref_e1a63c4f2] 105 ns +- 1 ns -> [patch_ed076ed4] 109 ns +- 1 ns: 1.03x slower (+3%)
25B: Mean +- std dev: [ref_e1a63c4f2] 108 ns +- 3 ns -> [patch_ed076ed4] 111 ns +- 3 ns: 1.03x slower (+3%)
100B: Mean +- std dev: [ref_e1a63c4f2] 114 ns +- 1 ns -> [patch_ed076ed4] 115 ns +- 2 ns: 1.01x slower (+1%)
1000B: Mean +- std dev: [ref_e1a63c4f2] 267 ns +- 3 ns -> [patch_ed076ed4] 253 ns +- 4 ns: 1.06x faster (-5%)

$ python3 -m pyperf compare_to ref_e1a63c4f2.json patch_ed076ed4.json  --table
+-----------+---------------+-----------------------------+
| Benchmark | ref_e1a63c4f2 | patch_ed076ed4              |
+===========+===============+=============================+
| 0B        | 76.7 ns       | 77.5 ns: 1.01x slower (+1%) |
+-----------+---------------+-----------------------------+
| 1B        | 92.9 ns       | 94.0 ns: 1.01x slower (+1%) |
+-----------+---------------+-----------------------------+
| 5B        | 106 ns        | 110 ns: 1.04x slower (+4%)  |
+-----------+---------------+-----------------------------+
| 10B       | 105 ns        | 109 ns: 1.03x slower (+3%)  |
+-----------+---------------+-----------------------------+
| 25B       | 108 ns        | 111 ns: 1.03x slower (+3%)  |
+-----------+---------------+-----------------------------+
| 100B      | 114 ns        | 115 ns: 1.01x slower (+1%)  |
+-----------+---------------+-----------------------------+
| 1000B     | 267 ns        | 253 ns: 1.06x faster (-5%)  |
+-----------+---------------+-----------------------------+

The overhead of my change is around 1 ns, 4 ns (on 106 ns) in the worst case (5B).

The change "looks" faster on the 1000B case, but it's likely a glitch of PGO compilation which is not really deterministic.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Tue Jun 25 20:13:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 00:13:23 +0000
Subject: [issue37388] unknown error handlers should be reported early
In-Reply-To: <1561385452.16.0.600106929179.issue37388@roundup.psfhosted.org>
Message-ID: <1561508003.09.0.30419502052.issue37388@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, the encoding and errors are now checked in almost all cases if you enable the development mode using -X dev command line option.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37388>
_______________________________________

From report at bugs.python.org  Tue Jun 25 20:47:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 00:47:57 +0000
Subject: [issue37406] Disable debug runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <1561510077.93.0.550027375965.issue37406@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14200
pull_request: https://github.com/python/cpython/pull/14386

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Tue Jun 25 21:08:21 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 26 Jun 2019 01:08:21 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561511301.03.0.0311726244409.issue23014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Hi! just stumbled on this as I was updating pytest's import hook.  I notice in PEP 451 this is still marked as optional (then again, I don't know whether PEPs are supposed to be living standards or not, or if there was a PEP which supersedes that one with better direction?)

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Tue Jun 25 21:16:27 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 01:16:27 +0000
Subject: [issue37406] Disable debug runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <1561511787.54.0.82630536745.issue37406@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset c6a2320e876354ee62cf8149b849bcff9492d38a by Victor Stinner in branch 'master':
bpo-37406: sqlite3 raises TypeError for wrong operation type (GH-14386)
https://github.com/python/cpython/commit/c6a2320e876354ee62cf8149b849bcff9492d38a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Tue Jun 25 21:48:22 2019
From: report at bugs.python.org (Daniel Hilst Selli)
Date: Wed, 26 Jun 2019 01:48:22 +0000
Subject: [issue36917] ast.NodeVisitor no longer calls visit_Str
In-Reply-To: <1557843682.58.0.0807679622364.issue36917@roundup.psfhosted.org>
Message-ID: <1561513702.24.0.363263089932.issue36917@roundup.psfhosted.org>


Change by Daniel Hilst Selli <danielhilst at gmail.com>:


----------
nosy: +dhilst

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36917>
_______________________________________

From report at bugs.python.org  Tue Jun 25 21:56:21 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 01:56:21 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561514181.64.0.298891015968.issue37380@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

The handle can deliberately live beyond the process, but it does not have to. If it is closed early then the kernel object will be freed when no handles remain, which will be at process exit.

So it's a classic __exit__/__del__ case, where both are needed if you want deterministic resource disposal. But it is in no way tied to the life of the child process, so waiting first is optional.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Tue Jun 25 22:36:44 2019
From: report at bugs.python.org (Abhilash Raj)
Date: Wed, 26 Jun 2019 02:36:44 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561516604.2.0.392771088894.issue29412@roundup.psfhosted.org>


Change by Abhilash Raj <raj.abhilash1 at gmail.com>:


----------
pull_requests: +14201
pull_request: https://github.com/python/cpython/pull/14387

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Tue Jun 25 22:51:26 2019
From: report at bugs.python.org (Brent Gardner)
Date: Wed, 26 Jun 2019 02:51:26 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
In-Reply-To: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>
Message-ID: <1561517486.62.0.595922102497.issue37405@roundup.psfhosted.org>


Brent Gardner <bggardner at gmail.com> added the comment:

Changed caused by commit effc12f8e9e20d0951d2ba5883587666bd8218e3 to cpython/Modules/socketmodule.c on Sep 6, 2017.

----------
components: +Extension Modules

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Tue Jun 25 22:54:32 2019
From: report at bugs.python.org (Brent Gardner)
Date: Wed, 26 Jun 2019 02:54:32 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
In-Reply-To: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>
Message-ID: <1561517672.56.0.041733851545.issue37405@roundup.psfhosted.org>


Brent Gardner <bggardner at gmail.com> added the comment:

Correction, change caused by a30f6d45ac3e72761b96a8df0527182029eaee24 to cpython/Modules/socketmodule.c on Aug 28, 2017.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Tue Jun 25 23:43:46 2019
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 26 Jun 2019 03:43:46 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561520626.22.0.194609269571.issue37380@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> One issue on Linux is that the zombie process keeps the pid used until 
> the parent reads the child exit status, and Linux pids are limited to
> 32768 by default.

Windows allocates Process and Thread IDs out of a kernel handle table, which can grow to about 2**24 entries (more than 16 million). So the practical resource limit for inactive Process and Thread objects is available memory, not running out of PID/TID values.

> Linux (for example) has the same design: the kernel doesn't keep a 
> "full process" alive, but a lightweight structure just for its parent
> process which gets the exit status. That's the concept of "zombie 
> process".

In Unix, the zombie remains visible in the task list (marked as <defunct> in Linux), but in Windows an exited process is removed from the Process Manager's active list, so it's no longer visible to users. Also, a Process object is reaped as soon as the last reference to it is closed, since clearly no one needs it anymore. 

> The subprocess module uses a magic Handle object which calls 
> CloseHandle(handle) in its __del__() method. I dislike relying on 
> destructors. If an object is kept alive by a reference cycle, it's
> never released: CloseHandle() isn't called.

We could call self._handle.Close() in _wait(), right after calling GetExitCodeProcess(self._handle). With this change, __exit__ will ensure that _handle gets closed in a deterministic context. Code that needs the handle indefinitely can call _handle.Detach() before exiting the with-statement context, but that should rarely be necessary.

I don't understand emitting a resource warning in Popen.__del__ if a process hasn't been waited on until completion beforehand (i.e. self.returncode is None). If a script wants to be strict about this, it can use a with statement, which is documented to wait on the process. 

I do understand emitting a resource warning in Popen.__del__ if self._internal_poll() is None. In this case, in Unix only now, the process gets added to the _active list to try to avoid leaking a zombie. The list gets polled in subprocess._cleanup, which is called in Popen.__init__. Shouldn't _cleanup also be set as an atexit function?

There should be a way to indicate a Popen instance is intended to continue running detached from our process, so scripts don't have to ignore an irrelevant resource warning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Tue Jun 25 23:51:49 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Wed, 26 Jun 2019 03:51:49 +0000
Subject: [issue13127] xml.dom.Attr.name is not labeled as read-only
In-Reply-To: <1318047492.07.0.217686953928.issue13127@psf.upfronthosting.co.za>
Message-ID: <1561521109.19.0.73619285844.issue13127@roundup.psfhosted.org>


Giovanni Cappellotto <potomak84 at gmail.com> added the comment:

I took a quick look at `minidom.py` and `test_minidom.py`. It seems that you should always use `doc.renameNode(attr, namespace, new_name)` for renaming an attribute (or an element).

When `doc.renameNode` is applied on an attribute node, it removes the attribute from the `ownerElement` and re-set it after renaming it.

For instance:

```
>>> import xml.dom.minidom
>>> from xml.dom import minidom
>>> doc = minidom.parseString("<a href=\"http://foo.com\">foo</a>")
>>> attr = doc.childNodes[0].attributes.item(0)
>>> doc.renameNode(attr, xml.dom.EMPTY_NAMESPACE, "bar")
<xml.dom.minidom.Attr object at 0x7fb27d7ddb00>
>>> doc.toxml()
'<?xml version="1.0" ?><a bar="http://foo.com">foo</a>'
```

I agree that this behavior should be documented somewhere.

Maybe there should be a note/warning in the `name` attribute description. It should says that resetting an attribute `name` won't change the document representation and that `doc.renameNode` should be used instead.

Another approach may be to update the `name` setter implementation to remove and then re-set the attribute in the `ownerElement`.

What do you think it's the best approach:

1. update the doc
2. update the `name` setter implementation

I'd be happy to help to fix this issue.

----------
nosy: +potomak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue13127>
_______________________________________

From report at bugs.python.org  Wed Jun 26 00:14:59 2019
From: report at bugs.python.org (Lisa Roach)
Date: Wed, 26 Jun 2019 04:14:59 +0000
Subject: [issue37251] Mocking a MagicMock with a function spec results in an
 AsyncMock
In-Reply-To: <1560348018.57.0.546920052201.issue37251@roundup.psfhosted.org>
Message-ID: <1561522499.31.0.401099021636.issue37251@roundup.psfhosted.org>


Lisa Roach <lisaroach14 at gmail.com> added the comment:

Yes, sorry I wasn't clear, I was thinking about the functions and testing without your PR. I think removing the __code__ object (or working around it) is the correct way to go, but just removing it wouldn't solve this particular problem.

"If I understand the awaitable examples correctly, mocking the obj which is an Awaitable should be returning an AsyncMock. But obj doesn't contain __code__ and hence check for inspect.isawaitable is never done causing _is_async_obj(obj) to return False and subsequently it's patched with MagicMock."

Exactly! This is why I think technically removing the __code__ check is correct. Probably removing the __code__ attribute for any AsyncMock that is mocking an async object and not an async function is best, but I don't know how I would do that. 

I may also be misunderstanding some asyncio concepts, that is just what I observed :)


What if instead of checking for the __code__ object at all we check if there it is a Mock object (excluding AsyncMock):
    

    def _is_async_obj(obj):
        sync_mocks = [MagicMock, Mock, PropertyMock, NonCallableMock, NonCallableMagicMock]
        if (any(isinstance(obj, sync_mock) for sync_mock in sync_mocks)
                and not isinstance(obj, AsyncMock)):
            return False
        return asyncio.iscoroutinefunction(obj) or inspect.isawaitable(obj)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37251>
_______________________________________

From report at bugs.python.org  Wed Jun 26 01:28:49 2019
From: report at bugs.python.org (Edward Smith)
Date: Wed, 26 Jun 2019 05:28:49 +0000
Subject: [issue37407] Update imaplib.py to account for additional padding
Message-ID: <1561526929.45.0.528897435215.issue37407@roundup.psfhosted.org>


New submission from Edward Smith <edwardmbsmith at icloud.com>:

Regex for imaplib should account for IMAP servers which return one or two whitespaces after the * in responses. For example when using davmail as an interpreter between exchange to IMAP 

Acceptable response is as follows:
```
  58:24.54 > PJJD3 EXAMINE INBOX
  58:24.77 < * 486 EXISTS
  58:24.78      matched r'\* (?P<data>\d+) (?P<type>[A-Z-]+)( (?P<data2>.*))?' => ('486', 'EXISTS', None, None)
  58:24.78 untagged_responses[EXISTS] 0 += ["486"]
```
Davmail response:
```
57:50.86 > KPFE3 EXAMINE INBOX
  57:51.10 < *  953 EXISTS
  57:51.10 last 0 IMAP4 interactions:
  57:51.10 > KPFE4 LOGOUT
```

See additional whitespace after the * on line 2

To be fixed by allowing the regex to account for one or two whitespaces
```python
br'\*[ ]{1,2}(?P<data>\d+) (?P<type>[A-Z-]+)( (?P<data2>.*))?'
```

----------
components: email
messages: 346584
nosy: barry, edwardmbsmith, r.david.murray
priority: normal
pull_requests: 14202
severity: normal
status: open
title: Update imaplib.py to account for additional padding
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37407>
_______________________________________

From report at bugs.python.org  Wed Jun 26 01:31:55 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 26 Jun 2019 05:31:55 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
In-Reply-To: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>
Message-ID: <1561527115.47.0.155740508432.issue37405@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +christian.heimes

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Wed Jun 26 02:51:48 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 26 Jun 2019 06:51:48 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561531908.3.0.867564537079.issue37391@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

It seems that the current warning
  WARNING: The version of Tcl/Tk (8.5.9) in use may be unstable. Visit
  http://www.python.org/download/mac/tcltk/ for current information.
is not visible or strong enough to prevent spurious issues like this.

I would like to either 1. make it much more visible -- all caps or whatever -- stronger -- "is buggy, will eventually fail" -- and explicitly request "don't report problems if you continue"; or 2. require 8.5.15 or even 8.6.x and refuse to continue and exit.

Does IDLE every run long enough with Apple's tk before failure to make continuing useful?

Any comments here before I open a new issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:40:19 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Wed, 26 Jun 2019 07:40:19 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
Message-ID: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>


New submission from Pascal Chambon <chambon.pascal at gmail.com>:

According to https://bugs.python.org/issue30661#msg339300 , "format" argument of Tarfile.open() only concerns the writing of files. It's worth mentioning it in the doc, if it's True (confirmation from core maintainers is welcome).

----------
components: Library (Lib)
messages: 346586
nosy: pakal
priority: normal
severity: normal
status: open
title: [DOC] Precise that Tarfile "format" argument only concerns writing.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:44:15 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Wed, 26 Jun 2019 07:44:15 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
In-Reply-To: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>
Message-ID: <1561535055.62.0.821070750194.issue37408@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

PR is on https://github.com/pakal/cpython/pull/1

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:47:24 2019
From: report at bugs.python.org (Marc-Andre Lemburg)
Date: Wed, 26 Jun 2019 07:47:24 +0000
Subject: [issue37406] Disable runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <e764545b-255a-82ed-a2a3-0ba3a6c8d4bf@egenix.com>


Marc-Andre Lemburg <mal at egenix.com> added the comment:

Given that extensions call these APIs, I find it highly risky to
disable these checks in any version of the Python runtime and
am -1 on such a change.

Using assert() in C is a pretty bad alternative, since this crashes
the whole process. It should really only be used where no other
means of error handling are possible. Python's exception mechanism
is a much better way to signal and handle such errors at the
application level.

-- 
Marc-Andre Lemburg
eGenix.com

Professional Python Services directly from the Experts (#1, Jun 26 2019)
>>> Python Projects, Coaching and Consulting ...  http://www.egenix.com/
>>> Python Database Interfaces ...           http://products.egenix.com/
>>> Plone/Zope Database Interfaces ...           http://zope.egenix.com/
________________________________________________________________________

::: We implement business ideas - efficiently in both time and costs :::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611
               http://www.egenix.com/company/contact/
                      http://www.malemburg.com/

----------
nosy: +lemburg
title: Disable debug runtime checks in release mode -> Disable runtime checks in release mode

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:47:29 2019
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 26 Jun 2019 07:47:29 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
In-Reply-To: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>
Message-ID: <1561535249.94.0.0883824551887.issue37408@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14203
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14389

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:49:15 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Wed, 26 Jun 2019 07:49:15 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
In-Reply-To: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>
Message-ID: <1561535355.27.0.389241551635.issue37408@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

My bad, this was a wrongly targeted PR, the real one is here: https://github.com/python/cpython/pull/14389

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 03:51:11 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 07:51:11 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561535471.78.0.00374057527093.issue37163@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +14204
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14390

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 26 04:03:43 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Wed, 26 Jun 2019 08:03:43 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561536223.59.0.366445484109.issue37276@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Pablo Galindo Salgado

Thank you for the debugging information. I would have expected 8 "Adding a new item to the call_queue" instead of 3, since I submitted 8 calls to the process pool.

The concurrent.futures._base module defines 5 future states:

> _FUTURE_STATES = [
>     PENDING,
>     RUNNING,
>     CANCELLED,
>     CANCELLED_AND_NOTIFIED,
>     FINISHED
> ]

The concurrent.futures.process module explains the job flow:

> Local worker thread:
> - reads work ids from the "Work Ids" queue and looks up the corresponding
>   WorkItem from the "Work Items" dict: if the work item has been cancelled then
>   it is simply removed from the dict, otherwise it is repackaged as a
>   _CallItem and put in the "Call Q". New _CallItems are put in the "Call Q"
>   until "Call Q" is full. NOTE: the size of the "Call Q" is kept small because
>   calls placed in the "Call Q" can no longer be cancelled with Future.cancel().
> - reads _ResultItems from "Result Q", updates the future stored in the
>   "Work Items" dict and deletes the dict entry

So for implementation reasons (allowing `Future.cancel()`), submitted calls are put in an intermediary unbounded pending dict instead of directly in the call queue (which should be the pending queue), and this queue is bounded instead of being unbounded. Note that is not the case for the concurrent.futures.thread module for which calls are directly submitted to an unbounded call queue (pending queue).

And for optimization reasons, the chosen size for this bounded call queue is `max_workers + 1` instead of `max_workers`, as defined here:

> # Create communication channels for the executor
> # Make the call queue slightly larger than the number of processes to
> # prevent the worker processes from idling. But don't make it too big
> # because futures in the call queue cannot be cancelled.
> queue_size = self._max_workers + EXTRA_QUEUED_CALLS
> self._call_queue = _SafeQueue(
>     max_size=queue_size, ctx=self._mp_context,
>     pending_work_items=self._pending_work_items)

and here:

> # Controls how many more calls than processes will be queued in the call queue.
> # A smaller number will mean that processes spend more time idle waiting for
> # work while a larger number will make Future.cancel() succeed less frequently
> # (Futures in the call queue cannot be cancelled).
> EXTRA_QUEUED_CALLS = 1

PENDING calls are put in the call queue until the queue is full:

>     while True:
>         if call_queue.full():
>             return
>         try:
>             work_id = work_ids.get(block=False)
>         except queue.Empty:
>             return
>         else:
>             work_item = pending_work_items[work_id]
> 
>             if work_item.future.set_running_or_notify_cancel():
>                 call_queue.put(_CallItem(work_id,
>                                          work_item.fn,
>                                          work_item.args,
>                                          work_item.kwargs),
>                                block=True)
>             else:
>                 del pending_work_items[work_id]
>                 continue

The state of the call is updated to RUNNING right *before* the call is put in the call queue by the method `Future.set_running_or_notify_cancel()` instead of when the call is consumed from the call queue by a worker process here:

>     while True:
>         call_item = call_queue.get(block=True)
>         if call_item is None:
>             # Wake up queue management thread
>             result_queue.put(os.getpid())
>             return
>         try:
>             r = call_item.fn(*call_item.args, **call_item.kwargs)
>         except BaseException as e:
>             exc = _ExceptionWithTraceback(e, e.__traceback__)
>             _sendback_result(result_queue, call_item.work_id, exception=exc)
>         else:
>             _sendback_result(result_queue, call_item.work_id, result=r)
> 
>         # Liberate the resource as soon as possible, to avoid holding onto
>         # open files or shared memory that is not needed anymore
>         del call_item

So when creating a process pool of 2 workers, a call queue of size 3 is created. When submitting 8 calls to the pool, all of them are put in a pending dict, then 3 of 8 of them are updated from the PENDING state to the RUNNING state and put in the call queue, then 2 of 3 are consumed by the 2 workers leaving the call queue with 2 empty places and finally 2 of 5 remaining calls in the pending dict are updated from the PENDING state to the RUNNING state and put in the call queue. So to my understanding, in the end the current implementation should show 5 RUNNING states (2 calls currently being executed by the 2 workers, 3 calls pending in the call queue).
On MacOS I get these 5 RUNNING states, but sometimes 4. On Windows always 3.
But this is wrong in all cases: the user expects 2, since RUNNING = "being executed by a worker process", not "being executed by a worker process or pending in the call queue".

When the number of submitted calls is less than or equal to the number of workers, everything is fine: the number of RUNNING calls is the number of calls currently being executed by a worker process (since with the current implementation all calls are put in the call queue and directly consumed by a worker process, since both the size of the queue and the number of worker processes are greater or equal to the number of submitted calls).

However when the number of submitted calls is strictly greater than the number of workers, the number of RUNNING calls makes no sense.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Wed Jun 26 04:03:39 2019
From: report at bugs.python.org (Pascal Chambon)
Date: Wed, 26 Jun 2019 08:03:39 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
In-Reply-To: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>
Message-ID: <1561536219.02.0.570521301988.issue37408@roundup.psfhosted.org>


Pascal Chambon <chambon.pascal at gmail.com> added the comment:

Looking at tarfile.py, "format" seems only used in addfile() indeed.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 04:09:50 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Wed, 26 Jun 2019 08:09:50 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561536590.78.0.402606383115.issue37335@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

I just added that in the way it was already there but I see why the current solution is not the best. Also I wanted to push this into 3.7 only as this problem is not present in 3.8 (as discussed in the PR 11195 opened incorrectly against the master).

Just to be sure: what you propose is to rewrite current replaces to use "codecs.lookup(encoding).name" instead and then push it into the master?
Ok, I will look into it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Wed Jun 26 04:40:09 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 26 Jun 2019 08:40:09 +0000
Subject: [issue37408] [DOC] Precise that Tarfile "format" argument only
 concerns writing.
In-Reply-To: <1561534819.95.0.472711593615.issue37408@roundup.psfhosted.org>
Message-ID: <1561538409.4.0.102341077209.issue37408@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +lars.gustaebel, serhiy.storchaka
type:  -> behavior
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37408>
_______________________________________

From report at bugs.python.org  Wed Jun 26 05:11:26 2019
From: report at bugs.python.org (Ben Lewis)
Date: Wed, 26 Jun 2019 09:11:26 +0000
Subject: [issue37409] relative import_from without parent
Message-ID: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>


New submission from Ben Lewis <benjamin.r.lewis at gmail.com>:

>>> from curses import ascii
>>> from . import ascii

The second line should raise an ImportError but instead succeeds (tested cpython 3.6.7, 3.7.0 and 3.7.3, and from interactive interpreter and scripts). Specifically, builtins.__import__ does not reproduce the behaviour of importlib._bootstrap.__import__; maybe ceval.c:import_from is neglecting to check that there are parent packages when attempting a relative import?

More details here: https://stackoverflow.com/a/56768129/5104777

----------
components: Interpreter Core
messages: 346593
nosy: Ben Lewis2
priority: normal
severity: normal
status: open
title: relative import_from without parent
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Wed Jun 26 05:12:24 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 26 Jun 2019 09:12:24 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561540344.76.0.0635546497922.issue37276@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Adding a new state for "not running and not pending but something in between" is useless, it can make .running() result a little more accurate but doesn't improve the real functionality.

The easy "fix" is documentation updating to point that the value returned by running is an approximation. That's true anyway because the future may change its state between reading self._state and returning a result.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Wed Jun 26 05:31:21 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Wed, 26 Jun 2019 09:31:21 +0000
Subject: [issue37409] relative import_from without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561541481.63.0.669546160923.issue37409@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
nosy: +brett.cannon, eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Wed Jun 26 05:51:57 2019
From: report at bugs.python.org (Cheuk Ting Ho)
Date: Wed, 26 Jun 2019 09:51:57 +0000
Subject: [issue36661] Missing dataclass decorator import in dataclasses module
 docs
In-Reply-To: <1555616208.44.0.536731608649.issue36661@roundup.psfhosted.org>
Message-ID: <1561542717.46.0.286025415851.issue36661@roundup.psfhosted.org>


Cheuk Ting Ho <cheukting.ho at gmail.com> added the comment:

I agree that for the more confusing ones, it would be better to write out the import statement explicitly.

----------
nosy: +Cheukting

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36661>
_______________________________________

From report at bugs.python.org  Wed Jun 26 05:53:14 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 26 Jun 2019 09:53:14 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561542794.52.0.325366663413.issue37276@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:

I concur with Andrew

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Wed Jun 26 06:20:58 2019
From: report at bugs.python.org (Akshay Takkar)
Date: Wed, 26 Jun 2019 10:20:58 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
In-Reply-To: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>
Message-ID: <1561544458.93.0.587180828339.issue37404@roundup.psfhosted.org>


Akshay Takkar <akshay.takkar101 at gmail.com> added the comment:

Can you please elaborate on how to get around this issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Wed Jun 26 06:35:47 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 26 Jun 2019 10:35:47 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
In-Reply-To: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>
Message-ID: <1561545347.83.0.407653884457.issue37404@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Use asyncio transports or streams.
sock_recv() is a low-level API with a very limited audience.

wrapped ssl socket provides a synchronous interface only.

Perhaps we should raise an exception if SSLSocket is passed into asyncio functions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Wed Jun 26 06:48:50 2019
From: report at bugs.python.org (Akshay Takkar)
Date: Wed, 26 Jun 2019 10:48:50 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
In-Reply-To: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>
Message-ID: <1561546130.03.0.258707907121.issue37404@roundup.psfhosted.org>


Akshay Takkar <akshay.takkar101 at gmail.com> added the comment:

Ah, I see. Yes, raising an exception would probably be very useful. Thanks for the info.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:06:32 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 11:06:32 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561547192.88.0.623012584567.issue37382@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Depending on the compiler optimization level, gdb may or may not br able to read variables and function arguments. IHMO it is fine to skip test_gdb if Python "is optimized". I don't think it is worth it to check the exact optimizatio level.

The worst debugging experience is provided by PGO build.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:31:27 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 11:31:27 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561548687.34.0.0532564565581.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Depending on the compiler optimization level, gdb may or may not br able to read variables and function arguments.

I haven't seen that problem. As I said, all GDB tests pass when compiled with "-O3 -g".

> IHMO it is fine to skip test_gdb if Python "is optimized".

The fact that these GDB tests are not run in any CI build is bad. For example, we had a buildbot failure after merging PEP 590 because of this. We should try to catch test breakage as early as possible, the buildbot should be the last resort.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:44:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 11:44:08 +0000
Subject: [issue37335] Add 646 ASCII alias to locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561549448.74.0.772013339791.issue37335@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

>  what you propose is to rewrite current replaces to use "codecs.lookup(encoding).name" instead and then push it into the master?

I suggest to remove the code which does the .replace(), but instead normalize the encoding when checking for the expected encoding (near .assertEqual()). I still see the .replace() code in master, so yeah, the code should first be changed in master:

    @staticmethod
    def _handle_output_variations(data):
        """Adjust the output to handle platform specific idiosyncrasies

        * Some platforms report ASCII as ANSI_X3.4-1968
        * Some platforms report ASCII as US-ASCII
        * Some platforms report UTF-8 instead of utf-8
        """
        data = data.replace(b"ANSI_X3.4-1968", b"ascii")
        data = data.replace(b"US-ASCII", b"ascii")
        data = data.lower()
        return data

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:53:14 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 11:53:14 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
Message-ID: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

subprocess.Popen uses _winapi.CreateProcess() to spawn a child process. It stores the process handle using a Handle class. Popen never explicitly releases the handle, it rely on Handle.__del__ when the Popen object is detroyed (when Popen._handle attribute is cleared).

As discussed in bpo-37380, we could call explicitly CloseHandle(handle) as soon as the child process completes, to release resources in the Windows kernel.

Attached PR implements this fix.

----------
components: Library (Lib)
messages: 346603
nosy: vstinner
priority: normal
severity: normal
status: open
title: [Windows] subprocess: close the handle when the process completes
type: resource usage
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:57:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 11:57:54 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
In-Reply-To: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>
Message-ID: <1561550274.45.0.635186919063.issue37410@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14205
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14391

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 07:58:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 11:58:18 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
In-Reply-To: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>
Message-ID: <1561550298.78.0.960655299916.issue37410@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

IMHO it's safe to backport PR 14391 to Python 3.7 and 3.8.

----------
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:01:59 2019
From: report at bugs.python.org (Roundup Robot)
Date: Wed, 26 Jun 2019 12:01:59 +0000
Subject: [issue37405] socket.getsockname() returns string instead of tuple
In-Reply-To: <1561496477.42.0.179203753139.issue37405@roundup.psfhosted.org>
Message-ID: <1561550519.69.0.266969825725.issue37405@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14206
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14392

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37405>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:05:51 2019
From: report at bugs.python.org (=?utf-8?q?Miro_Hron=C4=8Dok?=)
Date: Wed, 26 Jun 2019 12:05:51 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
Message-ID: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>


New submission from Miro Hron?ok <miro at hroncok.cz>:

In Fedora CI, we use the environment variable X to set tests to skip:

https://src.fedoraproject.org/tests/python/blob/bd3ec9505cd37d80fe47fbb8234928abcfc0c658/f/selftest/parallel.sh#_9 - lines 9 and 21

However, I'Ve realized that testEnviron (test.test_wsgiref.HandlerTests) fails.

Here's a reproducer:

$ python3.7 -m test test_wsgiref 
Run tests sequentially
0:00:00 load avg: 0.75 [1/1] test_wsgiref

== Tests result: SUCCESS ==

1 test OK.

Total duration: 77 ms
Tests result: SUCCESS


$ X=boom python3.7 -m test test_wsgiref 
Run tests sequentially
0:00:00 load avg: 0.71 [1/1] test_wsgiref
test test_wsgiref failed -- Traceback (most recent call last):
  File "/usr/lib64/python3.7/test/test_wsgiref.py", line 567, in testEnviron
    self.checkOSEnviron(h)
  File "/usr/lib64/python3.7/test/test_wsgiref.py", line 559, in checkOSEnviron
    self.assertEqual(env[k],v)
AssertionError: 'Y' != 'boom'
- Y
+ boom


test_wsgiref failed

== Tests result: FAILURE ==

1 test failed:
    test_wsgiref

Total duration: 73 ms
Tests result: FAILURE


I believe that such tests should not be so easily fooled - it should be properly isolated or a less common variable name should be used if that is not possible, such as PYTHON_TEST_WSGIREF_TMP instead of X.

----------
components: Tests
messages: 346605
nosy: hroncok, vstinner
priority: normal
severity: normal
status: open
title: testEnviron (test.test_wsgiref.HandlerTests) fails when environment variable X is set
versions: Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:07:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 12:07:35 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561550855.07.0.825237313395.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> In Unix, the zombie remains visible in the task list (marked as <defunct> in Linux), but in Windows an exited process is removed from the Process Manager's active list, so it's no longer visible to users. Also, a Process object is reaped as soon as the last reference to it is closed, since clearly no one needs it anymore. 
> (...)
> We could call self._handle.Close() in _wait(), right after calling GetExitCodeProcess(self._handle). With this change, __exit__ will ensure that _handle gets closed in a deterministic context.

I created bpo-37410 and PR 14391 to close the handle when the process completes. IMHO this change is easy and safe, it can be backported to Python 3.7 and 3.8.

> Code that needs the handle indefinitely can call _handle.Detach() before exiting the with-statement context, but that should rarely be necessary.
> (...)
> There should be a way to indicate a Popen instance is intended to continue running detached from our process, so scripts don't have to ignore an irrelevant resource warning.

My point is that if you want to "detach" a process, it must be *explicit*. In my experience, processes are "leaked" implicitly: by mistake. In multiprocessing, it can be subtle, you don't manipulate subprocess.Popen directly.

Users must not access private attributes (Popen._handle). After I added the ResourceWarning, I created bpo-27068 "Add a detach() method to subprocess.Popen". But I only created to reply to a request of Martin Panter, I didn't use this feature myself. At some point, I decided to just close the issue. Maybe it's time to reopen it.


> I don't understand emitting a resource warning in Popen.__del__ if a process hasn't been waited on until completion beforehand (i.e. self.returncode is None). If a script wants to be strict about this, it can use a with statement, which is documented to wait on the process.

The purpose is to help developers to find bugs in their bugs. Many are now aware that programs continue to run in the background and that leaking zombie processes is an issue on Unix.

The process is not polled to be able to emit the warning in more cases, again, to ease debug.

The warning is ignored by default.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:08:13 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 12:08:13 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
In-Reply-To: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>
Message-ID: <1561550893.57.0.551601070151.issue37410@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

See also bpo-37380: subprocess.Popen._cleanup() "The handle is invalid" error when some old process is gone.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:11:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 12:11:28 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561551088.92.0.905254544769.issue37382@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I haven't seen that problem. As I said, all GDB tests pass when compiled with "-O3 -g".

Again, it depends on the optimization level, but IMHO it's not worth it to implement an heuristic to check if gdb has enough info to run tests.


> The fact that these GDB tests are not run in any CI build is bad.

gdb is not installed on Travis CI, but test_gdb is run on almost all buildbots.


> We should try to catch test breakage as early as possible, the buildbot should be the last resort.

Maybe open an issue to attempt to install gdb on Travis CI?

test_gdb breakage are quiet rare. If you modify code which can impact test_gdb, you can run test_gdb locally. Because breakages are rare, I never invested time on this issue: there are more blocking issues in my agenda ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:16:29 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 26 Jun 2019 12:16:29 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561551389.61.0.0832598484028.issue36167@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
keywords: +easy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:16:35 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 26 Jun 2019 12:16:35 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561551395.54.0.580986572336.issue36167@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:17:06 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Wed, 26 Jun 2019 12:17:06 +0000
Subject: [issue36168] DOC: Fix capitalization in string.rst
In-Reply-To: <1551529262.87.0.31703753151.issue36168@roundup.psfhosted.org>
Message-ID: <1561551426.24.0.0200411355836.issue36168@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
keywords: +easy
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36168>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:18:11 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 12:18:11 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561551491.32.0.985371208871.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> If you modify code which can impact test_gdb, you can run test_gdb locally

I do run test_gdb locally but it's not very useful since most tests are skipped by default because python_is_optimized() is True. That's the whole point of this issue: tests are skipped without a good reason.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:21:49 2019
From: report at bugs.python.org (=?utf-8?b?R8Opcnk=?=)
Date: Wed, 26 Jun 2019 12:21:49 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561551709.57.0.58848574387.issue37276@roundup.psfhosted.org>


G?ry <gery.ogam at gmail.com> added the comment:

@Andrew Svetlov

> Adding a new state for "not running and not pending but something in between" is useless

I have not suggested that. I have just reported that when the number of submitted calls is strictly greater than the number of pool worker processes, the number of RUNNING calls returned by the method `Future.running()` makes no sense. Probably because the current `ProcessPoolExecutor` implementation uses 2 PENDING stores (the `_pending_work_items` `dict` and the `call_queue` `multiprocessing.Queue`) but treats the second store as a RUNNING store, contrary to the `ThreadPoolExecutor` implementation which has only 1 PENDING store (the `_work_queue` `queue.SimpleQueue`). The proper thing to do would be to correct the current implementation, not to create a new future state of course.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:26:02 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 26 Jun 2019 12:26:02 +0000
Subject: [issue37276] Incorrect number of running calls in ProcessPoolExecutor
In-Reply-To: <1560492485.93.0.0515191207525.issue37276@roundup.psfhosted.org>
Message-ID: <1561551962.85.0.115548354095.issue37276@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

I don't mind, sorry.

Feel free to make a pull request with the fix though.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37276>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:28:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 12:28:10 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561552090.65.0.0535595899769.issue37382@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I do run test_gdb locally but it's not very useful since most tests are skipped by default because python_is_optimized() is True.

Ah, I forgot to mention that I always compile Python using:

./configure -C --with-pydebug CFLAGS="-O0" && make

-O0 is not really needed, but sometimes -Og is too aggressive and fails to read some symbols. Or maybe it's just me who is not used to -Og yet :-)

I prefer -O0 because the compilation is way faster! But don't use this config for benchmarks ;-)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 08:42:12 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 26 Jun 2019 12:42:12 +0000
Subject: [issue37402] Fatal Python error: Cannot recover from stack overflow
 issues on Python 3.6 and 3.7
In-Reply-To: <1561467308.7.0.878273526771.issue37402@roundup.psfhosted.org>
Message-ID: <1561552932.99.0.148993691148.issue37402@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Is it ok to have
  File "/home/ajung/sandboxes/ugent-portaal-plone-4x/eggs/Products.CMFDynamicViewFTI-6.0.1-py3.7.egg/Products/CMFDynamicViewFTI/browserdefault.py", line 76 in __call__
so many times?
Looks very suspicious

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37402>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:06:36 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Wed, 26 Jun 2019 13:06:36 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561554396.19.0.951242906243.issue37411@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:15:09 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 13:15:09 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561554909.63.0.923574490686.issue37386@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The test requires the "largefile" resource on Windows. If "-u largefile" is specified and the test is failed, it is a correct behavior.

The correct solution is either increase the amount of available free disk space or remove the "largefile" resource on that buildbot.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:29:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:29:47 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561555787.31.0.50954242941.issue37411@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14208
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14394

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:32:42 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:32:42 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561555962.0.0.978116795317.issue37411@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I wrote PR 14394 to fix the test.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:33:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:33:17 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561555997.29.0.324819296164.issue37411@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
versions: +Python 2.7 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:36:16 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:36:16 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561556176.45.0.918563037858.issue37386@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

libregrtest usage says:

    largefile - It is okay to run some test that may create huge
                files.  These tests can take a long time and may
                consume >2 GiB of disk space temporarily.

> The test requires the "largefile" resource on Windows. If "-u largefile" is specified and the test is failed, it is a correct behavior.

Ok, but it's a practical issue. How can a buildbot worker maintainer ensure that a machine always has 2 GiB of free disk space? Is it really a Python bug if the machine has lower than 2 GiB of free space?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:38:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:38:43 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
In-Reply-To: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>
Message-ID: <1561556323.47.0.484264036768.issue37410@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

We may backport the change to Python 2.7 as well, but in this case terminate() must be changed to test returncode:

        def terminate(self):
            """Terminates the process."""
            # Don't terminate a process that we know has already died.
            if self.returncode is not None:
                return
            ...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 09:40:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 13:40:23 +0000
Subject: [issue37410] [Windows] subprocess: close the handle when the process
 completes
In-Reply-To: <1561549994.59.0.313860282111.issue37410@roundup.psfhosted.org>
Message-ID: <1561556423.57.0.956733509322.issue37410@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

terminate() was changed by:

commit a0c9caad66f01328155177180df1c46fe7c62e57
Author: Gregory P. Smith <greg at krypto.org>
Date:   Sun Nov 15 18:19:10 2015 -0800

    Fix issue #6973: When we know a subprocess.Popen process has died, do
    not allow the send_signal(), terminate(), or kill() methods to do
    anything as they could potentially signal a different process.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37410>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:03:25 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 14:03:25 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561557805.16.0.398138475942.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> The worst debugging experience is provided by PGO build.

That's true but unrelated to this issue. We already skip test_gdb completely when PGO is enabled.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:26:04 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 14:26:04 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561559164.61.0.470898027408.issue37382@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14209
pull_request: https://github.com/python/cpython/pull/14395

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:28:07 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:28:07 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
Message-ID: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

On Windows, os.getcwdb() is implemented using getcwd() on Windows. This function uses the ANSI code page, whereas PEP 529 "Change Windows filesystem encoding to UTF-8" is supposed to use UTF-8 for all bytes paths and filenames. Moreover, this function emits a DeprecationWarning, whereas PEP 529 was supposed to avoid the need to deprecated bytes paths and filenames on Windows.

I guess that it was forgotten in the implementation of the PEP 529. Or was it a deliberate choice?

Attached PR modify os.getcwdb() to use UTF-8.

----------
components: Library (Lib)
messages: 346620
nosy: steve.dower, vstinner
priority: normal
severity: normal
status: open
title: os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:32:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:32:20 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561559540.75.0.0143161841369.issue37412@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14210
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14396

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:36:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:36:50 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561559810.69.0.798808357747.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

My PR 14396 modify os.getcwdb() to use UTF-8 and it removes the deprecation warning.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:39:17 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 26 Jun 2019 14:39:17 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561559957.66.0.344712384721.issue37412@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

See also bpo-32920.

----------
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:40:11 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:40:11 +0000
Subject: [issue32920] Implement PEP 529 for os.getcwdb on Windows
In-Reply-To: <1519368268.76.0.467229070634.issue32920@psf.upfronthosting.co.za>
Message-ID: <1561560011.98.0.0634978478796.issue32920@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I just opened the same issue: bpo-37412, but I proposed a PR to implement my idea ;-)

----------
resolution:  -> duplicate
stage: needs patch -> resolved
status: open -> closed
superseder:  -> os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32920>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:40:17 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:40:17 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561560017.79.0.488323659884.issue37412@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:41:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:41:25 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561560085.85.0.599624992322.issue37382@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> That's true but unrelated to this issue. We already skip test_gdb completely when PGO is enabled.

What do you mean? support.PGO is something different: it's only used while profiling Python before Python is recompiled a second time.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:42:45 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 14:42:45 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561560165.79.0.420958799972.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

I meant this part in test_gdb.py:

if ((sysconfig.get_config_var('PGO_PROF_USE_FLAG') or 'xxx') in
    (sysconfig.get_config_var('PY_CORE_CFLAGS') or '')):
    raise unittest.SkipTest("test_gdb is not reliable on PGO builds")

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:53:50 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 14:53:50 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561560830.64.0.848014036029.issue37412@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Definitely just an oversight. Thanks for fixing this!

I think it can go to 3.8 as well. Thoughts?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 10:54:49 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 14:54:49 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561560889.66.0.321098349182.issue37382@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

If you want to understand why tests are currently skipped when Python is optimized, you should dig into the Git history. Not simply remove the decorator because it looks wrong to you. There is likely a story behind it.

https://en.wikipedia.org/wiki/Wikipedia:Chesterton's_fence

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:00:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:00:23 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561561223.81.0.0977306467271.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I think it can go to 3.8 as well. Thoughts?

Oh, 3.8 is not released yet. Well, it's more or less a new feature, or a bugfix, depending on the point of view.

I would not be comfortable to change the encoding in 3.8.1, but it should be fine to do the change in 3.8.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:03:06 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:03:06 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561561386.45.0.621898536584.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I retargeted my PR 14396 to Python 3.8.

----------
versions: +Python 3.8 -Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:15:29 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Wed, 26 Jun 2019 15:15:29 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561562129.07.0.408798148393.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

These python_is_optimized() tests were added in #8605 and #13628. Those issues talk about tests failing when CPython is compiled with -O2 or -O3. But, as I said here, I see no problems today with gcc -O3. So I'm guessing that either gcc or gdb improved such that these tests pass with more recent versions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:15:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:15:51 +0000
Subject: [issue37413] Deprecate sys._enablelegacywindowsfsencoding()?
Message-ID: <1561562151.11.0.833046423852.issue37413@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

sys._enablelegacywindowsfsencoding() was added late in PEP 529 design "just in case" if something goes wrong. But I'm not aware of anyone using it. Do we want to keep supporting the *legacy* Windows filesystem encoding (ANSI code page) forever? IMHO using UTF-8 is a way more practical solution to design portable applications working unmodified on Windows *and* Unix. Well, it's the purpose of the PEP 529.

I propose to deprecate sys._enablelegacywindowsfsencoding() and PYTHONLEGACYWINDOWSFSENCODING environment variable in Python 3.9 and remove it from Python 3.10. Calling sys._enablelegacywindowsfsencoding() would emit a DeprecationWarning in 3.9.

I dislike sys._enablelegacywindowsfsencoding() because it can lead to mojibake: filenames decoded from the ANSI code page but then encoded to UTF-8. In the PEP 587 "Python Initialization Configuration" I tried to ensure that encodings are set early: in a new "pre-initialization" phase. Encodings should not change after the pre-initialization.

--

By the way, I'm not aware of any issue with io._WindowsConsoleIO. Should we also deprecated PYTHONLEGACYWINDOWSSTDIO environment variable which opt-out from the new io._WindowsConsoleIO?

Extract of open() code in Modules/_io/_iomodule.c:

    /* Create the Raw file stream */
    {
        PyObject *RawIO_class = (PyObject *)&PyFileIO_Type;
#ifdef MS_WINDOWS
        PyConfig *config = &_PyInterpreterState_GET_UNSAFE()->config;
        if (!config->legacy_windows_stdio && _PyIO_get_console_type(path_or_fd) != '\0') {
            RawIO_class = (PyObject *)&PyWindowsConsoleIO_Type;
            encoding = "utf-8";
        }
#endif
        raw = PyObject_CallFunction(RawIO_class,
                                    "OsiO", path_or_fd, rawmode, closefd, opener);
    }

----------
components: Windows
messages: 346631
nosy: ZackerySpytz, eryksun, paul.moore, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: Deprecate sys._enablelegacywindowsfsencoding()?
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37413>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:16:43 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:16:43 +0000
Subject: [issue37413] Deprecate sys._enablelegacywindowsfsencoding()?
In-Reply-To: <1561562151.11.0.833046423852.issue37413@roundup.psfhosted.org>
Message-ID: <1561562203.95.0.815546269255.issue37413@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> By the way, I'm not aware of any issue with io._WindowsConsoleIO. Should we also deprecated PYTHONLEGACYWINDOWSSTDIO environment variable which opt-out from the new io._WindowsConsoleIO?

It was added to Python 3.6 by PEP 528 "Change Windows console encoding to UTF-8".

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37413>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:21:50 2019
From: report at bugs.python.org (Charalampos Stratakis)
Date: Wed, 26 Jun 2019 15:21:50 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561562510.72.0.0736508171911.issue37382@roundup.psfhosted.org>


Charalampos Stratakis <cstratak at redhat.com> added the comment:

There is a fleet of buildbots with a variety og versions of gcc and gdb, so if a change like that is pushed, all the fleet has to be monitored for potential failures, as there are many older OSes supported there.

----------
nosy: +cstratak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:25:17 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Wed, 26 Jun 2019 15:25:17 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561562717.98.0.613498464711.issue36889@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
pull_requests: +14211
pull_request: https://github.com/python/cpython/pull/14397

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:26:47 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:26:47 +0000
Subject: [issue37414] Remove sys.callstats()
Message-ID: <1561562806.99.0.203166683389.issue37414@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

In Python 3.6, sys.callstats() was a way to retrieve statistics produced by Python/ceval.c when Python was compiled with a special build option: CALL_PROFILE. The function was implemented with PyEval_GetCallStats().


I removed CALL_PROFILE special build and deprecated sys.callstats() in bpo-28799:

commit a61a54b149cfcbcee15b37f557be730f0e30b6ad
Author: Victor Stinner <victor.stinner at gmail.com>
Date:   Mon Nov 28 12:06:13 2016 +0100

    Issue #28799: Update Misc/SpecialBuilds.txt
    
    Remove CALL_PROFILE.


sys.callstats() always returned None since Python 3.7.


Attached PR removed sys.callstats().

----------
components: Interpreter Core
messages: 346634
nosy: vstinner
priority: normal
severity: normal
status: open
title: Remove sys.callstats()
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37414>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:28:33 2019
From: report at bugs.python.org (Eryk Sun)
Date: Wed, 26 Jun 2019 15:28:33 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561562913.63.0.724421724544.issue37380@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> The process is not polled to be able to emit the warning in more 
> cases, again, to ease debug.

It emits an incorrect warning if the process has already exited: "subprocess %s is still running". This can be rectified. Here's my current understanding:

    def __del__(self, _maxsize=sys.maxsize, _warn=warnings.warn):
        if not self._child_created or self.returncode is not None:
            return
        # In Unix, not reading the subprocess exit status creates a zombie
        # process, which is only destroyed at the parent Python process exit.
        # In Windows, no one else should have a reference to our _handle, so
        # it should get finalized and thus closed, but we use the same warning
        # in order to consistently educate developers.
        if self._internal_poll(_deadstate=_maxsize) is not None:
            _warn("subprocess %s was implicitly finalized" % self.pid,
                  ResourceWarning, source=self)
        else:
            _warn("subprocess %s is still running" % self.pid,
                  ResourceWarning, source=self)
            # Keep this instance alive until we can wait on it, if needed.
            if _active is not None:
                _active.append(self)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:29:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:29:10 +0000
Subject: [issue37414] Remove undocumented and deprecated sys.callstats()
 function
In-Reply-To: <1561562806.99.0.203166683389.issue37414@roundup.psfhosted.org>
Message-ID: <1561562950.02.0.133036203108.issue37414@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
title: Remove sys.callstats() -> Remove undocumented and deprecated sys.callstats() function

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37414>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:29:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:29:15 +0000
Subject: [issue37414] Remove undocumented and deprecated sys.callstats()
 function
In-Reply-To: <1561562806.99.0.203166683389.issue37414@roundup.psfhosted.org>
Message-ID: <1561562955.0.0.0523186433673.issue37414@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14212
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14398

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37414>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:31:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:31:24 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561563084.85.0.530198262113.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 689830ee6243126798a6c519c05aa11ba73db7cd by Victor Stinner in branch 'master':
bpo-37412: os.getcwdb() now uses UTF-8 on Windows (GH-14396)
https://github.com/python/cpython/commit/689830ee6243126798a6c519c05aa11ba73db7cd


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:31:50 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 15:31:50 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561563110.67.0.330148821274.issue37412@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14213
pull_request: https://github.com/python/cpython/pull/14399

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:32:47 2019
From: report at bugs.python.org (Borja)
Date: Wed, 26 Jun 2019 15:32:47 +0000
Subject: [issue37415] Error build Python with Intel compiler
Message-ID: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>


New submission from Borja <saszalez at gmail.com>:

I'm trying to build Python 3.7 on CentOS 7 with Intel compilers. To compile I do the following:

export CC=icc
export CXX=icpc
export FC=ifort

./configure --prefix=my_prefix --enable-optimizations --without-gcc
make
make install

In the configure, no error is seen, but when I execute make, the following message is printed:

Running code to generate profile data (this can take a while):
# First, we need to create a clean build with profile generation
# enabled.
make profile-gen-stamp
make[1]: se ingresa al directorio `/home/python/source/Python-3.7.3'
Building with support for profile generation:
make build_all_generate_profile
make[2]: se ingresa al directorio `/home/python/source/Python-3.7.3'
make build_all CFLAGS_NODIST=" -prof-gen" LDFLAGS_NODIST=" -prof-gen" LIBS="-lcrypt -lpthread -ldl  -lutil"
make[3]: se ingresa al directorio `/home/python/source/Python-3.7.3'
icc -pthread -c -Wsign-compare -Wunreachable-code -DNDEBUG -g  -O3 -Wall    -std=c99 -Wextra -Wno-unused-parameter -Wno-missing-field-initializers -Wno-cast-function-type -Werror=implicit-function-declaration -fp-model strict -prof-gen  -I. -I./Include    -DPy_BUILD_CORE -o Programs/python.o ./Programs/python.c
icc: command line warning #10006: ignoring unknown option '-Wno-cast-function-type'
In file included from ./Include/Python.h(75),
                 from ./Programs/python.c(3):
./Include/pyatomic.h(39): error: identifier "atomic_uintptr_t" is undefined
      atomic_uintptr_t _value;
      ^

compilation aborted for ./Programs/python.c (code 2)

----------
messages: 346637
nosy: Saszalez
priority: normal
severity: normal
status: open
title: Error build Python with Intel compiler
type: compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:36:42 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:36:42 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561563402.25.0.724887437166.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Sorry, I'm lost :-( More and more different issues are discussed here. Would it be possible please to stick this issue to _active list and _cleanup() on Windows? From what I read, remove/disable _active and _cleanup() makes sense on Windows.

I already created bpo-37410 to call CloseHandle() earlier.

Eryk: Please open a separated issue if you want to change the ResourceWarning message.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:42:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:42:01 +0000
Subject: [issue37415] Error build Python with Intel compiler
In-Reply-To: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>
Message-ID: <1561563721.42.0.889683220478.issue37415@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

atomic_uintptr_t is used if HAVE_STD_ATOMIC defined is defined. Can you please check in pyconfig.h if it's defined?

So <stdatomic.h> doesn't provide atomic_uintptr_t with ICC?

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:50:13 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 15:50:13 +0000
Subject: [issue37413] Deprecate sys._enablelegacywindowsfsencoding()?
In-Reply-To: <1561562151.11.0.833046423852.issue37413@roundup.psfhosted.org>
Message-ID: <1561564213.39.0.89372897654.issue37413@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

It's probably worth at least a post to python-dev to expand the audience, but unless someone speaks up with some really good reason why they must update to Python 3.10 without updating their own code then let's deprecate it.

FWIW, even with the flag the behaviour changed in 3.6. Previously it would use the *A APIs and let Windows do the encoding, but then it changed to the *W APIs and Python would encode with our own mbcs:replace, where mbcs is just calling through to the WideCharToMultiByte API. So there isn't really anything to maintain long term apart from the additional options.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37413>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:52:05 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 15:52:05 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561564325.72.0.343708705142.issue37386@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

The test suite fails if there is less than 500 or 600 MB of RAM, not counting bigmem tests. It is not a Python bug, but an environment issue. A buildbot worker should have some free disk space and RAM, and set tests running options correspondingly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:56:05 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 15:56:05 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561564565.38.0.548881906246.issue37386@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Serhiy:
> The test suite fails if there is less than 500 or 600 MB of RAM, not counting bigmem tests. It is not a Python bug, but an environment issue. A buildbot worker should have some free disk space and RAM, and set tests running options correspondingly.

How do you plan to fix buildbots? Contact each buildbot owner and asks them to ensure that largefile is only used with at least 2 GiB of free space? And maybe install monitor to get an alarm if it's no longer the case?

Maybe some buildbot owners will just remove largefile, which would not be the expected reaction, no?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 11:58:03 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 15:58:03 +0000
Subject: [issue37406] Disable runtime checks in release mode
In-Reply-To: <1561504591.64.0.387503975069.issue37406@roundup.psfhosted.org>
Message-ID: <1561564683.76.0.295118993996.issue37406@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

I think that the public C API should have runtime checks for its arguments, except performance sensitive functions and macros (like PyTuple_GET_ITEM). The internal C API can use just asserts.

I have a work-in-progress patch which adds tests for the public C API, including calls with invalid arguments.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37406>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:01:14 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 16:01:14 +0000
Subject: [issue37414] Remove undocumented and deprecated sys.callstats()
 function
In-Reply-To: <1561562806.99.0.203166683389.issue37414@roundup.psfhosted.org>
Message-ID: <1561564874.59.0.956504702413.issue37414@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 69150669f224a1fc47de483557736e725ac5b2a1 by Victor Stinner in branch 'master':
bpo-37414: Remove sys.callstats() (GH-14398)
https://github.com/python/cpython/commit/69150669f224a1fc47de483557736e725ac5b2a1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37414>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:01:21 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 16:01:21 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561564881.0.0.699527499954.issue37386@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

Yes, it is a solution.

In this particular case it may be that the disk is fulled by test files leaked from the past test runs.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:01:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 16:01:23 +0000
Subject: [issue37414] Remove undocumented and deprecated sys.callstats()
 function
In-Reply-To: <1561562806.99.0.203166683389.issue37414@roundup.psfhosted.org>
Message-ID: <1561564883.42.0.41031402637.issue37414@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37414>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:01:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 16:01:51 +0000
Subject: [issue28799] Drop CALL_PROFILE special build?
In-Reply-To: <1480064573.69.0.905508550534.issue28799@psf.upfronthosting.co.za>
Message-ID: <1561564911.39.0.271956334354.issue28799@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I removed the function from Python 3.9 in bpo-37414.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue28799>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:07:47 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 16:07:47 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561565267.6.0.286787353004.issue37163@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 2d88e63bfcf7bccba925ab80b3f47ccf8b7aefa8 by Serhiy Storchaka in branch 'master':
bpo-37163: Make the obj argument of dataclasses.replace() a positional-only. (GH-14390)
https://github.com/python/cpython/commit/2d88e63bfcf7bccba925ab80b3f47ccf8b7aefa8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:14:37 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 16:14:37 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561565677.91.0.0278185048818.issue37412@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 63429c839b19c6fe604deddcb12497443ca01a9a by Miss Islington (bot) in branch '3.8':
bpo-37412: os.getcwdb() now uses UTF-8 on Windows (GH-14396)
https://github.com/python/cpython/commit/63429c839b19c6fe604deddcb12497443ca01a9a


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:16:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 16:16:39 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561565799.22.0.187999166894.issue37411@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 5150d327924959639215ed0a78feffc0d88258da by Victor Stinner in branch 'master':
bpo-37411: Rewrite test_wsgiref.testEnviron() (GH-14394)
https://github.com/python/cpython/commit/5150d327924959639215ed0a78feffc0d88258da


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:16:48 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 16:16:48 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561565808.97.0.514988177802.issue37411@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14214
pull_request: https://github.com/python/cpython/pull/14402

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:16:57 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 16:16:57 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561565817.37.0.385276099832.issue37411@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14215
pull_request: https://github.com/python/cpython/pull/14403

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:17:08 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 16:17:08 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561565828.32.0.951696642646.issue37411@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14216
pull_request: https://github.com/python/cpython/pull/14404

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:24:55 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 16:24:55 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561566295.3.0.722485627522.issue37163@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
pull_requests: +14217
pull_request: https://github.com/python/cpython/pull/14405

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:29:01 2019
From: report at bugs.python.org (Cooper Lees)
Date: Wed, 26 Jun 2019 16:29:01 +0000
Subject: [issue37179] asyncio loop.start_tls() provide support for TLS in TLS
In-Reply-To: <1559843713.76.0.0171515478407.issue37179@roundup.psfhosted.org>
Message-ID: <1561566541.62.0.757450158383.issue37179@roundup.psfhosted.org>


Cooper Lees <me at cooperlees.com> added the comment:

@fantix - Is there anything I can do to help this progress. I'd be happy to potentially even do parts of the back porting if you're swamped. Would just need some guidance.

I need this as I'm looking to add auth to some internal HTTP(S) proxies I use and in order to allow aiohttp to be able to do client TLS auth, this is required.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37179>
_______________________________________

From report at bugs.python.org  Wed Jun 26 12:39:51 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Wed, 26 Jun 2019 16:39:51 +0000
Subject: [issue37376] pprint for types.SimpleNamespace
In-Reply-To: <1561292567.66.0.352814165526.issue37376@roundup.psfhosted.org>
Message-ID: <1561567191.95.0.548551966083.issue37376@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

+1 This would be a nice improvement.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37376>
_______________________________________

From report at bugs.python.org  Wed Jun 26 13:57:05 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 17:57:05 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561571825.73.0.210849199503.issue37390@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14218
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14406

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Wed Jun 26 13:59:30 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 17:59:30 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561571970.46.0.237198807034.issue37390@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

I think my PR is ready. I had to go through and update all the audit-event tags that existed, since the argument parsing in Sphinx didn't work the way I first thought it did, but now we can provide a back reference manually (or let it auto-generate one to the line with the event).

I also updated some of the event names I recently added so they are more consistent with the existing ones - e.g. poplib.POP3 -> poplib.connect for consistency with socket.connect.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:04:42 2019
From: report at bugs.python.org (Fabio Zadrozny)
Date: Wed, 26 Jun 2019 18:04:42 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
Message-ID: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>


New submission from Fabio Zadrozny <fabioz at users.sourceforge.net>:

I'm attaching a snippet which shows the issue (i.e.: threading.main_thread() and threading.current_thread() should be the same and they aren't).

What I'd see as a possible solution is that the initial thread ident would be stored when the interpreter is initialized and then when threading is imported the first time it would get that indent to initialize the main thread instead of calling `threading._MainThread._set_ident` in the wrong thread.

I'm not sure if this is possible if CPython is embedded in some other C++ program, but it seems to be the correct approach when Python is called from the command line.

As a note, I found this when doing an attach to pid for the `pydevd` debugger where a thread is created to initialize the debugger (the issue on the debugger is reported at: https://github.com/microsoft/ptvsd/issues/1542).

----------
components: Interpreter Core
files: snippet.py
messages: 346653
nosy: fabioz
priority: normal
severity: normal
status: open
title: If threading is not imported from the main thread it sees the wrong thread as the main thread.
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48438/snippet.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:05:28 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 26 Jun 2019 18:05:28 +0000
Subject: [issue37409] relative import_from without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561572328.47.0.816332616208.issue37409@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

I can't reproduce:

>>> from importlib import abc
>>> from . import util
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'util' from '__main__' (unknown location)
>>> import importlib.util
>>>

Did you happen to do an `import *` prior to this in your REPL? If so that might explain it as you could have pulled in __package__ and such and that's used to resolve relative imports.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:21:02 2019
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 26 Jun 2019 18:21:02 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
Message-ID: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>


New submission from Brandt Bucher <brandtbucher at gmail.com>:

bytearray.extend doesn't properly handle errors that arise during iteration of the argument:

Python 3.9.0a0 (heads/master:5150d32, Jun 26 2019, 10:55:32) 
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> array = bytearray()
>>> bad_iter = map(int, "X")
>>> array.extend(bad_iter)
ValueError: invalid literal for int() with base 10: 'X'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
SystemError: <method 'extend' of 'bytearray' objects> returned a result with an error set

As far as I can tell, this bug is present on all versions of Python 3. I've attached a patch with a fix and a regression test.

----------
components: Interpreter Core
messages: 346655
nosy: brandtbucher
priority: normal
severity: normal
status: open
title: bytearray.extend does not handle errors during iteration.
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:21:17 2019
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 26 Jun 2019 18:21:17 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561573277.69.0.126544055709.issue37417@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
keywords: +patch
pull_requests: +14219
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14407

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:31:25 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 26 Jun 2019 18:31:25 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561573885.54.0.666732975369.issue23014@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

PEPs are not living documents unless they are marked as Active (which PEP 451 is not).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:46:56 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 26 Jun 2019 18:46:56 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561574816.21.0.124918759912.issue23014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Where can I find up to date best practices / docs for the import machinery? I couldn't find a mention of this in docs.python.org

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:47:36 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 18:47:36 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561574856.42.0.770710425209.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

Okay, this definitely used to work, but now it's broken for me too.

What version of Windows are you on (copy-paste from cmd.exe's ver command)?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:53:27 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 26 Jun 2019 18:53:27 +0000
Subject: [issue37391] MacOS Touchpad scrolling crashes IDLE
In-Reply-To: <1561415016.56.0.472202468675.issue37391@roundup.psfhosted.org>
Message-ID: <1561575207.98.0.768112949079.issue37391@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

> Does IDLE every run long enough with Apple's tk before failure to make continuing useful?

Yes, depending on what you are doing, IDLE *may* run just fine with the system Tk.  But you may may run into this issue depending on how you scroll.  Or, among the worst bugs, if you try to type in characters not directly available on the keyboard by using one of the available composition characters, like opt-u followed by a vowel to produced an "umlauted" vowel with the US keyboard layout, Tk will immediately crash taking IDLE with it and with no opportunity to save any work in progress.  Many people will not run into those bugs but it can be very painful to those who do.

> Any comments here before I open a new issue?

I don't think changing the message is going to make much of a difference.  There isn't much an end user can do other to avoid the known behaviors that cause problems, install another version of Python (which may not be an option for many novice users), or not use IDLE.  Back when we did not ship our own copy of Tcl/Tk with the python.org macOS installers, there *was* something else you might be able to do: install a more up-to-date third-party Tcl/Tk that would then be automatically used. But that's not longer an option nor is it needed.

I think the best thing we can do is help make it easier for people building Python to not link with the broken system Python and improve the using Python on macOS documentation.  I have issues opened for both of those.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37391>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:55:24 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 26 Jun 2019 18:55:24 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561575324.67.0.880096075453.issue23014@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

The import machinery docs are split between the language reference and importlib itself. It really depends on what you're looking for.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:57:03 2019
From: report at bugs.python.org (=?utf-8?q?Emilio_L=C3=B3pez_Arias?=)
Date: Wed, 26 Jun 2019 18:57:03 +0000
Subject: [issue37418] Code execution without calling it
Message-ID: <1561575423.11.0.289574881474.issue37418@roundup.psfhosted.org>


New submission from Emilio L?pez Arias <milio81 at gmail.com>:

Create a new python file: example.py
------------------------------------
def my_decorator(f):
	print("before")
	f()
	print("after")


@my_decorator
def my_function():
	print("hello world")
------------------------------------

If you execute the file example.py you should see some output you shouldn't:
(base) C:\Users\emilio\curso_python>python --version
Python 3.7.3
(base) C:\Users\emilio\curso_python>python ejemplo.py
before
hello world
after

----------
messages: 346661
nosy: Emilio L?pez Arias
priority: normal
severity: normal
status: open
title: Code execution without calling it
type: security
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 14:57:22 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 26 Jun 2019 18:57:22 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561575442.48.0.284483402272.issue23014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Mostly looking for something that says how `create_module` should / shouldn't be implemented (and why `return None` is necessary)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:05:18 2019
From: report at bugs.python.org (SilentGhost)
Date: Wed, 26 Jun 2019 19:05:18 +0000
Subject: [issue37418] Code execution without calling it
In-Reply-To: <1561575423.11.0.289574881474.issue37418@roundup.psfhosted.org>
Message-ID: <1561575918.58.0.78841298837.issue37418@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

It seems you're misunderstanding mechanics of decorators. Decorator is called when @decorator statement is executed and in that function *you* are calling the wrapped function. There are tutorials available on how to use this feature, I'd suggest you try them.

----------
nosy: +SilentGhost
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type: security -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:06:31 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 19:06:31 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561575991.63.0.865751297067.issue37417@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 2a7d596f27b2342caf168a03c95ebf3b56e5dbbd by Serhiy Storchaka (Brandt Bucher) in branch 'master':
bpo-37417: Fix error handling in bytearray.extend. (GH-14407)
https://github.com/python/cpython/commit/2a7d596f27b2342caf168a03c95ebf3b56e5dbbd


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:06:33 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 19:06:33 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561575993.11.0.238204183068.issue37417@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14220
pull_request: https://github.com/python/cpython/pull/14408

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:07:15 2019
From: report at bugs.python.org (=?utf-8?q?Emilio_L=C3=B3pez_Arias?=)
Date: Wed, 26 Jun 2019 19:07:15 +0000
Subject: [issue37418] Code execution without calling it
In-Reply-To: <1561575918.58.0.78841298837.issue37418@roundup.psfhosted.org>
Message-ID: <CAO+Jh_OPEkWReF+U+PNK2Mhp8e4CzODKKR2fPHrFfcLEZ=8HAA@mail.gmail.com>


Emilio L?pez Arias <milio81 at gmail.com> added the comment:

why the code is executed?
I could do a library or a package and include evil code instead of a
print...

El mi?., 26 jun. 2019 a las 21:05, SilentGhost (<report at bugs.python.org>)
escribi?:

>
> SilentGhost <ghost.adh at runbox.com> added the comment:
>
> It seems you're misunderstanding mechanics of decorators. Decorator is
> called when @decorator statement is executed and in that function *you* are
> calling the wrapped function. There are tutorials available on how to use
> this feature, I'd suggest you try them.
>
> ----------
> nosy: +SilentGhost
> resolution:  -> not a bug
> stage:  -> resolved
> status: open -> closed
> type: security -> behavior
>
> _______________________________________
> Python tracker <report at bugs.python.org>
> <https://bugs.python.org/issue37418>
> _______________________________________
>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:09:34 2019
From: report at bugs.python.org (SilentGhost)
Date: Wed, 26 Jun 2019 19:09:34 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561576174.06.0.332098551697.issue37417@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:11:21 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 26 Jun 2019 19:11:21 +0000
Subject: [issue37418] Code execution without calling it
In-Reply-To: <1561575423.11.0.289574881474.issue37418@roundup.psfhosted.org>
Message-ID: <1561576281.09.0.37218390724.issue37418@roundup.psfhosted.org>


Paul Ganssle <p.ganssle at gmail.com> added the comment:

> why the code is executed?
> I could do a library or a package and include evil code instead of a
> print...

The code is executed because the decorator syntax

    @decorator
    def f():
       ...

Is equivalent to

    def f():
       ...

    f = decorator(f)

So you are indeed calling the `decorator` function.

It is true that you could put evil code in the decorator function, but it's also true that you can execute evil code directly in the Python function as well, e.g.:

    execute_evil_code()

    def f():
        ...

Importing such a package would call `execute_evil_code()`.

----------
nosy: +p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:11:30 2019
From: report at bugs.python.org (Paul Ganssle)
Date: Wed, 26 Jun 2019 19:11:30 +0000
Subject: [issue37418] Code execution without calling it
In-Reply-To: <1561575423.11.0.289574881474.issue37418@roundup.psfhosted.org>
Message-ID: <1561576290.75.0.678925756235.issue37418@roundup.psfhosted.org>


Change by Paul Ganssle <p.ganssle at gmail.com>:


----------
nosy:  -p-ganssle

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:12:30 2019
From: report at bugs.python.org (SilentGhost)
Date: Wed, 26 Jun 2019 19:12:30 +0000
Subject: [issue37418] Code execution without calling it
In-Reply-To: <1561575423.11.0.289574881474.issue37418@roundup.psfhosted.org>
Message-ID: <1561576350.13.0.325731348522.issue37418@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

The whole file is executed on import, you might as well have taken the "evil" code and placed in the global scope and not in the function. If you want to learn how to use decorators, again I suggest following a tutorial, SO or python-help. This is not a security issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37418>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:23:24 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 19:23:24 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561577004.72.0.315367953838.issue37417@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7675bca4b56c532875d8bc6a7832e3c51d71278f by Miss Islington (bot) in branch '3.7':
bpo-37417: Fix error handling in bytearray.extend. (GH-14407)
https://github.com/python/cpython/commit/7675bca4b56c532875d8bc6a7832e3c51d71278f


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:24:46 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 26 Jun 2019 19:24:46 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
Message-ID: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

parse_file_actions() uses an int as it loops over the passed sequence, but it should use a Py_ssize_t. If the sequence is large enough, the int will overflow.

----------
components: Extension Modules
messages: 346669
nosy: ZackerySpytz
priority: normal
severity: normal
status: open
title: Possible segfaults when passing large sequences to os.posix_spawn()
type: crash
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:30:05 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Wed, 26 Jun 2019 19:30:05 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
In-Reply-To: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>
Message-ID: <1561577405.84.0.656118110147.issue37419@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +14221
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14409

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:38:00 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 19:38:00 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561577880.13.0.464601328143.issue37411@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 814c7aefc2b8e9892bce3d59c0ab39563d658aa2 by Miss Islington (bot) in branch '3.7':
bpo-37411: Rewrite test_wsgiref.testEnviron() (GH-14394)
https://github.com/python/cpython/commit/814c7aefc2b8e9892bce3d59c0ab39563d658aa2


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:38:28 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 19:38:28 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561577908.63.0.963527690846.issue37411@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bdbd5e895ddf9aefcb79cdc52341f0697ad6aea0 by Miss Islington (bot) in branch '3.8':
bpo-37411: Rewrite test_wsgiref.testEnviron() (GH-14394)
https://github.com/python/cpython/commit/bdbd5e895ddf9aefcb79cdc52341f0697ad6aea0


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:42:08 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 19:42:08 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561578128.48.0.91236596155.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, it's merged into 3.8. Thanks for the review Steve. One less deprecation warning.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 15:58:38 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 19:58:38 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561579118.4.0.631185829389.issue37417@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14222
pull_request: https://github.com/python/cpython/pull/14410

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:00:11 2019
From: report at bugs.python.org (Brett Cannon)
Date: Wed, 26 Jun 2019 20:00:11 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561579211.9.0.807667103511.issue23014@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

> Mostly looking for something that says how `create_module` should / shouldn't be implemented

Basically you only need to provide the method if you want to use a custom object for the module itself. So as long as the object can quack like a module object you should be fine.

> (and why `return None` is necessary)

The "return None for default semantics" is there for two reasons (if I remember correctly). One, it makes it very easy to implement the default semantics. :) Two, it sends a very clear signal that nothing out of the ordinary is going on and so you can assume nothing special is expected (which is why LazyLoader requires this since it mucks with the object directly in a very specific way).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:03:14 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 20:03:14 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561579394.17.0.139972075924.issue37163@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:


New changeset 6ef103fbdbc05adbc20838c94b1f0c40fa6c159a by Serhiy Storchaka in branch '3.7':
[3.7] bpo-37163: dataclasses.replace() now supports the field named "obj". (GH-13877) (GH-14405)
https://github.com/python/cpython/commit/6ef103fbdbc05adbc20838c94b1f0c40fa6c159a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:04:02 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Wed, 26 Jun 2019 20:04:02 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561579442.67.0.766508560047.issue23014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

yeah I guess I'm just curious why this bug (seemingly intentionally) made the implementation diverge from PEP 451 and require an empty `create_module` (and where I would have found that except by searching bugs.python.org)

Everyone I've shown this bit of code has essentially said: "*headscratch* -- that's weird?" https://github.com/pytest-dev/pytest/blob/6a2d844c5d3e1e692d5bb6fa065c0d753d1dd7d1/src/_pytest/assertion/rewrite.py#L92-L93

why require the function at all I guess

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:13:07 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 26 Jun 2019 20:13:07 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561579987.36.0.311653404539.issue29412@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset 7213df7bbfd85378c6e42e1ac63144d5974bdcf6 by Barry Warsaw (Abhilash Raj) in branch 'master':
bpo-29412: Fix indexError when parsing a header value ending unexpectedly (GH-14387)
https://github.com/python/cpython/commit/7213df7bbfd85378c6e42e1ac63144d5974bdcf6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:13:14 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 20:13:14 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561579994.08.0.571419543706.issue29412@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14223
pull_request: https://github.com/python/cpython/pull/14411

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:13:22 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 20:13:22 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561580002.04.0.914312897754.issue29412@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14224
pull_request: https://github.com/python/cpython/pull/14412

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:16:55 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 20:16:55 +0000
Subject: [issue37163] dataclasses.replace() fails with the field named "obj"
In-Reply-To: <1559733184.92.0.103225044701.issue37163@roundup.psfhosted.org>
Message-ID: <1561580215.7.0.10043529296.issue37163@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37163>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:17:03 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 20:17:03 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561580223.74.0.765716855638.issue37417@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 5c4ce3e2fa73125fb6f9c501e6c4c8512216b7e1 by Miss Islington (bot) in branch '3.8':
bpo-37417: Fix error handling in bytearray.extend. (GH-14407)
https://github.com/python/cpython/commit/5c4ce3e2fa73125fb6f9c501e6c4c8512216b7e1


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:17:12 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Wed, 26 Jun 2019 20:17:12 +0000
Subject: [issue36738] Add 'array_hook' for json module
In-Reply-To: <1556330218.68.0.648450414936.issue36738@roundup.psfhosted.org>
Message-ID: <1561580232.21.0.394591500719.issue36738@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36738>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:17:31 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Wed, 26 Jun 2019 20:17:31 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561580251.54.0.209497520657.issue37417@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:54:31 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 26 Jun 2019 20:54:31 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
In-Reply-To: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>
Message-ID: <1561582471.88.0.651312107134.issue37419@roundup.psfhosted.org>


Pablo Galindo Salgado <pablogsal at gmail.com> added the comment:


New changeset d52a83a3d471ff3c7e9ebfa1731765e5334f7c24 by Pablo Galindo (Zackery Spytz) in branch 'master':
bpo-37419: Fix possible segfaults when passing large sequences to os.posix_spawn() (GH-14409)
https://github.com/python/cpython/commit/d52a83a3d471ff3c7e9ebfa1731765e5334f7c24


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:54:31 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 20:54:31 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561582471.88.0.749805904461.issue37411@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset dfa9499ccbc14a4227ca8d0c1728e2beacbb45c6 by Victor Stinner (Miss Islington (bot)) in branch '2.7':
[2.7] bpo-37411: Rewrite test_wsgiref.testEnviron() (GH-14394) (GH-14404)
https://github.com/python/cpython/commit/dfa9499ccbc14a4227ca8d0c1728e2beacbb45c6


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:54:37 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 20:54:37 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
In-Reply-To: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>
Message-ID: <1561582477.51.0.924885751378.issue37419@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14225
pull_request: https://github.com/python/cpython/pull/14413

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:55:07 2019
From: report at bugs.python.org (Pablo Galindo Salgado)
Date: Wed, 26 Jun 2019 20:55:07 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
In-Reply-To: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>
Message-ID: <1561582507.97.0.831649659541.issue37419@roundup.psfhosted.org>


Change by Pablo Galindo Salgado <pablogsal at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 16:55:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 20:55:23 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561582523.76.0.915987910108.issue37411@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, the bug is now fixed in 2.7, 3.7, 3.8 and master branches. Thanks Miro for the report. I also enhanced the test to test all variables of handler.environ.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:04:47 2019
From: report at bugs.python.org (konstantin danilov)
Date: Wed, 26 Jun 2019 21:04:47 +0000
Subject: [issue37402] Fatal Python error: Cannot recover from stack overflow
 issues on Python 3.6 and 3.7
In-Reply-To: <1561467308.7.0.878273526771.issue37402@roundup.psfhosted.org>
Message-ID: <1561583087.7.0.431508658842.issue37402@roundup.psfhosted.org>


konstantin danilov <koder.mail at gmail.com> added the comment:

Same error, python3.7. I have attached minifyed code version. It runs into infinite recursion due to __setattr__ call inside 'with' statement on top of same object. As result:

> python /tmp/text.py 
Fatal Python error: Cannot recover from stack overflow.

Current thread 0x00007f6bb073d740 (most recent call first):
  File "/tmp/text.py", line 10 in __getattr__
  ...
  File "/tmp/text.py", line 11 in __getattr__
  File "/tmp/text.py", line 28 in __exit__
  File "/tmp/text.py", line 13 in __getattr__
  ...
  File "/tmp/text.py", line 11 in __getattr__
  ...
[2]    22121 abort (core dumped)  python /tmp/text.py

----------
components: +Interpreter Core -asyncio
nosy: +konstantin danilov
versions:  -Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48439/text.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37402>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:20:12 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 21:20:12 +0000
Subject: [issue37419] Possible segfaults when passing large sequences to
 os.posix_spawn()
In-Reply-To: <1561577086.7.0.888910967379.issue37419@roundup.psfhosted.org>
Message-ID: <1561584012.53.0.0603573294267.issue37419@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 04d4692579cc4e0204c7fbced3692f8aa4bbb857 by Miss Islington (bot) in branch '3.8':
bpo-37419: Fix possible segfaults when passing large sequences to os.posix_spawn() (GH-14409)
https://github.com/python/cpython/commit/04d4692579cc4e0204c7fbced3692f8aa4bbb857


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37419>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:28:28 2019
From: report at bugs.python.org (Steve Dower)
Date: Wed, 26 Jun 2019 21:28:28 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561584508.58.0.0180415367598.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This seems to be a change in Windows at some point, as it still works on one of my other PCs. I've pinged some colleagues to find out what might have happened, but it definitely looks like the lack of Read+Execute permission is working correctly now :(

One potential fix is to return the path under C:\Users\<username>\AppData\Local\Microsoft\WindowsApp as sys.executable (and sys.exec_prefix?), but it only contains the executable launchers and none of the actual Python install. Making this work for venv might require new values in pyvenv.cfg (however, it also seems that the current sys.executable changes with each update, so if we can change it universally to point at the user's WindowsApp directory then that will stop).

The good news is that if you're trying to launch it from within Python it still works, so multiprocessing is not affected. It's only things that write sys.executable out and try to use it later, like venv.

Adding Ned FYI, as if I can come up with a fix for this before we ship 3.7.4 I'd like to include it. No idea yet how possible that will be or what our fix will be though.

----------
nosy: +ned.deily
priority: normal -> critical

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:33:15 2019
From: report at bugs.python.org (Thomas Grainger)
Date: Wed, 26 Jun 2019 21:33:15 +0000
Subject: [issue27071] unittest.TestCase.assertCountEqual is a very misleading
 name
In-Reply-To: <1463788380.52.0.782790370377.issue27071@psf.upfronthosting.co.za>
Message-ID: <1561584795.71.0.307547266531.issue27071@roundup.psfhosted.org>


Thomas Grainger <tagrain at gmail.com> added the comment:

How about assertIsPermutation?

https://www.fluentcpp.com/2019/06/25/understanding-the-implementation-of-stdis_permutation/

----------
nosy: +graingert

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue27071>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:44:01 2019
From: report at bugs.python.org (Ned Deily)
Date: Wed, 26 Jun 2019 21:44:01 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561585441.0.0.150929088013.issue37369@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

OK, I"m bumping it to "deferred blocker" for now so it remains visible.

----------
priority: critical -> deferred blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:47:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 21:47:35 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561585655.7.0.015625974872.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh, this feature has an issue on buildbots. For the 2 workers which allows more than 1 job in parallel, cleantest removes working directories of other running tests...

"x86 Gentoo Installed with X 3.7" is fighting with "x86 Gentoo Installed with X 3.8" for example: when a 3.8 job started, it removed working directories of 2 tests of the 3.7 job. This buildbot uses a single temporary directory for all Python branches: /buildbot/tmp/tmpdir.

I'm not sure how to fix this issue:

* Modify buildbot configuration to ensure that each branch uses a dedicated temporary directory.
* Modify regrtest to check if process <pid> is still running when deleting test_python_<pid>.
* Another idea?

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:52:01 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 21:52:01 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561585921.11.0.231313854137.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> * Another idea?

Another idea is to change the name of temporary directories to add a different prefix per Python branch. Like use "test_python_39_<pid>" for Python 3.9. But I'm not sure how custom jobs come into the play here. Python is not aware of "custom", it has a fixed version and Git branch.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Wed Jun 26 17:59:46 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 21:59:46 +0000
Subject: [issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo
 Installed with X 3.x
In-Reply-To: <1561110016.05.0.998917374097.issue37359@roundup.psfhosted.org>
Message-ID: <1561586386.79.0.327356764969.issue37359@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Until a solution is found, I disabled cleantest to repair *again* the Gentoo buildbot worker:
https://github.com/python/buildmaster-config/commit/378f0e4daed2c26479ee9571bd869110a6733ecc

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37359>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:05:11 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 26 Jun 2019 22:05:11 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561586711.24.0.34939875104.issue29412@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset b950cdb4beabeb093fa3ccc35f53d51cc0193aba by Barry Warsaw (Miss Islington (bot)) in branch '3.7':
bpo-29412: Fix indexError when parsing a header value ending unexpectedly (GH-14387) (GH-14412)
https://github.com/python/cpython/commit/b950cdb4beabeb093fa3ccc35f53d51cc0193aba


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:05:39 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Wed, 26 Jun 2019 22:05:39 +0000
Subject: [issue29412] IndexError thrown on email.message.Message.get
In-Reply-To: <1485957201.62.0.708721670813.issue29412@psf.upfronthosting.co.za>
Message-ID: <1561586739.34.0.247055803167.issue29412@roundup.psfhosted.org>


Barry A. Warsaw <barry at python.org> added the comment:


New changeset 82654a037211a3466a294d53952926fc87f8403d by Barry Warsaw (Miss Islington (bot)) in branch '3.8':
bpo-29412: Fix indexError when parsing a header value ending unexpectedly (GH-14387) (GH-14411)
https://github.com/python/cpython/commit/82654a037211a3466a294d53952926fc87f8403d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:22:26 2019
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 26 Jun 2019 22:22:26 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
Message-ID: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>


New submission from Brandt Bucher <brandtbucher at gmail.com>:

This is related to bpo-37417: os.sched_setaffinity doesn't properly handle errors that arise during iteration of the mask argument:

Python 3.9.0a0 (heads/master:d52a83a, Jun 26 2019, 15:13:41) 
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import os
>>> bad_iter = map(int, "0X")
>>> os.sched_setaffinity(0, bad_iter)
ValueError: invalid literal for int() with base 10: 'X'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
SystemError: <built-in function sched_setaffinity> returned a result with an error set

It looks like this bug is also present on all versions of Python 3. I've attached a patch with a fix and a regression test.

----------
components: Library (Lib)
messages: 346691
nosy: brandtbucher
priority: normal
severity: normal
status: open
title: os.sched_setaffinity does not handle errors during iteration.
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:22:41 2019
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 26 Jun 2019 22:22:41 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561587761.63.0.247607737593.issue37420@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
keywords: +patch
pull_requests: +14226
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14414

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:22:41 2019
From: report at bugs.python.org (Brandt Bucher)
Date: Wed, 26 Jun 2019 22:22:41 +0000
Subject: [issue37417] bytearray.extend does not handle errors during iteration.
In-Reply-To: <1561573262.89.0.0901150232643.issue37417@roundup.psfhosted.org>
Message-ID: <1561587761.71.0.380209363164.issue37417@roundup.psfhosted.org>


Change by Brandt Bucher <brandtbucher at gmail.com>:


----------
pull_requests: +14227
pull_request: https://github.com/python/cpython/pull/14414

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37417>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:34:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 22:34:15 +0000
Subject: [issue37421] Tests leak temporary files
Message-ID: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

When running tests, the tempoary directory is not left clean: there are temporary files which are not removed.

I wrote a PoC change to detect such bugs and I found that at least test_shutil and test_urllib leak such temporary files/directories.

----------
components: Tests
messages: 346692
nosy: vstinner
priority: normal
severity: normal
status: open
title: Tests leak temporary files
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:35:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 22:35:23 +0000
Subject: [issue37421] Tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561588523.74.0.949315946239.issue37421@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
keywords: +patch
pull_requests: +14228
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14415

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:38:25 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 22:38:25 +0000
Subject: [issue37421] Tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561588705.37.0.577610735001.issue37421@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14229
pull_request: https://github.com/python/cpython/pull/14416

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:39:18 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 22:39:18 +0000
Subject: [issue37421] Tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561588758.0.0.133123257973.issue37421@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Test leaking a temporary file in test_urllib:
test.test_urllib.urlretrieve_HttpTests.test_short_content_raises_ContentTooShortError_without_reporthook

I'm not sure of my fix:

diff --git a/Lib/urllib/request.py b/Lib/urllib/request.py
index f6ce9cb6d5..fdddd6e2d8 100644
--- a/Lib/urllib/request.py
+++ b/Lib/urllib/request.py
@@ -283,6 +283,7 @@ def urlretrieve(url, filename=None, reporthook=None, data=None):
                     reporthook(blocknum, bs, size)
 
     if size >= 0 and read < size:
+        urlcleanup()
         raise ContentTooShortError(
             "retrieval incomplete: got only %i out of %i bytes"
             % (read, size), result)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:41:22 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 22:41:22 +0000
Subject: [issue37421] Tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561588882.81.0.479957651349.issue37421@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy: +pablogsal, serhiy.storchaka, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 18:55:21 2019
From: report at bugs.python.org (Brooke Storm)
Date: Wed, 26 Jun 2019 22:55:21 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561589721.19.0.132445928896.issue37369@roundup.psfhosted.org>


Brooke Storm <brooke at largespiky.club> added the comment:

To answer Steve's question, the ver command gives me:
Microsoft Windows [Version 10.0.18917.1000]

Thank you for looking into this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:13:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 23:13:03 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561590783.54.0.132318485721.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Here is a concrete example of ResourceWarning when debugging/stressing multiprocessing code, I interrupt (CTRL+c) test_resource_tracker while it's running:

vstinner at apu$ ./python -m test test_multiprocessing_spawn --fail-env-changed -v -m test_resource_tracker
== CPython 3.9.0a0 (heads/master:689830ee62, Jun 26 2019, 23:07:31) [GCC 9.1.1 20190503 (Red Hat 9.1.1-1)]
== Linux-5.1.11-300.fc30.x86_64-x86_64-with-glibc2.29 little-endian
== cwd: /home/vstinner/prog/python/master/build/test_python_18573
== CPU count: 8
== encodings: locale=UTF-8, FS=utf-8
Run tests sequentially
0:00:00 load avg: 0.32 [1/1] test_multiprocessing_spawn
test_resource_tracker (test.test_multiprocessing_spawn.TestResourceTracker) ... 

^C

/home/vstinner/prog/python/master/Lib/subprocess.py:917: ResourceWarning: subprocess 18576 is still running
  _warn("subprocess %s is still running" % self.pid,
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/home/vstinner/prog/python/master/Lib/test/libregrtest/runtest.py:283: ResourceWarning: unclosed file <_io.BufferedReader name=6>
  return INTERRUPTED
ResourceWarning: Enable tracemalloc to get the object allocation traceback

== Tests result: INTERRUPTED ==
Test suite interrupted by signal SIGINT.

1 test omitted:
    test_multiprocessing_spawn

Total duration: 304 ms
Tests result: INTERRUPTED

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:13:31 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 23:13:31 +0000
Subject: [issue37376] pprint for types.SimpleNamespace
In-Reply-To: <1561292567.66.0.352814165526.issue37376@roundup.psfhosted.org>
Message-ID: <1561590811.6.0.595097351816.issue37376@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 06a8916cf465f139dca958685b0da899364b8a8c by Miss Islington (bot) (Carl Bordum Hansen) in branch 'master':
bpo-37376: pprint support for SimpleNamespace (GH-14318)
https://github.com/python/cpython/commit/06a8916cf465f139dca958685b0da899364b8a8c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37376>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:14:35 2019
From: report at bugs.python.org (Eric Snow)
Date: Wed, 26 Jun 2019 23:14:35 +0000
Subject: [issue37376] pprint for types.SimpleNamespace
In-Reply-To: <1561292567.66.0.352814165526.issue37376@roundup.psfhosted.org>
Message-ID: <1561590875.7.0.0441763735774.issue37376@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Thanks, Carl Bordum Hansen!

----------
nosy: +eric.snow
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37376>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:34:15 2019
From: report at bugs.python.org (Giovanni Cappellotto)
Date: Wed, 26 Jun 2019 23:34:15 +0000
Subject: [issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64
 Windows7 SP1 3.x with: [Errno 28] No space left on device
In-Reply-To: <1561376669.81.0.127051264665.issue37386@roundup.psfhosted.org>
Message-ID: <1561592055.29.0.581137806559.issue37386@roundup.psfhosted.org>


Giovanni Cappellotto <potomak84 at gmail.com> added the comment:

Serhiy, Victor:

I didn't get what's your suggested solution for this task.

Should we just close it as "wontfix", can I go ahead and merge the existing PR, or do you have a better suggestion on how to solve this issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37386>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:39:26 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 23:39:26 +0000
Subject: [issue37421] Some tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561592366.23.0.963253712793.issue37421@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Using PR 14415, the following test of test_multiprocessing_spawn emits a false alarm because multiprocessing use "Finalizer" objects which are only finalized "later":
test.test_multiprocessing_spawn.WithManagerTestMyManager.test_mymanager_context_prestarted


Workaround, call explicitly _run_finalizers():

diff --git a/Lib/test/_test_multiprocessing.py b/Lib/test/_test_multiprocessing.py
index eef262d723..bfecbab9ee 100644
--- a/Lib/test/_test_multiprocessing.py
+++ b/Lib/test/_test_multiprocessing.py
@@ -5651,6 +5651,7 @@ def install_tests_in_module_dict(remote_globs, start_method):
         if need_sleep:
             time.sleep(0.5)
         multiprocessing.process._cleanup()
+        multiprocessing.util._run_finalizers()
         test.support.gc_collect()
 
     remote_globs['setUpModule'] = setUpModule

----------
title: Tests leak temporary files -> Some tests leak temporary files

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:40:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 23:40:04 +0000
Subject: [issue37421] Some tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561592404.78.0.286631429588.issue37421@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 4c26abd14f1b7242998eb2f7756aa375e0fe714f by Victor Stinner in branch 'master':
bpo-37421: Fix test_shutil: don't leak temporary files (GH-14416)
https://github.com/python/cpython/commit/4c26abd14f1b7242998eb2f7756aa375e0fe714f


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:40:09 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 23:40:09 +0000
Subject: [issue37421] Some tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561592409.66.0.387915474303.issue37421@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14230
pull_request: https://github.com/python/cpython/pull/14417

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:43:33 2019
From: report at bugs.python.org (STINNER Victor)
Date: Wed, 26 Jun 2019 23:43:33 +0000
Subject: [issue35389] Use gnu_get_libc_version() in platform.libc_ver()?
In-Reply-To: <1543852933.45.0.788709270274.issue35389@psf.upfronthosting.co.za>
Message-ID: <1561592613.4.0.911459666543.issue35389@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14231
pull_request: https://github.com/python/cpython/pull/14418

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35389>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:46:04 2019
From: report at bugs.python.org (Jim Li)
Date: Wed, 26 Jun 2019 23:46:04 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
Message-ID: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>


New submission from Jim Li <jimli at bcgsc.ca>:

In Python 2, `__path__` used to be a list, so all of the operations available to list are available, e.g., `insert`; you can also do indexing; e.g., `__path__[0]`.

However, I believe that starting from Python 3, it seems to be a <class '_frozen_importlib_external._NamespacePath'>, and a lot of operations that worked previously stopped working.It seems so abruptive and I can't find any deprecation notice on this.

Previously, one is able to insert an additional path to the front of the list by doing

module.__path__.insert(0, 'src/mypath')

Now the only procedure allowed seems to be append. Is there any way to mimic the old behaviour? Sorry, this is my first question so maybe this issue doesn't deserve any more attention. If there is any documentation that talks about the change of type of the NamespacePath, please kindly lemme know.

Sincerely,

Related issues include https://bugs.python.org/issue35843

----------
assignee: docs at python
components: Documentation
messages: 346701
nosy: docs at python, jimli
priority: normal
severity: normal
status: open
title: Documentation on the change of __path__ in Python 3
versions: Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:57:52 2019
From: report at bugs.python.org (miss-islington)
Date: Wed, 26 Jun 2019 23:57:52 +0000
Subject: [issue37421] Some tests leak temporary files
In-Reply-To: <1561588455.96.0.166877646344.issue37421@roundup.psfhosted.org>
Message-ID: <1561593472.56.0.0750227866409.issue37421@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7fe81ce47ff6725e2e4d667d499e23dac19834af by Miss Islington (bot) in branch '3.8':
bpo-37421: Fix test_shutil: don't leak temporary files (GH-14416)
https://github.com/python/cpython/commit/7fe81ce47ff6725e2e4d667d499e23dac19834af


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37421>
_______________________________________

From report at bugs.python.org  Wed Jun 26 19:57:50 2019
From: report at bugs.python.org (Jim Li)
Date: Wed, 26 Jun 2019 23:57:50 +0000
Subject: [issue37423] 2to3 wraps a already bracketed print statement with
 another brackets
Message-ID: <1561593470.29.0.490221066261.issue37423@roundup.psfhosted.org>


New submission from Jim Li <jimli at bcgsc.ca>:

I encountered this issue when I was running 2to3 on a package, Python version 3.7.2, CentOS 7.

To reproduce this bug, create a file called test.py and paste the following code into it

def testSomeRequest(self):

    request = {"someRequest": "request"}
    response = self.sendSearchRequest(request)
    print(response.next_page_token)

The 2to3 tool would do the following:

-    print(response.next_page_token)
+    print((response.next_page_token))

Is this behaviour expected? Thank you.

----------
components: 2to3 (2.x to 3.x conversion tool)
messages: 346702
nosy: jimli
priority: normal
severity: normal
status: open
title: 2to3 wraps a already bracketed print statement with another brackets
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37423>
_______________________________________

From report at bugs.python.org  Wed Jun 26 20:10:00 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 27 Jun 2019 00:10:00 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561594200.76.0.307831241674.issue37422@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

Can you provide a short runnable example that used to work and now does not? And please show any error messages you're seeing.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Wed Jun 26 20:15:29 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 27 Jun 2019 00:15:29 +0000
Subject: [issue37423] 2to3 wraps a already bracketed print statement with
 another brackets
In-Reply-To: <1561593470.29.0.490221066261.issue37423@roundup.psfhosted.org>
Message-ID: <1561594529.19.0.582171165468.issue37423@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

2to3 is designed to convert python2 code to python3. It is not designed to work on python3 code.

I believe this behavior is correct.

----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37423>
_______________________________________

From report at bugs.python.org  Wed Jun 26 20:19:23 2019
From: report at bugs.python.org (Jim Li)
Date: Thu, 27 Jun 2019 00:19:23 +0000
Subject: [issue37423] 2to3 wraps a already bracketed print statement with
 another brackets
In-Reply-To: <1561593470.29.0.490221066261.issue37423@roundup.psfhosted.org>
Message-ID: <1561594763.65.0.0532447856524.issue37423@roundup.psfhosted.org>


Jim Li <jimli at bcgsc.ca> added the comment:

Thanks Eric. That does make sense. The code wasn't really Python 3, it was migrated from 2.7, which uses some Python 3 syntax.

As a side note, if you run 2to3 on this instead of the previous `print(response.next_page_token)`

print(response)

Then 2to3 would say that nothing needs to be converted. It seems like the attribute plays a role here.

Thanks for the quick response. Feel free to close the issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37423>
_______________________________________

From report at bugs.python.org  Wed Jun 26 20:21:16 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Thu, 27 Jun 2019 00:21:16 +0000
Subject: [issue37423] 2to3 wraps a already bracketed print statement with
 another brackets
In-Reply-To: <1561593470.29.0.490221066261.issue37423@roundup.psfhosted.org>
Message-ID: <1561594876.27.0.141008958787.issue37423@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

You might also want to look at python-modernize or similar tools.

----------
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type:  -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37423>
_______________________________________

From report at bugs.python.org  Wed Jun 26 21:10:01 2019
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 27 Jun 2019 01:10:01 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561597801.64.0.775815340853.issue37412@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

This update breaks long-path support in Windows. It includes the following unnecessary check, which is using the wrong comparison operator:

        if (len >= PY_SSIZE_T_MAX / sizeof(wchar_t))

PyMem_RawMalloc already checks this and returns NULL if size > (size_t)PY_SSIZE_T_MAX. This bug is causing a MemoryError with long paths:

    >>> p = 'C:/Temp/longpath' + ('/' + 'a' * 255) * 9
    >>> os.chdir(p)
    >>> len(os.getcwd())
    Traceback (most recent call last):
      File "<stdin>", line 1, in <module>
    MemoryError

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Wed Jun 26 22:23:27 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Thu, 27 Jun 2019 02:23:27 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561602207.51.0.407877276898.issue37366@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
keywords: +patch
pull_requests: +14232
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14419

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Wed Jun 26 23:17:47 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 03:17:47 +0000
Subject: [issue37423] 2to3 wraps a already bracketed print statement with
 another brackets
In-Reply-To: <1561593470.29.0.490221066261.issue37423@roundup.psfhosted.org>
Message-ID: <1561605467.76.0.714325887579.issue37423@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This is a duplicate of https://bugs.python.org/issue10375

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37423>
_______________________________________

From report at bugs.python.org  Thu Jun 27 00:45:43 2019
From: report at bugs.python.org (Ben Lewis)
Date: Thu, 27 Jun 2019 04:45:43 +0000
Subject: [issue37409] relative import without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561610743.52.0.746245193062.issue37409@roundup.psfhosted.org>


Ben Lewis <benjamin.r.lewis at gmail.com> added the comment:

>>> foo = 'oops'
>>> from . import foo as fubar   # should raise ImportError
>>> fubar
'oops'

After further investigation, the problem is that builtins.__import__ (the c port version) does not replicate the behaviour of importlib.__import__ (the python reference version):

>>> import builtins, importlib
>>> __package__ is None
True
>>> importlib.__import__('', globals(), locals(), ('foo',), 1)
ImportError
>>> builtins.__import__('', globals(), locals(), ('foo',), 1)
<module '__main__' (built-in)>

A further discrepancy is that for deeper relative imports, builtins.__import__ raises a ValueError instead of ImportError (contrary to expectation/spec):

>>> from ...... import foo
ValueError

A simple work around uses the python implementation to restore expected behaviour:

>>> builtins.__import__ = importlib.__import__
>>> from ...... import foo
ImportError
>>> from curses import ascii
>>> from . import ascii
ImportError

PS: Brett Cannon, to replicate please copy and paste lines in correct order :-)

----------
resolution: rejected -> 
status: closed -> open
title: relative import_from without parent -> relative import without parent

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Thu Jun 27 01:12:25 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 05:12:25 +0000
Subject: [issue37382] Improve conditional check for test_gdb
In-Reply-To: <1561365073.52.0.781183249984.issue37382@roundup.psfhosted.org>
Message-ID: <1561612345.29.0.905800962012.issue37382@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

> Maybe open an issue to attempt to install gdb on Travis CI?

I created PR 14395 for this.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37382>
_______________________________________

From report at bugs.python.org  Thu Jun 27 02:59:50 2019
From: report at bugs.python.org (haizaar)
Date: Thu, 27 Jun 2019 06:59:50 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
Message-ID: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>


New submission from haizaar <haizaar at gmail.com>:

Consider the following:

subprocess.run('sleep 10', shell=True, timeout=.1, capture_output=True)

It should raise after 0.1 seconds, but it does not - it waits 10 seconds till sleep finishes and only then raises "subprocess.TimeoutExpired: Command 'sleep 10' timed out after 0.1 seconds"

Removing 'capture_output=True' or converting command string to list (and removing shell=True) makes it work.

I'm using Python 3.7.3 on Ubuntu 16.04. Reproduces on official docker Python 3.7.3 image alpine3.8.

----------
components: Library (Lib)
messages: 346712
nosy: haizaar
priority: normal
severity: normal
status: open
title: subprocess.run timeout does not function if shell=True and capture_output=True
type: behavior
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Thu Jun 27 03:04:39 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 07:04:39 +0000
Subject: [issue35389] Use gnu_get_libc_version() in platform.libc_ver()?
In-Reply-To: <1543852933.45.0.788709270274.issue35389@psf.upfronthosting.co.za>
Message-ID: <1561619079.15.0.122417998493.issue35389@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset a719c8f4bd3cc5b1d98700c15c4a818f4d5617a4 by Victor Stinner in branch 'master':
bpo-35389: platform.platform() calls libc_ver() without executable (GH-14418)
https://github.com/python/cpython/commit/a719c8f4bd3cc5b1d98700c15c4a818f4d5617a4


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35389>
_______________________________________

From report at bugs.python.org  Thu Jun 27 03:17:18 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 07:17:18 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
In-Reply-To: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>
Message-ID: <1561619838.12.0.767914201745.issue37424@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

On mac this exits immediately with 0.1 seconds as timeout but reproducible on Ubuntu with master.

----------
nosy: +gregory.p.smith, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Thu Jun 27 03:26:24 2019
From: report at bugs.python.org (Sameer Bobade)
Date: Thu, 27 Jun 2019 07:26:24 +0000
Subject: [issue37425] Using Pyinstaller with (Anaconda) Python 3.7.3 needs
 PyQt5 even if not imported in code
Message-ID: <1561620384.94.0.687116956372.issue37425@roundup.psfhosted.org>


New submission from Sameer Bobade <skbobade at gmail.com>:

I am writing a test code with Python and tested that it works on both Python 3.7 and 3.7.3
The code uses tkinter, and does not use PyQT5
I use pyinstaller 3.4 I convert the python to exe.

With the same code and and same dependencies (including version number) - while converting code to exe using pyinstaller 3.4, with Python 3.7.3 - Pyinstaller asks for additional imports related to PyQt5 (and maybe more). This causes executable to expand in size with unwanted dependencies bundled in output.

Doing same thing with Python 3.7 removes the issue.
Not sure if this is Anaconda specific or general Python issue.

Both tests were done in virtual environment with Anaconda Python 3.7.3 as base.
Attached logs from pyinstaller for both versions.

Also reported to Anaconda - https://github.com/Anaconda-Platform/anaconda-project/issues/207

----------
components: Windows
files: pyinstallerlog.zip
messages: 346715
nosy: Sameer Bobade, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Using Pyinstaller with (Anaconda) Python 3.7.3 needs PyQt5 even if not imported in code
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48440/pyinstallerlog.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37425>
_______________________________________

From report at bugs.python.org  Thu Jun 27 03:30:36 2019
From: report at bugs.python.org (Pavel Minaev)
Date: Thu, 27 Jun 2019 07:30:36 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561620636.01.0.276394417611.issue37416@roundup.psfhosted.org>


Change by Pavel Minaev <me at int19h.org>:


----------
nosy: +int19h

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:07:42 2019
From: report at bugs.python.org (Borja)
Date: Thu, 27 Jun 2019 08:07:42 +0000
Subject: [issue37415] Error build Python with Intel compiler
In-Reply-To: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>
Message-ID: <1561622862.83.0.255336034664.issue37415@roundup.psfhosted.org>


Borja <saszalez at gmail.com> added the comment:

In pyconfig.h the variable HAVE_STD_ATOMIC appears like this:

/* Has stdatomic.h with atomic_int */
#define HAVE_STD_ATOMIC 1

I searched at <stdatomic.h> atomic_uintptr_t and found nothing.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:16:56 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 08:16:56 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561623416.06.0.640009721639.issue33926@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +14233
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14395

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:17:58 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 08:17:58 +0000
Subject: [issue32926] Add public TestCase method/property to get result of
 current test
In-Reply-To: <1519423717.02.0.467229070634.issue32926@psf.upfronthosting.co.za>
Message-ID: <1561623478.55.0.243442932787.issue32926@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
keywords: +patch
pull_requests: +14234
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14395

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:26:48 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 27 Jun 2019 08:26:48 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1561624008.29.0.527065140657.issue36656@roundup.psfhosted.org>


Change by Tal Einat <taleinat at gmail.com>:


----------
components: +Library (Lib)
versions: +Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:34:10 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 08:34:10 +0000
Subject: [issue32926] Add public TestCase method/property to get result of
 current test
In-Reply-To: <1519423717.02.0.467229070634.issue32926@psf.upfronthosting.co.za>
Message-ID: <1561624450.08.0.0194266719548.issue32926@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests:  -14234

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:34:51 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 08:34:51 +0000
Subject: [issue32926] Add public TestCase method/property to get result of
 current test
In-Reply-To: <1519423717.02.0.467229070634.issue32926@psf.upfronthosting.co.za>
Message-ID: <1561624491.23.0.262201618894.issue32926@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +ezio.melotti, michael.foord, rbcollins
stage: patch review -> 
versions: +Python 3.9 -Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:35:41 2019
From: report at bugs.python.org (Tal Einat)
Date: Thu, 27 Jun 2019 08:35:41 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1561624541.31.0.445077127928.issue36656@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

I think there is a general flaw with the suggested implementation approach.

An infinite loop as currently suggested seems dangerous to me.  For example, it could cause a program to stall indefinitely in some unforeseen edge-case.  I don't think this would be acceptable for something in the stdlib.

On the other hand, limiting this loop to a finite number of attempts would re-introduce the necessity of handling the case where creating the symlink fails. Users of the function would still need to deal with this case (or risk unhandled exceptions).

In either case, this wouldn't give users the simplicity and peace of mind that a truly atomic operation would.  ISTM that only using actually atomic operations, as provided by the underlying file system and/or OS, would allow us to provide that.

Given the above, I must say that I don't see this providing enough utility to justify inclusion in the stdlib, unless a better implementation approach can be found.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:37:07 2019
From: report at bugs.python.org (Martin Panter)
Date: Thu, 27 Jun 2019 08:37:07 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
In-Reply-To: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>
Message-ID: <1561624627.2.0.98322031951.issue37424@roundup.psfhosted.org>


Martin Panter <vadmium+py at gmail.com> added the comment:

Same thing going on as in Issue 30154. The shell is probably spawning the ?sleep? command as a child process (grandchild of Python), and waiting for it to exit. When Python times out, it will kill the shell process, leaving the grandchild as an orphan. The ?sleep? process will still be running and probably holds the ?stdout? and/or ?stderr? pipes open, and Python will wait indefinitely to be sure it has captured all the output to those pipes.

Also see Issue 26534 proposes APIs to kill a process group rather than the single child process.

----------
nosy: +martin.panter
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> subprocess.run with stderr connected to a pipe won't timeout when killing a never-ending shell commanad

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Thu Jun 27 04:43:47 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Thu, 27 Jun 2019 08:43:47 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561625027.8.0.846917549125.issue37366@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

I am not sure I understand the use case. Other than "unmounting a mount point" the other scenarios look unrealistic to me and also require a fd instead of a path. Also, if you want to unmount a path you can do so via *onerror* instead (unmount + delete). Pre-emptively checking if you have the permission to do something is sort of unpythonic and racy.

----------
versions:  -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Thu Jun 27 05:12:20 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 09:12:20 +0000
Subject: [issue32926] Add public TestCase method/property to get result of
 current test
In-Reply-To: <1519423717.02.0.467229070634.issue32926@psf.upfronthosting.co.za>
Message-ID: <1561626740.28.0.0530457469138.issue32926@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests: +14235
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14395

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 05:20:46 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 09:20:46 +0000
Subject: [issue32926] Add public TestCase method/property to get result of
 current test
In-Reply-To: <1519423717.02.0.467229070634.issue32926@psf.upfronthosting.co.za>
Message-ID: <1561627246.42.0.43089670144.issue32926@roundup.psfhosted.org>


Change by Jeroen Demeyer <J.Demeyer at UGent.be>:


----------
pull_requests:  -14235

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 05:23:38 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Thu, 27 Jun 2019 09:23:38 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561627418.04.0.946333339245.issue37416@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

The second import actually doesn't happen. You need to reload it. This can be tested by putting print('loading threading') in threading.py.

Your first method-thread will still think it's main thread. So no idea if this is a bug or wrong use. 'import threading' should be one of the first lines in your main code/thread?


import _thread
import time
import importlib
barrier = 0

def method():
    import threading  # Will make threading the wrong thread.
    global barrier
    print(threading.main_thread())
    print(threading.current_thread())
    barrier = 1

_thread.start_new_thread(method, ())

while barrier != 1:
    time.sleep(.1)

import threading
importlib.reload(threading)
print(threading.main_thread())
print(threading.current_thread())

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 05:49:37 2019
From: report at bugs.python.org (Atul Bagga)
Date: Thu, 27 Jun 2019 09:49:37 +0000
Subject: [issue37426] getpass.getpass not working with on windows when ctrl+v
 is used to enter the string
Message-ID: <1561628977.4.0.232389584594.issue37426@roundup.psfhosted.org>


New submission from Atul Bagga <bagga.atul at gmail.com>:

Detailed issue filed here - https://github.com/microsoft/knack/issues/160

----------
components: Library (Lib)
messages: 346721
nosy: Atul Bagga
priority: normal
severity: normal
status: open
title: getpass.getpass not working with on windows when ctrl+v  is used to enter the string
type: behavior
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37426>
_______________________________________

From report at bugs.python.org  Thu Jun 27 05:51:45 2019
From: report at bugs.python.org (NODA, Kai)
Date: Thu, 27 Jun 2019 09:51:45 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
Message-ID: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>


New submission from NODA, Kai <nodakai at gmail.com>:

class X:
    def __bool__(self):
        return True

x = [1, 2, 3]
x.sort(reverse=X())
print(x)
print(sorted([1, 2, 3], reverse=X()))

TypeError: an integer is required (got type X)

We can always still do

x.sort(reverse=bool(X()))
print(sorted([1, 2, 3], reverse=bool(X())))

but that isn't cool

----------
components: Interpreter Core
messages: 346722
nosy: nodakai
priority: normal
severity: normal
status: open
title: sorted() and list.sort() don't accept non-boolean objects with __bool__() as `reverse` parameter
type: behavior
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:06:32 2019
From: report at bugs.python.org (Pavel Minaev)
Date: Thu, 27 Jun 2019 10:06:32 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561629992.85.0.963801625789.issue37416@roundup.psfhosted.org>


Pavel Minaev <me at int19h.org> added the comment:

This is a bit tricky to explain... There's no easy way to achieve this effect "normally". It manifests due to the way some Python debuggers (specifically, pydevd and ptvsd - as used by PyCharm, PyDev, and VSCode) implement non-cooperative attaching to a running Python process by PID.

A TL;DR take is that those debuggers have to inject a new thread into a running process from the outside, and then run some Python code on that thread. There are OS APIs for such thread injection - e.g. CreateRemoteThread on Windows. There are various tricks that they then have to use to safely acquire GIL and invoke PyEval_InitThreads, but ultimately it comes down to running Python code.

That is the point where this can manifest. Basically, as soon as that injected code (i.e. the actual debugger) imports threading, things break. And advanced debuggers do need background threads for some functionality...

Here are the technical details - i.e. how thread injection happens exactly, and what kind of code it might run - if you're interested.
https://github.com/microsoft/ptvsd/issues/1542

I think that a similar problem can also occur in an embedded Python scenario with multithreading. Consider what happens if the hosted interpreter is initialized from the main thread of the host app - but some Python code is then run from the background thread, and that code happens to be the first in the process to import threading. Then that background thread becomes the "main thread" for threading, with the same results as described above.

The high-level problem, I think, is that there's an inconsistency between what Python itself considers "main thread" (i.e. main_thread in ceval.c, as set by PyEval_InitThreads), and what threading module considers "main thread" (i.e. _main_thread in threading.py). Logically, these should be in sync.

If PyEval_InitThreads is the source of truth, then the existing thread injection technique will "just work" as implemented already in all the aforementioned debuggers. It makes sure to invoke PyEval_InitThreads via Py_AddPendingCall, rather than directly from the background thread, precisely so that the interpreter doesn't get confused. 

Furthermore, on 3.7+, PyEval_InitThreads is already automatically invoked by Py_Initialize, and hence when used by python.exe, will mark the actual first thread in the process as the main thread. So, using it a the source of truth would guarantee that attach by thread injection works correctly in all non-embedded Python scenarios.

Apps hosting Python would still need to ensure that they always call Py_Initialize on what they want to be the main thread, as they already have to do; but they wouldn't need to worry about "import threading" anymore.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:10:40 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 10:10:40 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561630240.06.0.0705652266775.issue37427@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:24:24 2019
From: report at bugs.python.org (Pavel Minaev)
Date: Thu, 27 Jun 2019 10:24:24 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561631064.73.0.237158359449.issue37416@roundup.psfhosted.org>


Pavel Minaev <me at int19h.org> added the comment:

It's also possible to hit if using some native code that starts a background thread without going via threading, and runs Python code on that background thread. In that case, if that Python code then does "import threading", and threading hasn't been imported yet, then you have this same problem.

Here's a pure Python repro using ctypes on Win32:

#--------------------------
import sys, time
from ctypes import *

ThreadProc = WINFUNCTYPE(c_uint32, c_void_p)

@ThreadProc
def thread_proc(_):
    import threading
    print(threading.current_thread() is threading.main_thread())
    return 0

assert "threading" not in sys.modules
#import threading  # uncomment to fix

windll.kernel32.CreateThread(None, c_size_t(0), thread_proc, None, c_uint32(0), None)
time.sleep(1)

assert "threading" in sys.modules
import threading
print(threading.current_thread() is threading.main_thread())
#--------------------------

Here's the output:

>py -3 main.py
True
False
Exception ignored in: <module 'threading' from 'C:\\Python\\3.7-64\\lib\\threading.py'>
Traceback (most recent call last):
  File "C:\Python\3.7-64\lib\threading.py", line 1276, in _shutdown
    assert tlock.locked()
AssertionError:

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:32:50 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 10:32:50 +0000
Subject: [issue37426] getpass.getpass not working with on windows when ctrl+v
 is used to enter the string
In-Reply-To: <1561628977.4.0.232389584594.issue37426@roundup.psfhosted.org>
Message-ID: <1561631570.87.0.976806669649.issue37426@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37426>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:33:29 2019
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 27 Jun 2019 10:33:29 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
Message-ID: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>


New submission from Christian Heimes <lists at cheimes.de>:

Enabling TLS 1.3 post handshake auth also enables cert chain validation. OpenSSL documents SSL_VERIFY_POST_HANDSHAKE as ignored for client side. However tls_process_server_certificate in the client state machine code does not ignore the flag and checks for a correct cert chain.

see https://github.com/openssl/openssl/issues/9259 and https://github.com/openssl/openssl/blob/743694a6c29e5a6387819523fad5e3b7e613f1ee/ssl/statem/statem_clnt.c#L1899-L1918

----------
assignee: christian.heimes
components: SSL
messages: 346725
nosy: christian.heimes
priority: high
severity: normal
status: open
title: SSLContext.post_handshake_auth implicitly enables cert validation
type: behavior
versions: Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Thu Jun 27 06:46:30 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Thu, 27 Jun 2019 10:46:30 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561632390.91.0.160523454366.issue37416@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Understood. Thank you for the extra info. I'll read up on all the suggestions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:00:55 2019
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 27 Jun 2019 11:00:55 +0000
Subject: [issue37426] getpass.getpass not working with on windows when ctrl+v
 is used to enter the string
In-Reply-To: <1561628977.4.0.232389584594.issue37426@roundup.psfhosted.org>
Message-ID: <1561633255.06.0.689810178385.issue37426@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

getpass() reads from the console via msvcrt.getwch(). This is a raw console read, so Ctrl+V is read as the SYN (0x16) control character. Only the following keys are handled specially by getpass: 

* Ctrl+C - raise KeyboardInterrupt
* Ctrl+H (backspace) - delete the previous character
* Ctrl+J (linefeed) and Ctrl+M (return) - return

getpass() behaves pretty much the same in a Linux terminal emulator, except Ctrl+H isn't backspace. 

Recent versions of the console host in Windows 10 have an option to support pasting via Ctrl+Shift+V, regardless of the input mode. This is pretty common in Unix terminal emulators as well. You can change this setting in the Properties->Options dialog for a particular window or shortcut, or the default setting in the Defaults->Options dialog. In the "HKCU\Console" registry key, the DWORD value name is "InterceptCopyPaste".

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37426>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:18:06 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 27 Jun 2019 11:18:06 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561634286.35.0.312685164786.issue33926@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 667eaffb4e5d03bf8129773f79649c3befaa5b1a by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-33926: enable GDB tests on Travis CI (GH-14395)
https://github.com/python/cpython/commit/667eaffb4e5d03bf8129773f79649c3befaa5b1a


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:18:31 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 11:18:31 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561634311.38.0.813621229801.issue33926@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14236
pull_request: https://github.com/python/cpython/pull/14420

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:31:45 2019
From: report at bugs.python.org (Christian Heimes)
Date: Thu, 27 Jun 2019 11:31:45 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561635105.33.0.250174909011.issue37428@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
keywords: +patch
pull_requests: +14237
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14421

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:40:07 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 11:40:07 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561635607.3.0.974978529166.issue36889@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14238
pull_request: https://github.com/python/cpython/pull/14422

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Thu Jun 27 07:47:02 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 11:47:02 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561636022.89.0.220343956267.issue33926@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 7e9d706fd6e2f49d2bd829890c46868105767769 by Miss Islington (bot) in branch '3.8':
bpo-33926: enable GDB tests on Travis CI (GH-14395)
https://github.com/python/cpython/commit/7e9d706fd6e2f49d2bd829890c46868105767769


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:23:18 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 27 Jun 2019 12:23:18 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561638198.89.0.160433760799.issue37427@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

I haven't looked at the source yet, but from experimentation I'm finding it rather hard to guess what the rules are for what works and what doesn't:

Python 3.7.3 (default, Mar 30 2019, 03:37:43) 
[Clang 10.0.0 (clang-1000.11.45.5)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import decimal, fractions, numpy
>>> sorted([1, 2, 3], reverse=0.5)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: integer argument expected, got float
>>> sorted([1, 2, 3], reverse=decimal.Decimal(0.5))
[1, 2, 3]
>>> sorted([1, 2, 3], reverse=fractions.Fraction(0.5))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: an integer is required (got type Fraction)
>>> sorted([1, 2, 3], reverse=numpy.int64(1))
[3, 2, 1]
>>> sorted([1, 2, 3], reverse=numpy.bool_(True))
[3, 2, 1]

----------
nosy: +mark.dickinson

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:25:13 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 27 Jun 2019 12:25:13 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561638313.33.0.681554535294.issue37427@roundup.psfhosted.org>


Change by Mark Dickinson <dickinsm at gmail.com>:


----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:32:08 2019
From: report at bugs.python.org (Mark Dickinson)
Date: Thu, 27 Jun 2019 12:32:08 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561638728.74.0.00981134262834.issue37427@roundup.psfhosted.org>


Mark Dickinson <dickinsm at gmail.com> added the comment:

> I'm finding it rather hard to guess what the rules are for what works and what doesn't

So now that I've looked at the source: anything with an `__int__` method works, except that `float` instances are explicitly excluded. So this explains for example:

>>> sorted([1, 2, 3], reverse=numpy.float64(0.5))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: integer argument expected, got float
>>> sorted([1, 2, 3], reverse=numpy.float32(0.5))
[1, 2, 3]

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:39:22 2019
From: report at bugs.python.org (Ryan Petrello)
Date: Thu, 27 Jun 2019 12:39:22 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
Message-ID: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>


New submission from Ryan Petrello <ryan at ryanpetrello.com>:

It's possible to cause Python child processes to encountered a deadlock and hang on fork by:

1) Spawning one or more threads in a parent process
2) Have one of those threads emit log lines
3) Have the main thread use os.fork()
4) In the child, log immediately

The attached Python script can be used to reproduce this issue in Python 2.7.15 and Python 3.6.5

----------
components: Library (Lib)
files: hang.py
messages: 346732
nosy: ryan.petrello
priority: normal
severity: normal
status: open
title: Python hangs on fork when a logger is in use in a background thread
versions: Python 2.7, Python 3.6
Added file: https://bugs.python.org/file48441/hang.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:41:01 2019
From: report at bugs.python.org (Ryan Petrello)
Date: Thu, 27 Jun 2019 12:41:01 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
In-Reply-To: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>
Message-ID: <1561639261.81.0.143243593917.issue37429@roundup.psfhosted.org>


Ryan Petrello <ryan at ryanpetrello.com> added the comment:

This issue seems _very_ similar to https://bugs.python.org/issue6721, but I wasn't able to encounter the exact stack I've been seeing on my end.  Specifically, when I run the reproducer script in this issue (hang.py) for a few minutes, hung child processes start to build up.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:46:39 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 27 Jun 2019 12:46:39 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561639599.04.0.0125009686719.issue30345@roundup.psfhosted.org>


Change by Inada Naoki <songofacandy at gmail.com>:


----------
pull_requests: +14239
pull_request: https://github.com/python/cpython/pull/14423

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Thu Jun 27 08:47:54 2019
From: report at bugs.python.org (Ryan Petrello)
Date: Thu, 27 Jun 2019 12:47:54 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
In-Reply-To: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>
Message-ID: <1561639674.19.0.58582136818.issue37429@roundup.psfhosted.org>


Ryan Petrello <ryan at ryanpetrello.com> added the comment:

Here's the stack of one the hung child processes under py2.7:

(gdb) py-bt
#4 Waiting for a lock (e.g. GIL)
#5 Waiting for a lock (e.g. GIL)
#7 Frame 0x7f346a925430, for file /usr/lib64/python2.7/Queue.py, line 118, in put (self=<Queue(unfinished_tasks=147, queue=<collections.deque at remote 0x7f346a908ec0>, maxsize=0, all_tasks_done=<_Condition(_Verbose__verbose=False, _Condition__lock=<thread.lock at remote 0x7f346aa74230>, acquire=<built-in method acquire of thread.lock object at remote 0x7f346aa74230>, _Condition__waiters=[], release=<built-in method release of thread.lock object at remote 0x7f346aa74230>) at remote 0x7f3467df4150>, mutex=<thread.lock at remote 0x7f346aa74230>, not_full=<_Condition(_Verbose__verbose=False, _Condition__lock=<thread.lock at remote 0x7f346aa74230>, acquire=<built-in method acquire of thread.lock object at remote 0x7f346aa74230>, _Condition__waiters=[], release=<built-in method release of thread.lock object at remote 0x7f346aa74230>) at remote 0x7f3467df4110>, not_empty=<_Condition(_Verbose__verbose=False, _Condition__lock=<thread.lock at remote 0x7f346aa74230>, acquire=<built-in method acquire of thread.lock object ...(truncated)
    self.not_full.acquire()
#11 Frame 0x1ae6ae0, for file /tmp/foo/lib/python2.7/site-packages/concurrent/futures/thread.py, line 129, in submit (self=<ThreadPoolExecutor(_shutdown_lock=<thread.lock at remote 0x7f346aa74270>, _shutdown=False, _max_workers=2, _thread_name_prefix='Thread---Type <return> to continue, or q <return> to quit---
PoolExecutor-0', _threads=set([<...>, <...>]), _work_queue=<...>) at remote 0x7f3467df0f90>, fn=<instancemethod at remote 0x7f3467e01e10>, args=(<LogRecord(threadName='MainThread', name='example', thread=139863104821056, created=<float at remote 0x1a7d580>, process=1155, processName='Process-74', args=(), module='hang', filename='hang.py', levelno=20, exc_text=None, pathname='/tmp/hang.py', lineno=25, msg='exiting', exc_info=None, funcName='exit', relativeCreated=<float at remote 0x1a7d568>, levelname='INFO', msecs=<float at remote 0x1a7d550>) at remote 0x7f346a972490>,), kwargs={}, f=<Future(_exception=None, _result=None, _condition=<_Condition(_Condition__lock=<_RLock(_Verbose__verbose=False, _RLock__owner=None, _RLock__block=<thread.lock at remote 0x7f346aa...(truncated)
    self._work_queue.put(w)
#15 Frame 0x7f3467df15a8, for file /tmp/hang.py, line 16, in handle (self=<ThreadPoolLogger(executor=<ThreadPoolExecutor(_shutdown_lock=<thread.lock at remote 0x7f346aa74270>, _shutdown=False, _max_workers=2, _thread_name_prefix='ThreadPoolExecutor-0', _threads=set([<...>, <...>]), _work_queue=<...>) at remote 0x7f3467df0f90>) at remote 0x7f3467df0f50>, record=<LogRecord(threadName='MainThread', name='example', thread=139863104821056, created=<float at remote 0x1a7d580>, process=1155, processName='Process-74', args=(), module='hang', filename='hang.py', levelno=20, exc_text=None, pathname='/tmp/hang.py', lineno=25, msg='exiting', exc_info=None, funcName='exit', relativeCreated=<f---Type <return> to continue, or q <return> to quit---
loat at remote 0x1a7d568>, levelname='INFO', msecs=<float at remote 0x1a7d550>) at remote 0x7f346a972490>)
    self.executor.submit(self.send, record)
#19 Frame 0x7f346a925240, for file /usr/lib64/python2.7/logging/__init__.py, line 1318, in callHandlers (self=<Logger(name='example', parent=None, handlers=[<ThreadPoolLogger(executor=<ThreadPoolExecutor(_shutdown_lock=<thread.lock at remote 0x7f346aa74270>, _shutdown=False, _max_workers=2, _thread_name_prefix='ThreadPoolExecutor-0', _threads=set([<...>, <...>]), _work_queue=<...>) at remote 0x7f3467df0f90>) at remote 0x7f3467df0f50>], level=10, disabled=0, propagate=1, filters=[]) at remote 0x7f3467de1a90>, record=<LogRecord(threadName='MainThread', name='example', thread=139863104821056, created=<float at remote 0x1a7d580>, process=1155, processName='Process-74', args=(), module='hang', filename='hang.py', levelno=20, exc_text=None, pathname='/tmp/hang.py', lineno=25, msg='exiting', exc_info=None, funcName='exit', relativeCreated=<float at remote 0x1a7d568>, levelname='INFO', msecs=<float at remote 0x1a7d550>) at remote 0x7f346a972490>, c=<...>, found=1, hdlr=<...>)
    hdlr.handle(record)
#22 Frame 0x7f3467df13e0, for file /usr/lib64/python2.7/logging/__init__.py, line 1278, in handle (self=<Logger(name='example', parent=None, handlers=[<ThreadPoolLogger(executor=<ThreadPoolExecutor(_shutdown_lock=<thread.lock at remote 0x7f346aa74270>, _shut---Type <return> to continue, or q <return> to quit---
down=False, _max_workers=2, _thread_name_prefix='ThreadPoolExecutor-0', _threads=set([<...>, <...>]), _work_queue=<...>) at remote 0x7f3467df0f90>) at remote 0x7f3467df0f50>], level=10, disabled=0, propagate=1, filters=[]) at remote 0x7f3467de1a90>, record=<LogRecord(threadName='MainThread', name='example', thread=139863104821056, created=<float at remote 0x1a7d580>, process=1155, processName='Process-74', args=(), module='hang', filename='hang.py', levelno=20, exc_text=None, pathname='/tmp/hang.py', lineno=25, msg='exiting', exc_info=None, funcName='exit', relativeCreated=<float at remote 0x1a7d568>, levelname='INFO', msecs=<float at remote 0x1a7d550>) at remote 0x7f346a972490>)
    self.callHandlers(record)
#25 Frame 0x1ae60e0, for file /usr/lib64/python2.7/logging/__init__.py, line 1268, in _log (self=<Logger(name='example', parent=None, handlers=[<ThreadPoolLogger(executor=<ThreadPoolExecutor(_shutdown_lock=<thread.lock at remote 0x7f346aa74270>, _shutdown=False, _max_workers=2, _thread_name_prefix='ThreadPoolExecutor-0', _threads=set([<...>, <...>]), _work_queue=<...>) at remote 0x7f3467df0f90>) at remote 0x7f3467df0f50>], level=10, disabled=0, propagate=1, filters=[]) at remote 0x7f3467de1a90>, level=20, msg='exiting', args=(), exc_info=None, extra=None, fn='/tmp/hang.py', lno=25, func='exit', record=<LogRecord(threadName='MainThread', name='example', thread=139863104821056, created=<float at remote 0x1a7d580>, process=1155, processName='Process-74', args=(...), ---Type <return> to continue, or q <return> to quit---

Here's the similar stack under py3.6:

(gdb) bt
#0  0x00007f208166cadb in futex_abstimed_wait (cancel=true, private=<optimized out>,
    abstime=0x0, expected=0, futex=0x88bbf0)
    at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:43
#1  do_futex_wait (sem=sem at entry=0x88bbf0, abstime=0x0)
    at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:223
#2  0x00007f208166cb6f in __new_sem_wait_slow (sem=0x88bbf0, abstime=0x0)
    at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:292
#3  0x00007f208166cc0b in __new_sem_wait (sem=<optimized out>)
    at ../nptl/sysdeps/unix/sysv/linux/sem_wait.c:28
#4  0x00007f2081a05a80 in PyThread_acquire_lock_timed (lock=0x88bbf0,
    microseconds=microseconds at entry=-1, intr_flag=intr_flag at entry=0)
    at /usr/src/debug/Python-3.6.8/Python/thread_pthread.h:386
#5  0x00007f2081a05c34 in PyThread_acquire_lock (lock=<optimized out>,
    waitflag=waitflag at entry=1)
    at /usr/src/debug/Python-3.6.8/Python/thread_pthread.h:595
#6  0x00007f2081918797 in _enter_buffered_busy (self=self at entry=0x7f2081e29b48)
    at /usr/src/debug/Python-3.6.8/Modules/_io/bufferedio.c:292
#7  0x00007f2081a1f131 in buffered_flush (self=0x7f2081e29b48, args=<optimized out>)
    at /usr/src/debug/Python-3.6.8/Modules/_io/bufferedio.c:852
---Type <return> to continue, or q <return> to quit---
#8  0x00007f2081962dd0 in _PyCFunction_FastCallDict (
    func_obj=func_obj at entry=0x7f207eb1cb88, args=args at entry=0x0, nargs=0,
    kwargs=kwargs at entry=0x0)
    at /usr/src/debug/Python-3.6.8/Objects/methodobject.c:209
#9  0x00007f2081924c46 in _PyObject_FastCallDict (func=func at entry=0x7f207eb1cb88,
    args=args at entry=0x0, nargs=nargs at entry=0, kwargs=kwargs at entry=0x0)
    at /usr/src/debug/Python-3.6.8/Objects/abstract.c:2313
#10 0x00007f2081925c66 in callmethod (is_size_t=1, va=0x7ffee1ce4ef0, format=0x0,
    func=0x7f207eb1cb88) at /usr/src/debug/Python-3.6.8/Objects/abstract.c:2583

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:11:23 2019
From: report at bugs.python.org (haizaar)
Date: Thu, 27 Jun 2019 13:11:23 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
In-Reply-To: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>
Message-ID: <1561641083.07.0.397479552724.issue37424@roundup.psfhosted.org>


haizaar <haizaar at gmail.com> added the comment:

Thanks for looking at it.

My original code had "tar" running, which is a child of the shell as well... I assume running exec in the shell may help somewhat, but not a cure obviously.

I'm all for killing the process group. "Run something and get it's about" should be simple enough without requiring a programmer to know all POSIX process semantics.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:11:54 2019
From: report at bugs.python.org (haizaar)
Date: Thu, 27 Jun 2019 13:11:54 +0000
Subject: [issue26534] subprocess.check_output with shell=True ignores the
 timeout
In-Reply-To: <1457653531.44.0.556796452495.issue26534@psf.upfronthosting.co.za>
Message-ID: <1561641114.43.0.774698345208.issue26534@roundup.psfhosted.org>


Change by haizaar <haizaar at gmail.com>:


----------
nosy: +haizaar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26534>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:12:00 2019
From: report at bugs.python.org (haizaar)
Date: Thu, 27 Jun 2019 13:12:00 +0000
Subject: [issue30154] subprocess.run with stderr connected to a pipe won't
 timeout when killing a never-ending shell commanad
In-Reply-To: <1493029874.23.0.365021685695.issue30154@psf.upfronthosting.co.za>
Message-ID: <1561641120.6.0.706052453844.issue30154@roundup.psfhosted.org>


Change by haizaar <haizaar at gmail.com>:


----------
nosy: +haizaar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30154>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:14:54 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 13:14:54 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
In-Reply-To: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>
Message-ID: <1561641294.14.0.603938996634.issue37429@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

See also https://bugs.python.org/issue36533

----------
nosy: +vinay.sajip, xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:20:42 2019
From: report at bugs.python.org (haizaar)
Date: Thu, 27 Jun 2019 13:20:42 +0000
Subject: [issue5115] Extend subprocess.kill to be able to kill process groups
In-Reply-To: <1233370260.58.0.70597374825.issue5115@psf.upfronthosting.co.za>
Message-ID: <1561641642.01.0.330969039346.issue5115@roundup.psfhosted.org>


Change by haizaar <haizaar at gmail.com>:


----------
nosy: +haizaar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5115>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:27:37 2019
From: report at bugs.python.org (Ryan Petrello)
Date: Thu, 27 Jun 2019 13:27:37 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
In-Reply-To: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>
Message-ID: <1561642057.05.0.0417012911543.issue37429@roundup.psfhosted.org>


Ryan Petrello <ryan at ryanpetrello.com> added the comment:

Also, for what it's worth, I'm *not* able to reproduce this hang in Python 3.7.0.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 09:32:31 2019
From: report at bugs.python.org (Ryan Petrello)
Date: Thu, 27 Jun 2019 13:32:31 +0000
Subject: [issue37429] Python hangs on fork when a logger is in use in a
 background thread
In-Reply-To: <1561639162.28.0.948669559671.issue37429@roundup.psfhosted.org>
Message-ID: <1561642351.98.0.462190387418.issue37429@roundup.psfhosted.org>


Ryan Petrello <ryan at ryanpetrello.com> added the comment:

Actually, I think I *am* seeing this on 3.7:

(gdb) bt
#0  0x00007f130d530adb in futex_abstimed_wait (cancel=true, private=<optimized out>, abstime=0x0, expected=0,
    futex=0x142c6d0) at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:43
#1  do_futex_wait (sem=sem at entry=0x142c6d0, abstime=0x0) at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:223
#2  0x00007f130d530b6f in __new_sem_wait_slow (sem=0x142c6d0, abstime=0x0)
    at ../nptl/sysdeps/unix/sysv/linux/sem_waitcommon.c:292
#3  0x00007f130d530c0b in __new_sem_wait (sem=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/sem_wait.c:28
#4  0x0000000000535baa in PyThread_acquire_lock_timed (lock=0x142c6d0, microseconds=microseconds at entry=-1,
    intr_flag=intr_flag at entry=0) at Python/thread_pthread.h:340
#5  0x0000000000535c24 in PyThread_acquire_lock (lock=<optimized out>, waitflag=waitflag at entry=1)
    at Python/thread_pthread.h:576
#6  0x000000000058949a in _enter_buffered_busy (self=0x7f130ca0fbf8) at ./Modules/_io/bufferedio.c:282
#7  buffered_flush (self=0x7f130ca0fbf8, args=<optimized out>) at ./Modules/_io/bufferedio.c:835
#8  0x000000000043aae8 in _PyMethodDef_RawFastCallDict (kwargs=<optimized out>, nargs=0, args=<optimized out>,
    self=0x7f130ca0fbf8, method=0x8eeda0 <bufferedwriter_methods+320>) at Objects/call.c:482
#9  _PyCFunction_FastCallDict (func=0x7f130aeb3438, args=<optimized out>, nargs=0, kwargs=<optimized out>)
    at Objects/call.c:582

----------
versions: +Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37429>
_______________________________________

From report at bugs.python.org  Thu Jun 27 10:25:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 14:25:35 +0000
Subject: [issue37415] Error build Python with Intel compiler: <stdatomic.h>
 doesn't provide atomic_uintptr_t
In-Reply-To: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>
Message-ID: <1561645535.6.0.719607930124.issue37415@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> I searched at <stdatomic.h> atomic_uintptr_t and found nothing.

That's not good. I expectd std to stand for standard. I expected that atomic_uintptr_t would always be available on <stdatomic.h>.

GCC defines the type as:

typedef _Atomic __UINTPTR_TYPE__ atomic_uintptr_t;

Maybe you should try:

typedef struct _Py_atomic_address {
    _Atomic Py_uintptr_t _value;
} _Py_atomic_address;

----------
title: Error build Python with Intel compiler -> Error build Python with Intel compiler: <stdatomic.h> doesn't provide atomic_uintptr_t

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Thu Jun 27 10:26:35 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 14:26:35 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561645595.57.0.386270359271.issue36889@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Thu Jun 27 10:46:11 2019
From: report at bugs.python.org (Jeroen Demeyer)
Date: Thu, 27 Jun 2019 14:46:11 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561646771.02.0.789663606811.issue33926@roundup.psfhosted.org>


Jeroen Demeyer <J.Demeyer at UGent.be> added the comment:

Feel free to close...

----------
nosy: +jdemeyer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 10:47:57 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 14:47:57 +0000
Subject: [issue33926] test_gdb is skipped in builds since gdb is not installed
 as part of build script
In-Reply-To: <1529577339.32.0.56676864532.issue33926@psf.upfronthosting.co.za>
Message-ID: <1561646877.61.0.500376312099.issue33926@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> Feel free to close...

What about 2.7 and 3.7 branches?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33926>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:11:25 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 27 Jun 2019 15:11:25 +0000
Subject: [issue37427] sorted() and list.sort() don't accept non-boolean
 objects with __bool__() as `reverse` parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561648285.48.0.383755523729.issue37427@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

See issue15999.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:14:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 15:14:59 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561648499.17.0.349404948465.issue37412@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14240
pull_request: https://github.com/python/cpython/pull/14424

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:18:19 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 15:18:19 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561648699.05.0.029998643314.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> This update breaks long-path support in Windows.

Oops.

This is the risk of not testing a feature :-) My PR added very basic tests for getcwd() and getcwdb(). I wrote PR 14424 to not only fix the integer overflow check, but also to add a new unit tests for "long path".

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:29:16 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 15:29:16 +0000
Subject: [issue37425] Using Pyinstaller with (Anaconda) Python 3.7.3 needs
 PyQt5 even if not imported in code
In-Reply-To: <1561620384.94.0.687116956372.issue37425@roundup.psfhosted.org>
Message-ID: <1561649356.46.0.244563024399.issue37425@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

This looks like because you have Qt installed in one environment and not the other, so when matplotlib imports it pyinstaller decides to include it.

You'll have to report this to pyinstaller. It's nothing to do with core Python.

----------
resolution:  -> third party
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37425>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:39:32 2019
From: report at bugs.python.org (bob gailer)
Date: Thu, 27 Jun 2019 15:39:32 +0000
Subject: [issue37430] range is not a built-in function
Message-ID: <1561649972.91.0.461406342746.issue37430@roundup.psfhosted.org>


New submission from bob gailer <bgailer at gmail.com>:

In section 8.3 The for statement there is a reference to range as a built-in function. That was true in python 2. Now range is a built-in type.

----------
assignee: docs at python
components: Documentation
messages: 346745
nosy: bgailer, docs at python
priority: normal
severity: normal
status: open
title: range is not a built-in function
type: behavior
versions: Python 3.5, Python 3.6, Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37430>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:48:41 2019
From: report at bugs.python.org (Eric Snow)
Date: Thu, 27 Jun 2019 15:48:41 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561650521.4.0.736967472172.issue37416@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

Note that in Python 3.7 we consolidated a bunch of the global runtime state.  The "main_thread" static in ceval.c moved to the internal struct _PyRuntimestate and in 3.7 it is accessible as _Runtime.ceval.pending.main_thread (but only if you build with Py_BUILD_CORE, which extensions shouldn't).  In 3.8 it was moved to the top of the struct as _PyRuntimeState.main_thread.  All that said, that thread ID is still not exposed directly in Python.

So perhaps it would make sense to add something like sys.get_main_thread_id, which Lib/threading.py could then use (rather than assuming the current (during import) thread is the main thread).

Unfortunately, this wouldn't help with anything earlier than 3.9.  Currently 3.8 is already in beta1, where we apply a feature freeze, so it's barely too late for 3.8.  I suppose you could ask for a special exception from the release manager, given the change would be relatively small, with real benefits, but don't expect it. :)

----------
nosy: +brett.cannon, eric.snow
versions: +Python 3.8, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:49:05 2019
From: report at bugs.python.org (Eric Snow)
Date: Thu, 27 Jun 2019 15:49:05 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561650545.66.0.643268729099.issue37416@roundup.psfhosted.org>


Eric Snow <ericsnowcurrently at gmail.com> added the comment:

FWIW, this might also have implications for thread shutdown during runtime/interpreter finalization.

----------
nosy: +vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:49:06 2019
From: report at bugs.python.org (Riccardo Schirone)
Date: Thu, 27 Jun 2019 15:49:06 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1561650546.59.0.647507917451.issue35121@roundup.psfhosted.org>


Riccardo Schirone <rschiron at redhat.com> added the comment:

Did anybody request a CVE for this issue? I think it deserves one as it is a security issue and it may leak cookies to wrong domains. Does anybody have anything against assigning a CVE to this issue? If not, I would try to get one from MITRE.

----------
nosy: +rschiron

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:55:29 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 15:55:29 +0000
Subject: [issue35121] Cookie domain check returns incorrect results
In-Reply-To: <1540968768.96.0.788709270274.issue35121@psf.upfronthosting.co.za>
Message-ID: <1561650929.81.0.391915760974.issue35121@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

I also reported it to security at python.org . Please check with them too to see if there is a CVE request already made. Thanks.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35121>
_______________________________________

From report at bugs.python.org  Thu Jun 27 11:58:12 2019
From: report at bugs.python.org (Pavel Minaev)
Date: Thu, 27 Jun 2019 15:58:12 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561651092.04.0.00557220081483.issue37416@roundup.psfhosted.org>


Pavel Minaev <me at int19h.org> added the comment:

Debuggers will have to work around this in past Python versions that they support (which still includes Python 2 for pretty much all of them), so this is solely about resolving the inconsistency for the future. No point rushing it for 3.8 specifically.

(The most likely immediate workaround will be that, instead of invoking PyEval_InitThreads on the main thread via Py_AddPendingCall, we will simply use the same facility to exec "import threading" on the main thread.)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:11:13 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Thu, 27 Jun 2019 16:11:13 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561651873.98.0.118578796564.issue37420@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 45a30af109f69a81576b87ea775863ba12d55316 by Benjamin Peterson (Brandt Bucher) in branch 'master':
closes bpo-37420: Handle errors during iteration in os.sched_setaffinity. (GH-14414)
https://github.com/python/cpython/commit/45a30af109f69a81576b87ea775863ba12d55316


----------
nosy: +benjamin.peterson
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:11:22 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 16:11:22 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561651882.45.0.150665976607.issue37420@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14241
pull_request: https://github.com/python/cpython/pull/14425

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:11:42 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 16:11:42 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561651902.71.0.701541082471.issue37420@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14242
pull_request: https://github.com/python/cpython/pull/14426

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:18:24 2019
From: report at bugs.python.org (Sameer Bobade)
Date: Thu, 27 Jun 2019 16:18:24 +0000
Subject: [issue37425] Using Pyinstaller with (Anaconda) Python 3.7.3 needs
 PyQt5 even if not imported in code
In-Reply-To: <1561620384.94.0.687116956372.issue37425@roundup.psfhosted.org>
Message-ID: <1561652304.84.0.575162154742.issue37425@roundup.psfhosted.org>


Sameer Bobade <skbobade at gmail.com> added the comment:

PyQt5 was installed when trying to make exe with Python 3.7.3 because without it pyinstaller will fail to produce output.

Added log without PyQt5 & Python 3.7.3 which fails to produce output.
Maybe this is issue of Matplotlib then? Not sure if versions are changed between the distribution.

----------
status: closed -> open
Added file: https://bugs.python.org/file48442/withpy3.7.3 -without PyQt5.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37425>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:19:19 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Thu, 27 Jun 2019 16:19:19 +0000
Subject: [issue37430] range is not a built-in function
In-Reply-To: <1561649972.91.0.461406342746.issue37430@roundup.psfhosted.org>
Message-ID: <1561652359.92.0.988981448701.issue37430@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

I presume you are referring to 8.3 of the language reference
https://docs.python.org/3/reference/compound_stmts.html#the-for-statement
which has "the built-in function range()".  Types/classes *are* functions, which is why dist, list, range, etc are listed in "Built-in Functions" in the library reference.  But I agree that the more specific term should be used.

To me, the more severe problem is with the complete sentence.

"Hint: the built-in function range() returns an iterator of integers suitable to emulate the effect of Pascal?s for i := a to b do; e.g., list(range(3)) returns the list [0, 1, 2]."

The now obsolete definition of Python in terms of the now obscure Pascal should be deleted here and anywhere else such remains.  I think the whole sentence should just be deleted.  The whole paragraph and example could otherwise be improved.

----------
nosy: +terry.reedy
versions: +Python 3.9 -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37430>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:30:53 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 16:30:53 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561653053.2.0.26196514735.issue37420@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 65e187239a6feb09840ed9c2ebee51ed151e690d by Miss Islington (bot) in branch '3.7':
closes bpo-37420: Handle errors during iteration in os.sched_setaffinity. (GH-14414)
https://github.com/python/cpython/commit/65e187239a6feb09840ed9c2ebee51ed151e690d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:32:09 2019
From: report at bugs.python.org (Jim Li)
Date: Thu, 27 Jun 2019 16:32:09 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561653129.68.0.539305158022.issue37422@roundup.psfhosted.org>


Jim Li <jimli at bcgsc.ca> added the comment:

Hi Eric,

Sorry for the late reply. I think I did not accurately describe the issue at all. As a minimal example, set up two virtual environments, one from 2.7.x, one from 3.7.2.

When you are in the virtual environment, do
- pip install protobuf==3.3.0
- python (to go into compiler)
- import google
- print(type(google.__path__))

The 2.7.x would tell you it's a <type 'list'>
The 3.7.2 would tell you it's a <class'_frozen_importlib_external._NamespacePath'>

Since it's not a list, some behaviours are gone, e.g., insert. I'm not trying to manipulate protobuf package's __path__, but trying to upgrade a legacy codebase, the legacy codebase does something like:

module.insert(0, 'some/path'), which breaks under python3, because it's not a list anymore, but a <class'_frozen_importlib_external._NamespacePath'>.


I believe the problem comes from the 'top level entry point'. For example, when you have 2 separate packages but they were organized under the same namespace.

E.g., in their setup.py

Package A:

    packages=[
        "orange",
        "orange.schemas",
    ],
    namespace_packages=["orange"]

Package B:
    packages=[
        "orange",
        "orange.server",
    ],
    namespace_packages=["orange"]

The problem comes from when you try to do `import orange`, and do operations with orange.__path__ here. In Python 2.7, it's a list; in Python 3.7, it's a <class '_frozen_importlib_external._NamespacePath'>

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:32:33 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 16:32:33 +0000
Subject: [issue37425] Using Pyinstaller with (Anaconda) Python 3.7.3 needs
 PyQt5 even if not imported in code
In-Reply-To: <1561620384.94.0.687116956372.issue37425@roundup.psfhosted.org>
Message-ID: <1561653153.85.0.999019138061.issue37425@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

In any case, it's definitely pyinstaller and not CPython. Please report it on their issue tracker.

----------
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37425>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:45:35 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 16:45:35 +0000
Subject: [issue37420] os.sched_setaffinity does not handle errors during
 iteration.
In-Reply-To: <1561587746.71.0.976232092459.issue37420@roundup.psfhosted.org>
Message-ID: <1561653935.16.0.454055422245.issue37420@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6fbed5350c786ab88868925d67f59e19d0ab841c by Miss Islington (bot) in branch '3.8':
closes bpo-37420: Handle errors during iteration in os.sched_setaffinity. (GH-14414)
https://github.com/python/cpython/commit/6fbed5350c786ab88868925d67f59e19d0ab841c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37420>
_______________________________________

From report at bugs.python.org  Thu Jun 27 12:52:59 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 16:52:59 +0000
Subject: [issue37431] test_asyncio: test_start_tls_server_1() failed on ARMv7
 Debian buster 3.7
Message-ID: <1561654379.48.0.149014452571.issue37431@roundup.psfhosted.org>


New submission from STINNER Victor <vstinner at redhat.com>:

The test failed but then passed when run again.

See also bpo-35998 "test_asyncio: test_start_tls_server_1() TimeoutError on Fedora 29" and bpo-35031 "test_asyncio test_start_tls_server_1 fails in AMD64 FreeBSD CURRENT buildbots"

https://buildbot.python.org/all/#/builders/177/builds/241
== Tests result: FAILURE then SUCCESS ==

1 re-run test:
    test_asyncio


======================================================================
ERROR: test_start_tls_server_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/test_sslproto.py", line 583, in test_start_tls_server_1
    self.loop.run_until_complete(run_main())
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/asyncio/base_events.py", line 577, in run_until_complete
    raise RuntimeError('Event loop stopped before Future completed.')
RuntimeError: Event loop stopped before Future completed.



test_start_tls_server_1 (test.test_asyncio.test_sslproto.ProactorStartTLSTests) ... skipped 'Windows only'
test_start_tls_slow_client_cancel (test.test_asyncio.test_sslproto.ProactorStartTLSTests) ... skipped 'Windows only'
test_start_tls_wrong_args (test.test_asyncio.test_sslproto.ProactorStartTLSTests) ... skipped 'Windows only'
test_buf_feed_data (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_create_connection_memory_leak (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_create_connection_ssl_failed_certificate (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_create_connection_ssl_slow_handshake (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_handshake_timeout (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_start_tls_client_buf_proto_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_start_tls_client_corrupted_ssl (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_start_tls_client_reg_proto_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_start_tls_server_1 (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... Exception in thread test-client:
Traceback (most recent call last):
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/functional.py", line 198, in run
    self._prog(TestSocketWrapper(self._sock))
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/test_sslproto.py", line 573, in <lambda>
    with self.tcp_client(lambda sock: client(sock, addr),
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/test_sslproto.py", line 518, in client
    answer = sock.recv_all(len(ANSWER))
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/functional.py", line 138, in recv_all
    data = self.recv(n - len(buf))
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/ssl.py", line 1045, in recv
    return self.read(buflen)
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/ssl.py", line 920, in read
    return self._sslobj.read(len)
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2488)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/functional.py", line 200, in run
    self._test._abort_socket_test(ex)
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/functional.py", line 122, in _abort_socket_test
    self.fail(ex)
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/unittest/case.py", line 693, in fail
    raise self.failureException(msg)
AssertionError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:2488)

ERROR
test_start_tls_slow_client_cancel (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... /ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/threading.py:960: ResourceWarning: unclosed <ssl.SSLSocket fd=7, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 58522), raddr=('127.0.0.1', 33379)>
  del exc_type, exc_value, exc_tb
ResourceWarning: Enable tracemalloc to get the object allocation traceback
ok
test_start_tls_wrong_args (test.test_asyncio.test_sslproto.SelectorStartTLSTests) ... ok
test_close_during_handshake (test.test_asyncio.test_sslproto.SslProtoHandshakeTests) ... /ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/unittest/mock.py:953: ResourceWarning: unclosed <socket.socket fd=6, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 33379)>
  self.side_effect = side_effect
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Unhandled error in exception handler
context: {'message': 'Task was destroyed but it is pending!', 'task': <Task pending coro=<BaseStartTLS.test_start_tls_server_1.<locals>.main() done, defined at /ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/test_sslproto.py:547> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0xb4b5cab8>()]> cb=[_release_waiter(<Future pendi...xb4b29188>()]>)() at /ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/asyncio/tasks.py:392]>}
Traceback (most recent call last):
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/asyncio/base_events.py", line 1639, in call_exception_handler
    self._exception_handler(self, context)
  File "/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/test/test_asyncio/functional.py", line 22, in loop_exception_handler
    self.loop.default_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'default_exception_handler'
/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/unittest/mock.py:953: ResourceWarning: unclosed <socket.socket fd=8, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('127.0.0.1', 33379)>
  self.side_effect = side_effect
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/asyncio/selector_events.py:658: ResourceWarning: unclosed transport <_SelectorSocketTransport closing fd=8>
  source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
/ssd/buildbot/buildarea/3.7.gps-ubuntu-exynos5-armv7l/build/Lib/asyncio/sslproto.py:322: ResourceWarning: unclosed transport <asyncio.sslproto._SSLProtocolTransport object at 0xb4b5cee0>
  source=self)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
ok

----------
components: asyncio
messages: 346758
nosy: asvetlov, vstinner, yselivanov
priority: normal
severity: normal
status: open
title: test_asyncio: test_start_tls_server_1() failed on ARMv7 Debian buster 3.7
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37431>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:04:31 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Thu, 27 Jun 2019 17:04:31 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561655071.14.0.240901166994.issue37422@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:05:40 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 27 Jun 2019 17:05:40 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561655140.89.0.215077145343.issue30345@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset 21cfae107e410bf4b0ab3c142ca4449bc33290f5 by Inada Naoki in branch 'master':
bpo-30345: travis: use -Og with --with-pydebug (GH-14423)
https://github.com/python/cpython/commit/21cfae107e410bf4b0ab3c142ca4449bc33290f5


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:05:59 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 17:05:59 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561655159.0.0.0874887599576.issue30345@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14243
pull_request: https://github.com/python/cpython/pull/14427

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:07:14 2019
From: report at bugs.python.org (Inada Naoki)
Date: Thu, 27 Jun 2019 17:07:14 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561655234.0.0.677476246413.issue30345@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:

I think test_gdb is useful for 3.8 branch because some PEP 590 relating changes will be backported to it.
But I don't know how test_gdb is useful for older branches.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:08:46 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 17:08:46 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561655326.56.0.712945465742.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

So I have a fix for 3.9 for this, I believe (involves making sys.base_executable configurable via PyConfig and overriding it and config->home when we know we're inside an app container).

For 3.8 I can apply the same fix and make sys.base_executable public, or keep it as sys._base_executable. Either way, it'll show up in PyConfig. (Victor - thoughts here? Should be a non-breaking change, right?)

For 3.7, I'm going to have to come up with a different fix, and possibly expose some new private API to be able to pass through the correct executable path.


Fundamentally, the problem is that Windows is going to start enforcing some ACLs that were previously not being enforced. In theory, when an application is deployed in an app package (as required through the Store), you are not supposed to be able to launch the executable directly. Instead, you should go through your current user's apps directory (C:\Users\name\AppData\Local\Microsoft\WindowsApps\<package family>, which contains only symlinks to the actual executables).

This has a very good advantage that the package family name does not change with new versions, while the full install path does. Currently, a behind-the-scenes update of Python will actually break environments when their "home" path is no longer correct.

However, it does mean that we need to start reporting a sys.executable that is not inside sys.prefix, and I'm not sure whether that is a good idea.

Looking at venv (+Vinay for confirmation here), it seems to treat "home" as "the directory containing the original Python binary" rather than "the directory containing the Python install". So in theory (and in my simple testing), using the sys.executable-not-in-prefix here is fine. But is that intentional?

----------
nosy: +vinay.sajip, vstinner
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:10:24 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 17:10:24 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561655424.61.0.00932147778611.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
keywords: +patch
pull_requests: +14244
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14428

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:24:09 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 17:24:09 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561656249.09.0.0838683888741.issue30345@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 60f24b23bf6ac485d195bb904635bdc3fe646b07 by Miss Islington (bot) in branch '3.8':
bpo-30345: travis: use -Og with --with-pydebug (GH-14423)
https://github.com/python/cpython/commit/60f24b23bf6ac485d195bb904635bdc3fe646b07


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:48:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 17:48:04 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561657684.08.0.131651162465.issue37390@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 44f91c388a6f4da9ed3300df32ca290b8aa104ea by Steve Dower in branch 'master':
bpo-37390: Add audit event table to documentations (GH-14406)
https://github.com/python/cpython/commit/44f91c388a6f4da9ed3300df32ca290b8aa104ea


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Thu Jun 27 13:48:15 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 17:48:15 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561657695.76.0.073004452111.issue37390@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14245
pull_request: https://github.com/python/cpython/pull/14429

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:01:45 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 27 Jun 2019 18:01:45 +0000
Subject: [issue37432] Fix a small param type allocation.rst
Message-ID: <1561658505.31.0.8053222581.issue37432@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
assignee: docs at python
components: Documentation
nosy: docs at python, shihai1991
priority: normal
severity: normal
status: open
title: Fix a small param type allocation.rst
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:03:06 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 27 Jun 2019 18:03:06 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
Message-ID: <1561658586.01.0.048454435171.issue37432@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
title: Fix a small param type allocation.rst -> Fix a small param type in allocation.rst

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:04:17 2019
From: report at bugs.python.org (SilentGhost)
Date: Thu, 27 Jun 2019 18:04:17 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
Message-ID: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>


New submission from SilentGhost <ghost.adh at runbox.com>:

Could you please elaborate on what exactly needs fixing?

----------
nosy: +SilentGhost

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:05:06 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 27 Jun 2019 18:05:06 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561658706.02.0.95805015635.issue37432@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +14246
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14430

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:07:12 2019
From: report at bugs.python.org (hai shi)
Date: Thu, 27 Jun 2019 18:07:12 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561658832.47.0.864721385463.issue37432@roundup.psfhosted.org>


hai shi <shihai1991 at 126.com> added the comment:

Due to https://github.com/python/cpython/blob/master/Include/objimpl.h#L102,
`void PyObject_Del(PyObject *op)` should be `void PyObject_Del(void *op)`

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:07:20 2019
From: report at bugs.python.org (miss-islington)
Date: Thu, 27 Jun 2019 18:07:20 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561658840.52.0.861696868234.issue37390@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4fee28aa42dbac7f08a6d2829546b7d8e848034d by Miss Islington (bot) in branch '3.8':
bpo-37390: Add audit event table to documentations (GH-14406)
https://github.com/python/cpython/commit/4fee28aa42dbac7f08a6d2829546b7d8e848034d


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:10:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Thu, 27 Jun 2019 18:10:20 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561659020.66.0.495915874883.issue37390@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:22:41 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 27 Jun 2019 18:22:41 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
Message-ID: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>


New submission from Anthony Sottile <asottile at umich.edu>:

For instance this file:

foo = f"""{}
foo"""

$ python3.8 --version --version
Python 3.8.0b1 (default, Jun  6 2019, 03:44:52) 
[GCC 7.4.0]

$ python3.8 t.py | wc -c
  File "t.py", line 1


<<snipped, but very very many spaces>>

                                   ^
SyntaxError: f-string: empty expression not allowed


$ python3.8 t.py |& wc -c
49134

----------
components: Interpreter Core
messages: 346767
nosy: Anthony Sottile
priority: normal
severity: normal
status: open
title: syntax error in f-string in multiline string produces ~40k spaces of output
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:30:57 2019
From: report at bugs.python.org (Tim Lusk)
Date: Thu, 27 Jun 2019 18:30:57 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
Message-ID: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>


New submission from Tim Lusk <tlusk at carbonblack.com>:

I'm working on porting an application from Python 3.6.8 to 3.7.3 and am running into this segfault.
I'm not able to pin point exactly what Python code is causing this as it's a very large enterprise application
and I can't seem to pinpoint exactly where this is coming from.

The application consistently crashes on start every time with this stack trace.

Program received signal SIGSEGV, Segmentation fault.
0x00007ffff7922ae5 in type_dealloc (type=0x7fffed185480) at /usr/src/debug/Python-3.7.3/Objects/typeobject.c:3283
3283	    _PyObject_GC_UNTRACK(type);
(gdb) bt
#0  0x00007ffff7922ae5 in type_dealloc (type=0x7fffed185480) at /usr/src/debug/Python-3.7.3/Objects/typeobject.c:3283
#1  0x00007ffff78ee721 in free_keys_object (keys=0x7fffee258bc0) at /usr/src/debug/Python-3.7.3/Objects/dictobject.c:559
#2  0x00007ffff78f20af in dict_dealloc (mp=0x7fffee209c60) at /usr/src/debug/Python-3.7.3/Objects/dictobject.c:1913
#3  0x00007ffff7904d15 in module_clear (m=0x7fffee211048) at /usr/src/debug/Python-3.7.3/Objects/moduleobject.c:749
#4  0x00007ffff7a3aeda in delete_garbage (collectable=0x7fffffff7420, old=0x7ffff7dd75f0 <_PyRuntime+400>) at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:769
#5  0x00007ffff7a3b41d in collect (generation=2, n_collected=0x7fffffff7488, n_uncollectable=0x7fffffff7490, nofail=0)
    at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:924
#6  0x00007ffff7a3b845 in collect_with_callback (generation=2) at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:1036
#7  0x00007ffff7a3bcef in gc_collect_impl (module=0x7ffff615d9f8, generation=2) at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:1138
#8  0x00007ffff7a3ba13 in gc_collect (module=0x7ffff615d9f8, args=0xcc6cd0, nargs=0, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Modules/clinic/gcmodule.c.h:100
#9  0x00007ffff78b48e5 in _PyMethodDef_RawFastCallKeywords (method=0x7ffff7d8b800 <GcMethods+256>, self=0x7ffff615d9f8, args=0xcc6cd0, nargs=0, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:656
#10 0x00007ffff78b4bab in _PyCFunction_FastCallKeywords (func=0x7ffff615ecf0, args=0xcc6cd0, nargs=0, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:730
#11 0x00007ffff79cbf2c in call_function (pp_stack=0x7fffffff78b8, oparg=0, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:4568
#12 0x00007ffff79c6344 in _PyEval_EvalFrameDefault (f=0xcc6b08, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3093
#13 0x00007ffff79b8067 in PyEval_EvalFrameEx (f=0xcc6b08, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:547
#14 0x00007ffff78b3b1a in function_code_fastcall (co=0x7ffff620bc00, args=0x7ffff64fef90, nargs=1, globals=0x7ffff64e6120)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:283
#15 0x00007ffff78b4096 in _PyFunction_FastCallKeywords (func=0x7fffedb63488, stack=0x7ffff64fef88, nargs=1, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:408
#16 0x00007ffff79cc357 in call_function (pp_stack=0x7fffffff9140, oparg=1, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:4616
#17 0x00007ffff79c64c9 in _PyEval_EvalFrameDefault (f=0x7ffff64fee08, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3124
#18 0x00007ffff79b8067 in PyEval_EvalFrameEx (f=0x7ffff64fee08, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:547
#19 0x00007ffff79ca14f in _PyEval_EvalCodeWithName (_co=0x7ffff620bc90, globals=0x7ffff64e6120, locals=0x7ffff64e6120, args=0x0, argcount=0, kwnames=0x0, 
    kwargs=0x0, kwcount=0, kwstep=2, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0, name=0x0, qualname=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3930
#20 0x00007ffff79ca347 in PyEval_EvalCodeEx (_co=0x7ffff620bc90, globals=0x7ffff64e6120, locals=0x7ffff64e6120, args=0x0, argcount=0, kws=0x0, kwcount=0, 
    defs=0x0, defcount=0, kwdefs=0x0, closure=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3959
#21 0x00007ffff79b7ff1 in PyEval_EvalCode (co=0x7ffff620bc90, globals=0x7ffff64e6120, locals=0x7ffff64e6120) at /usr/src/debug/Python-3.7.3/Python/ceval.c:524
#22 0x00007ffff79b2963 in builtin_exec_impl (module=0x7ffff7e61c28, source=0x7ffff620bc90, globals=0x7ffff64e6120, locals=0x7ffff64e6120)
    at /usr/src/debug/Python-3.7.3/Python/bltinmodule.c:1079
#23 0x00007ffff79aff3b in builtin_exec (module=0x7ffff7e61c28, args=0x6c5b58, nargs=2) at /usr/src/debug/Python-3.7.3/Python/clinic/bltinmodule.c.h:283
#24 0x00007ffff78b48bd in _PyMethodDef_RawFastCallKeywords (method=0x7ffff7d7bae0 <builtin_methods+480>, self=0x7ffff7e61c28, args=0x6c5b58, nargs=2, 
    kwnames=0x0) at /usr/src/debug/Python-3.7.3/Objects/call.c:651
#25 0x00007ffff78b4bab in _PyCFunction_FastCallKeywords (func=0x7ffff6566d80, args=0x6c5b58, nargs=2, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:730
#26 0x00007ffff79cbf2c in call_function (pp_stack=0x7fffffffada0, oparg=2, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:4568
#27 0x00007ffff79c64c9 in _PyEval_EvalFrameDefault (f=0x6c5998, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3124
#28 0x00007ffff79b8067 in PyEval_EvalFrameEx (f=0x6c5998, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:547
#29 0x00007ffff79ca14f in _PyEval_EvalCodeWithName (_co=0x7ffff648d930, globals=0x7ffff651b360, locals=0x0, args=0x67c820, argcount=5, kwnames=0x0, 
    kwargs=0x67c848, kwcount=0, kwstep=1, defs=0x7ffff6487a58, defcount=5, kwdefs=0x0, closure=0x0, name=0x7ffff61fa230, qualname=0x7ffff61fa230)
    at /usr/src/debug/Python-3.7.3/Python/ceval.c:3930
#30 0x00007ffff78b41c1 in _PyFunction_FastCallKeywords (func=0x7ffff61e89d8, stack=0x67c820, nargs=5, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:433
#31 0x00007ffff79cc357 in call_function (pp_stack=0x7fffffffc830, oparg=5, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:4616
#32 0x00007ffff79c64c9 in _PyEval_EvalFrameDefault (f=0x67c678, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3124
#33 0x00007ffff79b8067 in PyEval_EvalFrameEx (f=0x67c678, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:547
--Type <RET> for more, q to quit, c to continue without paging--
#34 0x00007ffff79ca14f in _PyEval_EvalCodeWithName (_co=0x7ffff6485270, globals=0x7ffff651b360, locals=0x0, args=0x7ffff6462620, argcount=2, kwnames=0x0, 
    kwargs=0x0, kwcount=0, kwstep=2, defs=0x7ffff64db4c0, defcount=1, kwdefs=0x0, closure=0x0, name=0x7ffff64a0150, qualname=0x7ffff64a0150)
    at /usr/src/debug/Python-3.7.3/Python/ceval.c:3930
#35 0x00007ffff78b3f8b in _PyFunction_FastCallDict (func=0x7ffff6218730, args=0x7ffff6462620, nargs=2, kwargs=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:376
#36 0x00007ffff78b38af in PyObject_Call (callable=0x7ffff6218730, args=0x7ffff6462608, kwargs=0x0) at /usr/src/debug/Python-3.7.3/Objects/call.c:226
#37 0x00007ffff7a3195e in pymain_run_module (modname=0x603490 L"cb.enterprise.main", set_argv0=1) at /usr/src/debug/Python-3.7.3/Modules/main.c:320
#38 0x00007ffff7a399ab in pymain_run_python (pymain=0x7fffffffe1d0) at /usr/src/debug/Python-3.7.3/Modules/main.c:2874
#39 0x00007ffff7a39ee2 in pymain_main (pymain=0x7fffffffe1d0) at /usr/src/debug/Python-3.7.3/Modules/main.c:3038
#40 0x00007ffff7a39f9b in _Py_UnixMain (argc=5, argv=0x7fffffffe318) at /usr/src/debug/Python-3.7.3/Modules/main.c:3073
#41 0x00007ffff67c6d20 in __libc_start_main () from /lib64/libc.so.6
#42 0x0000000000400691 in _start ()

----------
messages: 346768
nosy: Tim Lusk
priority: normal
severity: normal
status: open
title: Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
type: crash
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Thu Jun 27 14:56:13 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 27 Jun 2019 18:56:13 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561661773.4.0.0226604918277.issue37433@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +eric.smith

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 15:15:08 2019
From: report at bugs.python.org (Tim Lusk)
Date: Thu, 27 Jun 2019 19:15:08 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561662908.45.0.299722199579.issue37434@roundup.psfhosted.org>


Tim Lusk <tlusk at carbonblack.com> added the comment:

Alright I was finally able to reproduce the issue with a small code snip and capture the stack in gdb.  It looks like the issue has something to do with an exception thrown while importing a class (and possibly only when the class is a c_ext, but I haven't confirmed that)

[root at 933fdf38d838 ~]# python3.7 -m venv crash-test
[root at 933fdf38d838 ~]# crash-test/bin/pip install protobuf
Looking in indexes: https://files.pythonhosted.org/simple
Collecting protobuf
  Downloading https://files.pythonhosted.org/packages/ce/86/9f6123c4c6f481862f286dbe13aa2e97bdedd7662f5fc3033c1a41f32f88/protobuf-3.8.0-cp37-cp37m-manylinux1_x86_64.whl (1.2MB)
    100% |????????????????????????????????| 1.2MB 2.3MB/s 
Collecting six>=1.9 (from protobuf)
  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./crash-test/lib/python3.7/site-packages (from protobuf) (40.8.0)
Installing collected packages: six, protobuf
Successfully installed protobuf-3.8.0 six-1.12.0
[root at 933fdf38d838 ~]# scl enable devtoolset-8 "gdb ./crash-test/bin/python"
GNU gdb (GDB) Red Hat Enterprise Linux 8.2-2.el6
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from ./crash-test/bin/python...Reading symbols from /usr/lib/debug/usr/bin/python3.7m.debug...
warning: Skipping deprecated .gdb_index section in /usr/lib/debug/usr/bin/python3.7m.debug.
Do "set use-deprecated-index-sections on" before the file is read
to use the section anyway.
done.
done.
(gdb) run
Starting program: /root/crash-test/bin/python 
Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.212.el6.x86_64
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Python 3.7.3 (default, Jun 27 2019, 15:27:42) 
[GCC 8.2.1 20180905 (Red Hat 8.2.1-3)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import warnings
>>> import gc
>>> 
>>> gc.disable()
>>> 
>>> for i in range(100):
...     warnings.filterwarnings('error')
...     try:
...         from google.protobuf.pyext import _message
...     except Exception as ex:
...         print(i)
...     
...     gc.collect()
... 
0
1
2
3
4
5

Program received signal SIGSEGV, Segmentation fault.
0x00007ffff7922ae5 in type_dealloc (type=0x7ffff2277480) at /usr/src/debug/Python-3.7.3/Objects/typeobject.c:3283
3283	    _PyObject_GC_UNTRACK(type);
Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 expat-2.0.1-13.el6_8.x86_64 libgcc-4.4.7-23.el6.x86_64 libstdc++-4.4.7-23.el6.x86_64 ncurses-libs-5.7-4.20090207.el6.x86_64 nss-softokn-freebl-3.14.3-23.3.el6_8.x86_64 openresty-openssl-1.0.2s-1.el6.x86_64 readline-6.0-4.el6.x86_64 xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 zlib-1.2.3-29.el6.x86_64
(gdb) bt
#0  0x00007ffff7922ae5 in type_dealloc (type=0x7ffff2277480) at /usr/src/debug/Python-3.7.3/Objects/typeobject.c:3283
#1  0x00007ffff78ee721 in free_keys_object (keys=0x7ffff64e3bc0) at /usr/src/debug/Python-3.7.3/Objects/dictobject.c:559
#2  0x00007ffff78f20af in dict_dealloc (mp=0x7ffff47a1708) at /usr/src/debug/Python-3.7.3/Objects/dictobject.c:1913
#3  0x00007ffff7904d15 in module_clear (m=0x7ffff22f3ea8) at /usr/src/debug/Python-3.7.3/Objects/moduleobject.c:749
#4  0x00007ffff7a3aeda in delete_garbage (collectable=0x7fffffffc250, old=0x7ffff7dd75f0 <_PyRuntime+400>)
    at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:769
#5  0x00007ffff7a3b41d in collect (generation=2, n_collected=0x7fffffffc2b8, n_uncollectable=0x7fffffffc2c0, nofail=0)
    at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:924
#6  0x00007ffff7a3b845 in collect_with_callback (generation=2) at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:1036
#7  0x00007ffff7a3bcef in gc_collect_impl (module=0x7ffff61f6138, generation=2)
    at /usr/src/debug/Python-3.7.3/Modules/gcmodule.c:1138
#8  0x00007ffff7a3ba13 in gc_collect (module=0x7ffff61f6138, args=0x7ffff64e7768, nargs=0, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Modules/clinic/gcmodule.c.h:100
#9  0x00007ffff78b48e5 in _PyMethodDef_RawFastCallKeywords (method=0x7ffff7d8b800 <GcMethods+256>, self=0x7ffff61f6138, 
    args=0x7ffff64e7768, nargs=0, kwnames=0x0) at /usr/src/debug/Python-3.7.3/Objects/call.c:656
#10 0x00007ffff78b4bab in _PyCFunction_FastCallKeywords (func=0x7ffff61f8438, args=0x7ffff64e7768, nargs=0, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Objects/call.c:730
#11 0x00007ffff79cbf2c in call_function (pp_stack=0x7fffffffc6e8, oparg=0, kwnames=0x0)
    at /usr/src/debug/Python-3.7.3/Python/ceval.c:4568
#12 0x00007ffff79c6344 in _PyEval_EvalFrameDefault (f=0x7ffff64e75e8, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3093
#13 0x00007ffff79b8067 in PyEval_EvalFrameEx (f=0x7ffff64e75e8, throwflag=0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:547
#14 0x00007ffff79ca14f in _PyEval_EvalCodeWithName (_co=0x7ffff6484810, globals=0x7ffff64e6120, locals=0x7ffff64e6120, args=0x0, 
    argcount=0, kwnames=0x0, kwargs=0x0, kwcount=0, kwstep=2, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0, name=0x0, qualname=0x0)
    at /usr/src/debug/Python-3.7.3/Python/ceval.c:3930
#15 0x00007ffff79ca347 in PyEval_EvalCodeEx (_co=0x7ffff6484810, globals=0x7ffff64e6120, locals=0x7ffff64e6120, args=0x0, 
    argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0, kwdefs=0x0, closure=0x0) at /usr/src/debug/Python-3.7.3/Python/ceval.c:3959
#16 0x00007ffff79b7ff1 in PyEval_EvalCode (co=0x7ffff6484810, globals=0x7ffff64e6120, locals=0x7ffff64e6120)
    at /usr/src/debug/Python-3.7.3/Python/ceval.c:524
#17 0x00007ffff7a0efcf in run_mod (mod=0x6b7790, filename=0x7ffff6514ae8, globals=0x7ffff64e6120, locals=0x7ffff64e6120, 
    flags=0x7fffffffe1dc, arena=0x7ffff7e692d0) at /usr/src/debug/Python-3.7.3/Python/pythonrun.c:1035
#18 0x00007ffff7a0ca53 in PyRun_InteractiveOneObjectEx (fp=0x7ffff6b36f60 <_IO_2_1_stdin_>, filename=0x7ffff6514ae8, 
    flags=0x7fffffffe1dc) at /usr/src/debug/Python-3.7.3/Python/pythonrun.c:256
#19 0x00007ffff7a0c42e in PyRun_InteractiveLoopFlags (fp=0x7ffff6b36f60 <_IO_2_1_stdin_>, filename_str=0x7ffff7ada976 "<stdin>", 
    flags=0x7fffffffe1dc) at /usr/src/debug/Python-3.7.3/Python/pythonrun.c:120
#20 0x00007ffff7a0c27e in PyRun_AnyFileExFlags (fp=0x7ffff6b36f60 <_IO_2_1_stdin_>, filename=0x7ffff7ada976 "<stdin>", closeit=0, 
    flags=0x7fffffffe1dc) at /usr/src/debug/Python-3.7.3/Python/pythonrun.c:78
#21 0x00007ffff7a31e5e in pymain_run_file (fp=0x7ffff6b36f60 <_IO_2_1_stdin_>, filename=0x0, p_cf=0x7fffffffe1dc)
    at /usr/src/debug/Python-3.7.3/Modules/main.c:427
#22 0x00007ffff7a34e51 in pymain_run_filename (pymain=0x7fffffffe230, cf=0x7fffffffe1dc)
    at /usr/src/debug/Python-3.7.3/Modules/main.c:1627
#23 0x00007ffff7a399cf in pymain_run_python (pymain=0x7fffffffe230) at /usr/src/debug/Python-3.7.3/Modules/main.c:2877
#24 0x00007ffff7a39ee2 in pymain_main (pymain=0x7fffffffe230) at /usr/src/debug/Python-3.7.3/Modules/main.c:3038
#25 0x00007ffff7a39f9b in _Py_UnixMain (argc=1, argv=0x7fffffffe398) at /usr/src/debug/Python-3.7.3/Modules/main.c:3073
#26 0x0000000000400772 in main (argc=1, argv=0x7fffffffe398) at /usr/src/debug/Python-3.7.3/Programs/python.c:15
(gdb) p type->tp_name
$1 = 0x7ffff20034c0 "google.protobuf.pyext._message.MessageMeta"
(gdb) p type->tp_doc
$2 = 0x7ffff20034f0 "The metaclass of ProtocolMessages"
(gdb)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:07:10 2019
From: report at bugs.python.org (Timothy Lusk)
Date: Thu, 27 Jun 2019 20:07:10 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561666030.3.0.360571364395.issue37434@roundup.psfhosted.org>


Timothy Lusk <tlusk at carbonblack.com> added the comment:

I've realized this might not be Python 3.7 specific, the reason protobuf is throwing an exception during import in my above example (as well as in our application) is because it's throwing a deprecation warning that was only introduced in 3.7.  

Python 3.6 doesn't cause any warnings importing protobuf so it doesn't abort the import.  Might need a different test case to confirm what versions this does apply to.

I've made a change to our application's error handling in this area so we aren't having a segfault anymore, but this is still a bug in Python itself.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:10:23 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 27 Jun 2019 20:10:23 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561666223.11.0.724332626938.issue37433@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

I can also trigger this with:

```
1+ """\q
"""
```

And `python -Werror`

so it seems not necessarily related to fstrings

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:12:36 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 20:12:36 +0000
Subject: [issue37435] builtin map iterator should provide __length_hint__
Message-ID: <1561666356.12.0.770059184223.issue37435@roundup.psfhosted.org>


New submission from Nicholas Musolino <n.musolino at gmail.com>:

The builtin `map` function takes one or more user-supplied iterators, and returns an iterator.

When all the user-supplied iterator arguments to `map` provide a valid length hint (according to the PEP 424 length hint protocol), the iterator returned by `map` should provide a length hint.  

I suggest the following behavior:  when all the iterator arguments provide a valid length hint, the map iterator should return the minimum value among all length hint values, because it stops upon exhaustion of the shortest input iterator.

If any user-supplied iterator does *not* provide a length hint according to the PEP 424 protocol, the map iterator should return the `NotImplemented` singleton, in accordance with the protocol.

When the evaluation of `__length_hint__()` for a user-supplied iterator raises an exception, the exception should be propagated by the map iterator's `__length_hint__()` method.

----------
components: Interpreter Core
messages: 346772
nosy: nmusolino
priority: normal
severity: normal
status: open
title: builtin map iterator should provide __length_hint__
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37435>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:18:11 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 27 Jun 2019 20:18:11 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561666691.96.0.364826883744.issue37433@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

Debugging further, there's a token with a `multi_line_start` pointing at uninitialized memory -- let's see if I can't track down where that gets set and fix it :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:29:37 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:29:37 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561667377.41.0.165745325474.issue36511@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
pull_requests: +14247
pull_request: https://github.com/python/cpython/pull/14431

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:30:19 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 20:30:19 +0000
Subject: [issue37435] builtin map iterator should provide __length_hint__
In-Reply-To: <1561666356.12.0.770059184223.issue37435@roundup.psfhosted.org>
Message-ID: <1561667419.43.0.554495647991.issue37435@roundup.psfhosted.org>


Change by Nicholas Musolino <n.musolino at gmail.com>:


----------
keywords: +patch
pull_requests: +14248
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14432

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37435>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:31:51 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Thu, 27 Jun 2019 20:31:51 +0000
Subject: [issue37435] builtin map iterator should provide __length_hint__
In-Reply-To: <1561666356.12.0.770059184223.issue37435@roundup.psfhosted.org>
Message-ID: <1561667511.0.0.577083467696.issue37435@roundup.psfhosted.org>


Serhiy Storchaka <storchaka+cpython at gmail.com> added the comment:

This is a duplicate of issue26828.

----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37435>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:37:15 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:37:15 +0000
Subject: [issue37236] fix test_complex for Windows arm64
In-Reply-To: <1560273542.8.0.377927810639.issue37236@roundup.psfhosted.org>
Message-ID: <1561667835.68.0.108112016962.issue37236@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37236>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:37:43 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:37:43 +0000
Subject: [issue37201] fix test_distutils failures for Windows ARM64
In-Reply-To: <1559940477.37.0.824825377046.issue37201@roundup.psfhosted.org>
Message-ID: <1561667863.04.0.353318191716.issue37201@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37201>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:38:11 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:38:11 +0000
Subject: [issue36941] Windows build changes for Windows ARM64
In-Reply-To: <1558042492.97.0.749926608424.issue36941@roundup.psfhosted.org>
Message-ID: <1561667891.06.0.136001193161.issue36941@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36941>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:38:27 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:38:27 +0000
Subject: [issue36942] Windows code changes for Windows ARM64
In-Reply-To: <1558042626.28.0.817176769827.issue36942@roundup.psfhosted.org>
Message-ID: <1561667907.94.0.924631430421.issue36942@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36942>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:38:41 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:38:41 +0000
Subject: [issue36943] Windows test changes for Windows ARM64
In-Reply-To: <1558042991.15.0.439006116362.issue36943@roundup.psfhosted.org>
Message-ID: <1561667921.14.0.970279208724.issue36943@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36943>
_______________________________________

From report at bugs.python.org  Thu Jun 27 16:39:59 2019
From: report at bugs.python.org (Paul Monson)
Date: Thu, 27 Jun 2019 20:39:59 +0000
Subject: [issue36944] Add support for ARM64 to libffi
In-Reply-To: <1558043538.34.0.103396364975.issue36944@roundup.psfhosted.org>
Message-ID: <1561667999.02.0.0418282946547.issue36944@roundup.psfhosted.org>


Paul Monson <paulmons at gmail.com> added the comment:

submitted new PR to fix build and test issues for Windows ARM64 in Python

https://github.com/libffi/libffi/pull/496

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36944>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:08:04 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 21:08:04 +0000
Subject: [issue37435] builtin map iterator should provide __length_hint__
In-Reply-To: <1561666356.12.0.770059184223.issue37435@roundup.psfhosted.org>
Message-ID: <1561669684.21.0.315927500967.issue37435@roundup.psfhosted.org>


Nicholas Musolino <n.musolino at gmail.com> added the comment:

Thanks, Serihy.  I can close this issue.

I actually have been looking at this problem for some time, and created a patch, but don't what the "length transparency issues" that led to #26828 being closed.  

Do you think I should close this and comment on the original issue?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37435>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:14:48 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 21:14:48 +0000
Subject: [issue26828] Implement __length_hint__() on map() and filter() to
 optimize list(map) and list(filter)
In-Reply-To: <1461327160.24.0.621419084727.issue26828@psf.upfronthosting.co.za>
Message-ID: <1561670088.46.0.375891243921.issue26828@roundup.psfhosted.org>


Change by Nicholas Musolino <n.musolino at gmail.com>:


----------
pull_requests: +14249
pull_request: https://github.com/python/cpython/pull/14432

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26828>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:28:35 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 21:28:35 +0000
Subject: [issue37435] builtin map iterator should provide __length_hint__
In-Reply-To: <1561666356.12.0.770059184223.issue37435@roundup.psfhosted.org>
Message-ID: <1561670915.6.0.583125565525.issue37435@roundup.psfhosted.org>


Change by Nicholas Musolino <n.musolino at gmail.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37435>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:43:30 2019
From: report at bugs.python.org (Aaron Meurer)
Date: Thu, 27 Jun 2019 21:43:30 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561671810.18.0.162533323297.issue37433@roundup.psfhosted.org>


Aaron Meurer <asmeurer at gmail.com> added the comment:

This looks like the same issue I mentioned here https://bugs.python.org/msg344764

----------
nosy: +asmeurer

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:51:32 2019
From: report at bugs.python.org (Borja)
Date: Thu, 27 Jun 2019 21:51:32 +0000
Subject: [issue37415] Error build Python with Intel compiler: <stdatomic.h>
 doesn't provide atomic_uintptr_t
In-Reply-To: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>
Message-ID: <1561672292.39.0.682139175179.issue37415@roundup.psfhosted.org>


Borja <saszalez at gmail.com> added the comment:

Two things.

I searched a bit more and found "atomic_uint" inside <stdatomic.h>, but it's not exactly the same as what you wrote.

What you have put me to try, where do I put it?

I attached <stdatomic.h> in case it helps.

----------
Added file: https://bugs.python.org/file48443/stdatomic.h

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:55:09 2019
From: report at bugs.python.org (Nicholas Musolino)
Date: Thu, 27 Jun 2019 21:55:09 +0000
Subject: [issue26828] Implement __length_hint__() on map() and filter() to
 optimize list(map) and list(filter)
In-Reply-To: <1461327160.24.0.621419084727.issue26828@psf.upfronthosting.co.za>
Message-ID: <1561672509.3.0.614619648925.issue26828@roundup.psfhosted.org>


Nicholas Musolino <n.musolino at gmail.com> added the comment:

Before seeing this issue and its closed status, I created PR 14432, which adds `__length_hint__()` to the iterator returned by builtin `map`.

This PR differs from the original 2017 PR by MSeifert in that the code can distinguish between the cases where a length hint (or length) function is not available, versus a case in which the `__length_hint__()` method of the user-supplied iterable raises an exception.

That is, the new PR propagates exceptions (other than TypeError, per PEP 424) raised in the `__length_hint__()` functions of the user-supplied iterators.

I've read the comments in this issue, and the notes in `test_iterlen.py`:

> [Other] iterators [...], such as enumerate and the other itertools,
> are not length transparent because they have no way to distinguish between
> iterables that report static length and iterators whose length changes with
> each call (i.e. the difference between enumerate('abc') and
> enumerate(iter('abc')).

Can anyone provide a concrete example that illustrates the inherent difficulties of computing a length hint for `map`?  

In ad-hoc testing, the current PR handles situations listed there, and I haven't come across some fundamental show-stopper problem.

There are two limitations to the current PR:

1.  The case where a single iterator is supplied as multiple arguments to `map`, as pointed out by MSeifert:  
    it = iter([1,2,3,4])
    map_it = map(f, it, it)  
2.  When a user-supplied `__length_hint__()` method returns a non-integer, it results in a TypeError in an *inner* evaluation of `PyObject_LengthHint()` (per PEP 424).  When this exception reaches an *outer* evaluation of `PyObject_LengthHint()`, it is cleared (per PEP 424), and leads to operator.length_hint's default value being returned.

If we consider issue 2 to be incorrect,  I think I could fix it by raising RuntimeError from the original TypeError, or by somewhat invasive refactoring of `PyObject_LengthHint()` (which I do not recommend).

----------
nosy: +nmusolino

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26828>
_______________________________________

From report at bugs.python.org  Thu Jun 27 17:58:44 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 27 Jun 2019 21:58:44 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561672724.25.0.133752251538.issue23014@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Feel free to open a new issue to propose changing it.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:01:16 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 27 Jun 2019 22:01:16 +0000
Subject: [issue37409] relative import without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561672876.14.0.0913786005248.issue37409@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Please open a separate issue for the relative import issue.

----------
stage: resolved -> test needed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:01:45 2019
From: report at bugs.python.org (Brett Cannon)
Date: Thu, 27 Jun 2019 22:01:45 +0000
Subject: [issue37416] If threading is not imported from the main thread it
 sees the wrong thread as the main thread.
In-Reply-To: <1561572282.64.0.920915319776.issue37416@roundup.psfhosted.org>
Message-ID: <1561672905.36.0.177605365935.issue37416@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
nosy:  -brett.cannon

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37416>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:03:03 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 27 Jun 2019 22:03:03 +0000
Subject: [issue37433] syntax error in f-string in multiline string produces
 ~40k spaces of output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561672983.45.0.0839658094354.issue37433@roundup.psfhosted.org>


Change by Anthony Sottile <asottile at umich.edu>:


----------
keywords: +patch
pull_requests: +14250
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14433

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:04:25 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Thu, 27 Jun 2019 22:04:25 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561673065.12.0.485233451342.issue23014@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

I suspect it would be closed since it's essentially just a revert of this issue :S

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:09:41 2019
From: report at bugs.python.org (Eryk Sun)
Date: Thu, 27 Jun 2019 22:09:41 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561673381.23.0.280194327043.issue37369@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> you should go through your current user's apps directory 
> (C:\Users\name\AppData\Local\Microsoft\WindowsApps\<package family>,
> which contains only symlinks to the actual executables).

"%LocalAppData%\Microsoft\WindowsApps" contains IO_REPARSE_TAG_APPEXECLINK reparse points. An application-execution link is not like a regular symlink, i.e. it does not have the name-surrogate bit set in the tag value. In addition to the real application path, an app-exec link also contains the package information that the system uses to create the special access token that's required in order to execute the application.

I stepped through CreateProcessW in 10.0.18362.175 (slow ring), which has the old behavior. The first NtCreateUserProcess system call (the call that actually creates the Process object) fails with STATUS_IO_REPARSE_TAG_NOT_HANDLED. CreateProcessW handles this by getting the package information from the reparse point and creating a new token that contains 3 additional security attributes (WIN://SYSAPPID, WIN://PKG, and WIN://PKGHOSTID). For the subsequent NtCreateUserProcess system call, it uses the real path under "%ProgramFiles%\WindowsApps" and impersonates the new access token. 

The real executable has two ACEs for standard users. There's a basic access-allowed ACE that grants read access, but does not grant execute access. There's also an access-allowed callback ACE that grants read and execute access. Normally the kernel security routines ignore callback ACEs in an access check, since they're intended for an application-defined callback in the user-mode AuthZ API. Apparently something is special-casing the access check in this case, to conditionally check the security attributes in the token in order to apply this callback ACE. If I remove the callback ACE, users can no longer execute python.exe, so I know this is the ACE that's granting execute access.

Back to CreateProcessW. If I try to directly execute the real executable in "%ProgramFiles%\WindowsApps", the NtCreateUserProcess system call fails with STATUS_ACCESS_DENIED, as expected. But then CreateProcessW does something that I didn't expect. It parses out the base filename "python.exe" and joins it to "%LocalAppData%\Microsoft\WindowsApps". If it finds the app-exec link, then it reads it to create the special package access token, as if we had run the app-exec link directly. If I had to guess, I would assume this behavior has been disabled in newer versions of Windows 10. I'm using the slow ring for now, so I don't have a way to test this guess.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Thu Jun 27 18:37:29 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 22:37:29 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561675049.41.0.968503559885.issue37412@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14251
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14434

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Thu Jun 27 19:00:47 2019
From: report at bugs.python.org (bob gailer)
Date: Thu, 27 Jun 2019 23:00:47 +0000
Subject: [issue37430] range is not a built-in function
In-Reply-To: <1561649972.91.0.461406342746.issue37430@roundup.psfhosted.org>
Message-ID: <1561676447.11.0.719620949302.issue37430@roundup.psfhosted.org>


bob gailer <bgailer at gmail.com> added the comment:

Thanks for explaining. Indeed range appears in __builtins__. It is a surprise to type range and get <class 'range'> in response. sum otoh gives <built-in function sum>. The distinction between function, type and class seems muddy.

When I enter "range" in the index box in the windows documentation display I am offered: 

(1)built-in function, which takes me to the paragraph that started this issue. It does NOT take me to the built-in functions topic, whereas sum does.

(2) object, and range (built-in class)which take me to the built-in types topic. This seems to add to the confusion.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37430>
_______________________________________

From report at bugs.python.org  Thu Jun 27 19:23:02 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 23:23:02 +0000
Subject: [issue37415] Error build Python with Intel compiler: <stdatomic.h>
 doesn't provide atomic_uintptr_t
In-Reply-To: <1561563167.55.0.111630694926.issue37415@roundup.psfhosted.org>
Message-ID: <1561677782.79.0.350291016112.issue37415@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I suggested you to test the following change on the master branch of Python:

diff --git a/Include/internal/pycore_atomic.h b/Include/internal/pycore_atomic.h
index 336bc3fec2..c624a0cf1c 100644
--- a/Include/internal/pycore_atomic.h
+++ b/Include/internal/pycore_atomic.h
@@ -44,7 +44,7 @@ typedef enum _Py_memory_order {
 } _Py_memory_order;
 
 typedef struct _Py_atomic_address {
-    atomic_uintptr_t _value;
+    _Atomic uintptr_t _value;
 } _Py_atomic_address;
 
 typedef struct _Py_atomic_int {

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37415>
_______________________________________

From report at bugs.python.org  Thu Jun 27 19:29:15 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 23:29:15 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561678155.36.0.340379291611.issue37369@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> For 3.8 I can apply the same fix and make sys.base_executable public, or keep it as sys._base_executable. Either way, it'll show up in PyConfig. (Victor - thoughts here? Should be a non-breaking change, right?)

There is _PyConfig._config_version which is designed to support PyConfig change without losing ABI compatibility... but I didn't implement code for that yet :-)

If you have to modify PyConfig in 3.8, I suggest to directly use "base_executable" "public" name there (don't change it from _base_executable  to base_executable from 3.8 to 3.9, it would be painful).

I'm not sure of the purpose of sys._base_executable. Maybe open a separated issue to make the attribute public? I'm not sure if multiprocessing (for example) should use it, or if sys.executble should be used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Thu Jun 27 19:33:28 2019
From: report at bugs.python.org (Ned Deily)
Date: Thu, 27 Jun 2019 23:33:28 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561678408.06.0.662662078375.issue37428@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Christian, just confirming that, since you have not set this as a "release blocker", 3.7.4 will go out without it.

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Thu Jun 27 19:33:52 2019
From: report at bugs.python.org (STINNER Victor)
Date: Thu, 27 Jun 2019 23:33:52 +0000
Subject: [issue26828] Implement __length_hint__() on map() and filter() to
 optimize list(map) and list(filter)
In-Reply-To: <1461327160.24.0.621419084727.issue26828@psf.upfronthosting.co.za>
Message-ID: <1561678432.11.0.490795868198.issue26828@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

The main issue with using length hint is that calling a method is Python is not free. Calling the method may add more overhead than the speedup provided by smarter memory allocations.

The worst case for this optimization should be measured on very small data set, of less than 10 items. We don't want to make Python smaller for operations on 5 items for example.

The idea which remains open is the idea of adding a "slot" for length hint in PyTypeObject. But I would suggest to open a separated issue to explore this idea.

Slots allows to use C functions at raw speed and so reduce the cost of getting the length hint.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26828>
_______________________________________

From report at bugs.python.org  Thu Jun 27 20:18:23 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 00:18:23 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561681103.33.0.105079209119.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Example of case where a module path is still relative:
---
import sys
import os
modname = 'relpath'
filename = modname + '.py'
sys.path.insert(0, os.curdir)
with open(filename, "w") as fp:
    print("import sys", file=fp)
    print("mod = sys.modules[__name__]", file=fp)
    print("print(f'{__file__=}')", file=fp)
    print("print(f'{mod.__file__=}')", file=fp)
    print("print(f'{mod.__cached__=}')", file=fp)
__import__(modname)
os.unlink(filename)
---

Output:
---
__file__='./relpath.py'
mod.__file__='./relpath.py'
mod.__cached__='./__pycache__/relpath.cpython-39.pyc'
---

__file__ and mod.__file__ are relative paths: not absolute paths.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Thu Jun 27 21:20:52 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 28 Jun 2019 01:20:52 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561684852.37.0.331604896932.issue37422@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

It's a _NamespacePath in 3.7 because there's no __init__.py in the top-level "google" directory, and that makes it a namespace package.

I'm not exactly sure why it works in 2.7, frankly. <time passes> Looking some more: it's because they're playing tricks in a .pth file. I don't recall what the interactions between .pth and namespace packages.

I don't know if Google really means for "google" to be a namespace package, or if it's just a side effect of how they're installing protobuf.

In any event, I don't think we want a _NamespacePath to be modifiable.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Thu Jun 27 21:21:56 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Fri, 28 Jun 2019 01:21:56 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561684916.03.0.426116149636.issue37422@roundup.psfhosted.org>


Eric V. Smith <eric at trueblade.com> added the comment:

And I see you're not asking for changed behavior, just documentation. But I think it is documented that this is how namespace packages work.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Thu Jun 27 21:53:43 2019
From: report at bugs.python.org (Zufu Liu)
Date: Fri, 28 Jun 2019 01:53:43 +0000
Subject: [issue37436] os.path.isfile() with big number cause OverflowError: fd
 is greater than maximum
Message-ID: <1561686823.22.0.469835611791.issue37436@roundup.psfhosted.org>


New submission from Zufu Liu <zufuliu at 163.com>:

I think it's should be TypeError as Python 2.7.

The doc https://docs.python.org/3/library/os.path.html
doesn't says it accept file descriptor.


Python 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import os.path
>>> os.path.isfile(123)
False
>>> os.path.isfile(2**32)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "D:\Dev\Python3\lib\genericpath.py", line 30, in isfile
    st = os.stat(path)
OverflowError: fd is greater than maximum
>>>

Python 3.8.0b1 (tags/v3.8.0b1:3b5deb0116, Jun  4 2019, 19:52:55) [MSC v.1916 64 bit (AMD64)] on win32
>>> import os.path
>>> os.path.isfile(123)
False
>>> os.path.isfile(2**32)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "D:\obj\Windows-Release\38amd64_Release\msi_python\zip_amd64\genericpath.py", line 30, in isfile
OverflowError: fd is greater than maximum
>>>

Python 2.7.16 (v2.7.16:413a49145e, Mar  4 2019, 01:37:19) [MSC v.1500 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import os.path
>>> os.path.isfile(123)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "D:\Dev\Python\lib\genericpath.py", line 37, in isfile
    st = os.stat(path)
TypeError: coercing to Unicode: need string or buffer, int found
>>>

----------
components: Library (Lib), Windows
messages: 346792
nosy: paul.moore, steve.dower, tim.golden, zach.ware, zufuliu
priority: normal
severity: normal
status: open
title: os.path.isfile() with big number cause OverflowError: fd is greater than maximum
type: behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37436>
_______________________________________

From report at bugs.python.org  Thu Jun 27 22:37:03 2019
From: report at bugs.python.org (Jim Li)
Date: Fri, 28 Jun 2019 02:37:03 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561689423.42.0.596166004533.issue37422@roundup.psfhosted.org>


Jim Li <jimli at bcgsc.ca> added the comment:

Ah, that started to make sense. To be honest I didn't really pay much attention to the _namespace's documentation, I only looked at that of __path__ and somehow expected it to mention that certain namespace won't be a type<list> anymore.

I will re-read your comments and the docs for _namespace; I was also reading this https://www.python.org/dev/peps/pep-0420/#migrating-from-legacy-namespace-packages

Thanks for the help!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:29:05 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 28 Jun 2019 03:29:05 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
Message-ID: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>


New submission from Benjamin Peterson <benjamin at python.org>:

Fixes CVE-2018-20843.

----------
components: XML
messages: 346794
nosy: benjamin.peterson
priority: normal
severity: normal
status: open
title: update vendorized expat to 2.2.7
versions: Python 2.7, Python 3.6, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:35:12 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 28 Jun 2019 03:35:12 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561692912.63.0.184104392639.issue37437@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
keywords: +patch
pull_requests: +14252
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14436

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:54:47 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 28 Jun 2019 03:54:47 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561694087.74.0.30586734531.issue37437@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 3b03b09fc94425915c5b1225e9200a3a95bc827b by Benjamin Peterson in branch 'master':
closes bpo-37437: Update vendorized expat to 2.2.7. (GH-14436)
https://github.com/python/cpython/commit/3b03b09fc94425915c5b1225e9200a3a95bc827b


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:55:00 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 03:55:00 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561694100.61.0.455702651702.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14253
pull_request: https://github.com/python/cpython/pull/14437

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:55:09 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 03:55:09 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561694109.67.0.6472051088.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14254
pull_request: https://github.com/python/cpython/pull/14438

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:55:26 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 03:55:26 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561694126.61.0.148446220934.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14255
pull_request: https://github.com/python/cpython/pull/14439

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Thu Jun 27 23:55:36 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 03:55:36 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561694136.64.0.478633508996.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14256
pull_request: https://github.com/python/cpython/pull/14440

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 00:12:44 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 04:12:44 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561695164.9.0.804756197726.issue37437@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 515a026eb068e2730b6e2cddc9bbb1aef39d71fd by Miss Islington (bot) in branch '3.8':
closes bpo-37437: Update vendorized expat to 2.2.7. (GH-14436)
https://github.com/python/cpython/commit/515a026eb068e2730b6e2cddc9bbb1aef39d71fd


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 00:15:12 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 04:15:12 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561695312.3.0.253575347507.issue37437@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 87cc66877ccf9c8222d51515c0d8de40c39d8af2 by Miss Islington (bot) in branch '3.7':
closes bpo-37437: Update vendorized expat to 2.2.7. (GH-14436)
https://github.com/python/cpython/commit/87cc66877ccf9c8222d51515c0d8de40c39d8af2


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 00:16:51 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 04:16:51 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561695411.47.0.177362797705.issue37437@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 6632906c08e1d4de0fceba42c47886be41b7ba3d by Miss Islington (bot) in branch '3.6':
closes bpo-37437: Update vendorized expat to 2.2.7. (GH-14436)
https://github.com/python/cpython/commit/6632906c08e1d4de0fceba42c47886be41b7ba3d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 00:24:55 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 04:24:55 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561695895.07.0.603360005598.issue37437@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 4397c68663efe58930b31c561e5948b4038875ae by Miss Islington (bot) in branch '2.7':
closes bpo-37437: Update vendorized expat to 2.2.7. (GH-14436)
https://github.com/python/cpython/commit/4397c68663efe58930b31c561e5948b4038875ae


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 00:46:45 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 28 Jun 2019 04:46:45 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561697205.46.0.288196517018.issue20443@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

This change seems to produce a new warning on my Mac.

./Modules/getpath.c:764:23: warning: incompatible pointer types passing 'char [1025]' to parameter of type 'const wchar_t *' (aka 'const int *') [-Wincompatible-pointer-types]
            _Py_isabs(execpath))
                      ^~~~~~~~
./Include/fileutils.h:158:42: note: passing argument to parameter 'path' here
PyAPI_FUNC(int) _Py_isabs(const wchar_t *path);
                                         ^
1 warning generated.

----------
nosy: +xtreak

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 01:13:58 2019
From: report at bugs.python.org (Aldwin Pollefeyt)
Date: Fri, 28 Jun 2019 05:13:58 +0000
Subject: [issue37436] os.path.isfile() with big number cause OverflowError: fd
 is greater than maximum
In-Reply-To: <1561686823.22.0.469835611791.issue37436@roundup.psfhosted.org>
Message-ID: <1561698838.51.0.403510489391.issue37436@roundup.psfhosted.org>


Aldwin Pollefeyt <aldwinaldwin at gmail.com> added the comment:

Integers seems to be accepted, so not a TypeError? Maybe documentation needs some more information. 


Documentation os.path under os.path.exists(path):

Changed in version 3.3: path can now be an integer: True is returned if it is an open file descriptor, False otherwise.


in posixmodule.c:

 * path_converter also optionally accepts signed
 * integers (representing open file descriptors) instead
 * of path strings.


although i dunno how to use then:

$ echo "test" > 123
$ ls -i 123
8012691 123
$ ./python -c "import os.path; print(os.path.isfile(8012691))"
False
$ ./python -c "import os.path; print(os.path.isfile('123'))"
True

----------
nosy: +aldwinaldwin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37436>
_______________________________________

From report at bugs.python.org  Fri Jun 28 01:39:29 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Fri, 28 Jun 2019 05:39:29 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561700369.48.0.331688845163.issue37399@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

I think it might be this call that strikes here:

https://github.com/python/cpython/commit/43851a202c#diff-f3b827d6e1d5c270ab42bc2c0523c1d2R2842

treebuilder_flush_data() is not made for concatenating text, it simply replaces it. If both text parts come separately, and the comment between the two is discarded, then the last one overwrites the first one.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Fri Jun 28 02:17:49 2019
From: report at bugs.python.org (Dima Tisnek)
Date: Fri, 28 Jun 2019 06:17:49 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561702669.78.0.958482081139.issue37399@roundup.psfhosted.org>


Dima Tisnek <dimaqq at gmail.com> added the comment:

Yes that does look suspicious!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Fri Jun 28 02:40:50 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 28 Jun 2019 06:40:50 +0000
Subject: [issue37390] Generate table of audit events for docs
In-Reply-To: <1561391164.88.0.923938823513.issue37390@roundup.psfhosted.org>
Message-ID: <1561704050.02.0.175913348394.issue37390@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks Steve, the page will serve as a good reference to all audit events.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37390>
_______________________________________

From report at bugs.python.org  Fri Jun 28 03:10:27 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 28 Jun 2019 07:10:27 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561705827.06.0.617659959695.issue37366@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Yes, onerror allows you to delete an undeletable item.  But, in the case of a mount point, the contents of the mounted filesystem get deleted *before* the mount point triggers onerror.  This is the case described in issue #36422.

The behavior provided by onitem allows you to provide a callback that can check for specific paths that may require special handling.  This is especially useful if the onitem callback is also added to tempfile.TemporaryDirectory().

My PR handles a missing onitem argument the same way onerror is handled by providing a do-nothing stub function:

if onitem is None:
    def onitem(*args):
        pass

I don't know enough about CPython internals to tell the performance differences between such a stub function and wrapping each call to onitem in an "if" block.

----------
versions: +Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Fri Jun 28 04:01:17 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 08:01:17 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561708877.48.0.211582184459.issue37366@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

I'm with Giampaolo.

I'm also concerned that the new callback will make the rmtree function too complicated. It's not a one-size-fits-all solution, but it covers most uses cases.

----------
nosy: +christian.heimes
versions:  -Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Fri Jun 28 04:02:20 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 28 Jun 2019 08:02:20 +0000
Subject: [issue36956] Calling "functions" used to implement generators/comps
 easily cause crash
In-Reply-To: <1558187601.17.0.878025070628.issue36956@roundup.psfhosted.org>
Message-ID: <1561708940.41.0.00881193249144.issue36956@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

What is the preferred behavior? Raise an exception of some kind?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36956>
_______________________________________

From report at bugs.python.org  Fri Jun 28 04:13:01 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 28 Jun 2019 08:13:01 +0000
Subject: [issue36956] Calling "functions" used to implement generators/comps
 easily cause crash
In-Reply-To: <1558187601.17.0.878025070628.issue36956@roundup.psfhosted.org>
Message-ID: <1561709581.75.0.721288296716.issue36956@roundup.psfhosted.org>


Jeffrey Kintscher <websurfer at surf2c.net> added the comment:

Specifically, the crash occurs in Python/ceval.c function _PyEval_EvalFrameDefault() in the TARGET(FOR_ITER) case at line 3198 (master branch):

PyObject *next = (*iter->ob_type->tp_iternext)(iter);

It segfaults because tp_iternext is NULL.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36956>
_______________________________________

From report at bugs.python.org  Fri Jun 28 04:15:22 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 28 Jun 2019 08:15:22 +0000
Subject: [issue36956] Calling "functions" used to implement generators/comps
 easily cause crash
In-Reply-To: <1558187601.17.0.878025070628.issue36956@roundup.psfhosted.org>
Message-ID: <1561709722.54.0.131011134658.issue36956@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

ISTM this report is close to that covered by the traditional stance that word code hacks aren't protected from crashes because trying to do can be complicated, can be expensive, and isn't always possible.  

I'm not really sure where this falls on the grey scale with "normal, everyday python shouldn't crash" on one end and "with ctypes or code hacks, all bets are off" on the other end.  

Offhand, the posted snippet seems closer to "messing with the internals" but perhaps small cheap check can be added when the __code__ variable is updated.

----------
nosy: +rhettinger

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36956>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:03:21 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 28 Jun 2019 09:03:21 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561712601.55.0.71183971994.issue37432@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset b4bee03087a3c70cb040e2ce569c828860ed8e87 by Inada Naoki (Hai Shi) in branch 'master':
bpo-37432: Doc: Fix signature of PyObject_Del() (GH-14430)
https://github.com/python/cpython/commit/b4bee03087a3c70cb040e2ce569c828860ed8e87


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:03:23 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 09:03:23 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561712603.37.0.515101565014.issue37432@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14257
pull_request: https://github.com/python/cpython/pull/14441

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:03:32 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 09:03:32 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561712612.11.0.507927096778.issue37432@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14258
pull_request: https://github.com/python/cpython/pull/14442

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:16:33 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 09:16:33 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561713393.82.0.892091885711.issue37432@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 99f2f851773c6e481e80e8e157d9f5ad4fc5cbb3 by Miss Islington (bot) in branch '3.7':
bpo-37432: Doc: Fix signature of PyObject_Del() (GH-14430)
https://github.com/python/cpython/commit/99f2f851773c6e481e80e8e157d9f5ad4fc5cbb3


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:16:39 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 09:16:39 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561713399.19.0.0364970033362.issue37432@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ad00640f936956c3a19834b6cd12b04edf53a776 by Miss Islington (bot) in branch '3.8':
bpo-37432: Doc: Fix signature of PyObject_Del() (GH-14430)
https://github.com/python/cpython/commit/ad00640f936956c3a19834b6cd12b04edf53a776


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:23:20 2019
From: report at bugs.python.org (Nick Coghlan)
Date: Fri, 28 Jun 2019 09:23:20 +0000
Subject: [issue37438] ConfigParser.set() docs should mention allow_no_value
Message-ID: <1561713800.79.0.286500391609.issue37438@roundup.psfhosted.org>


New submission from Nick Coghlan <ncoghlan at gmail.com>:

Reviewing some code today, I came across a ConfigParser.set() call that only specified the section and key, with the value argument missing.

If you look at the ConfigParser.set() docs, this seems like incorrect code, as those docs indicate that the value argument is a required parameter: https://docs.python.org/3/library/configparser.html#configparser.ConfigParser.set

However, checking the code shows that:

1. "value" has a default value of None
2. if "allow_no_value" is passed to the constructor, passing "None" as the value will be interpreted as a request to add a key-only entry to the section with no equals sign

----------
assignee: docs at python
components: Documentation
messages: 346813
nosy: docs at python, ncoghlan
priority: normal
severity: normal
stage: needs patch
status: open
title: ConfigParser.set() docs should mention allow_no_value
type: enhancement
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37438>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:25:54 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 09:25:54 +0000
Subject: [issue34022] 6 tests fail using SOURCE_DATE_EPOCH env var
In-Reply-To: <1530533915.92.0.56676864532.issue34022@psf.upfronthosting.co.za>
Message-ID: <1561713954.49.0.493724169751.issue34022@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

> With this change, only 3 tests fail on 3.7, and all these 3 fail because of zipimport: test_cmd_line_script, test_multiprocessing_main_handling and test_runpy.

These tests were fixed by:

commit a6e956bcb0edbfe7f18af9be2215a5326ea6bf05
Author: Elvis Pranskevichus <elvis at magic.io>
Date:   Wed Nov 7 13:34:59 2018 -0500

    bpo-34726: Fix handling of hash-based pycs in zipimport. (GH-10327)
    
    Current support for hash-based bytecode files in `zipimport` is rather
    sparse, which leads to test failures when the test suite is ran with
    the ``SOURCE_DATE_EPOCH`` environment variable set.
    
    This teaches zipimport to handle hash-based pycs properly.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34022>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:28:09 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 28 Jun 2019 09:28:09 +0000
Subject: [issue37439] Add random.binomialvariate()
Message-ID: <1561714089.16.0.904652961331.issue37439@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

This a small snippet of code I written dozens of times.  It would be nice to have this in the library along with the other distributions.

def binomialvariate(n, p):
    ''' Binomial distribution for the number of successes
        in *n* Bernoulli trials each with a probability *p*
        of success.

        Returns an integer in the range:  0 <= X <= n
    '''
    return sum(random() < p for i in range(n))

----------
components: Library (Lib)
messages: 346815
nosy: mark.dickinson, rhettinger, tim.peters
priority: low
severity: normal
status: open
title: Add random.binomialvariate()
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37439>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:41:52 2019
From: report at bugs.python.org (hai shi)
Date: Fri, 28 Jun 2019 09:41:52 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561714912.61.0.161917122875.issue37432@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 05:49:05 2019
From: report at bugs.python.org (Inada Naoki)
Date: Fri, 28 Jun 2019 09:49:05 +0000
Subject: [issue37337] Add _PyObject_VectorcallMethod() function
In-Reply-To: <1560936931.61.0.893195452608.issue37337@roundup.psfhosted.org>
Message-ID: <1561715345.65.0.162622805149.issue37337@roundup.psfhosted.org>


Inada Naoki <songofacandy at gmail.com> added the comment:


New changeset b1263d5a60d3f7ab02dd28409fff59b3815a3f67 by Inada Naoki (Jeroen Demeyer) in branch 'master':
bpo-37337: Add _PyObject_VectorcallMethod() (GH-14228)
https://github.com/python/cpython/commit/b1263d5a60d3f7ab02dd28409fff59b3815a3f67


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37337>
_______________________________________

From report at bugs.python.org  Fri Jun 28 06:19:21 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 28 Jun 2019 10:19:21 +0000
Subject: [issue37439] Add random.binomialvariate()
In-Reply-To: <1561714089.16.0.904652961331.issue37439@roundup.psfhosted.org>
Message-ID: <1561717161.56.0.576199803251.issue37439@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

Instead of a O(n) simulation, an O(1) equivalent should be used.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37439>
_______________________________________

From report at bugs.python.org  Fri Jun 28 07:51:45 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 28 Jun 2019 11:51:45 +0000
Subject: [issue37335] Fix unexpected ASCII aliases in locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561722705.95.0.492962812744.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
title: Add 646 ASCII alias to locale coercion tests. -> Fix unexpected ASCII aliases in locale coercion tests.

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 28 08:00:51 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 28 Jun 2019 12:00:51 +0000
Subject: [issue37335] Fix unexpected ASCII aliases in locale coercion tests.
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561723251.7.0.975193075571.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
pull_requests: +14259
pull_request: https://github.com/python/cpython/pull/14443

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 28 09:48:34 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 13:48:34 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1561729714.1.0.724507036289.issue36763@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14260
pull_request: https://github.com/python/cpython/pull/14444

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Fri Jun 28 09:51:28 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 13:51:28 +0000
Subject: [issue36763] Implementation of the PEP 587
In-Reply-To: <1556663939.96.0.509924822981.issue36763@roundup.psfhosted.org>
Message-ID: <1561729888.37.0.764318659992.issue36763@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14261
pull_request: https://github.com/python/cpython/pull/14445

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36763>
_______________________________________

From report at bugs.python.org  Fri Jun 28 09:59:05 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 13:59:05 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561730345.73.0.962317312984.issue37428@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

This issue breaks some stuff at work. I would appreciate if we can get the fix into 3.7.4. I wasn't aware that we are so close to cut-off to 3.7.4 release.


What does the fix do?
I moved all PHA related flags / options from SSL_CTX* to SSL*. The flags and options now depend on the socket type and existing flags.

For a server-side socket, the SSL_VERIFY_POST_HANDSHAKE verify flag is now only set when the server socket is configured to verify client certs. Server sockets without SSL_VERIFY_PEER flag don't set the option. The presence of SSL_VERIFY_POST_HANDSHAKE without SSL_VERIFY_PEER sometimes triggers handshake errors like "extension not received". The official documentation says "This flag must be used together with SSL_VERIFY_PEER.". The ssl.CERT_OPTIONAL and ssl.CERT_REQURED both set SSL_VERIFY_PEER. SSL_set_post_handshake_auth() is not enabled for server-side sockets.

For client side sockets, PHA is only enabled with SSL_set_post_handshake_auth(ssl, 1). The SSL_VERIFY_POST_HANDSHAKE flag is no longer set.

https://www.openssl.org/docs/manmaster/man3/SSL_CTX_set_post_handshake_auth.html

----------
nosy: +alex
priority: high -> deferred blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:16:50 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 28 Jun 2019 14:16:50 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561731410.18.0.877971418288.issue37428@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

"Assuming no critical problems are found prior to 2019-06-28, no code changes are planned between these release candidates and the final releases."

We were planning to start producing the final release artifacts in a couple of hours so we need to make a decision very quickly.  If you think this is necessary, we can delay the release a bit.  In the worst case, we could do a second release candidate but I *really* do not want to do that unless it is absolutely necessary.  Also note that with 3.7.4, we have updated the Windows and macOS installers to use OpenSSL 1.1.1 (c) instead of 1.1.0.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:17:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 14:17:51 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561731471.02.0.412969756327.issue20443@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14262
pull_request: https://github.com/python/cpython/pull/14446

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:28:23 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 28 Jun 2019 14:28:23 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561732103.39.0.239842489163.issue37432@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
resolution:  -> fixed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:28:38 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 28 Jun 2019 14:28:38 +0000
Subject: [issue37432] Fix a small param type in allocation.rst
In-Reply-To: <1561658657.08.0.608872131801.issue37432@roundup.psfhosted.org>
Message-ID: <1561732118.38.0.987304363053.issue37432@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
versions: +Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37432>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:29:05 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 14:29:05 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
Message-ID: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>


New submission from Christian Heimes <lists at cheimes.de>:

httplib.client does not enable post-handshake authentication for TLS 1.3 connections. PHA is necessary for TLS 1.3 connections to servers that have conditional client cert authentication. For example Apache mod_ssl uses PHA when only certain paths or request methods require a client cert to authenticate a client.

Since TLS 1.3 is enabled by default with OpenSSL 1.1.1 and TLS 1.3 is preferred over TLS 1.2, the lack of PHA extension breaks backwards compatibility.

----------
assignee: christian.heimes
components: Library (Lib), SSL
messages: 346820
nosy: alex, christian.heimes, dstufft, janssen, ned.deily
priority: deferred blocker
severity: normal
status: open
title: httplib should enable post-handshake authentication for TLS 1.3
type: behavior
versions: Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:41:23 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 28 Jun 2019 14:41:23 +0000
Subject: [issue37335] Improve encoding alias handling in locale coercion tests
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561732883.88.0.910627580638.issue37335@roundup.psfhosted.org>


Jakub Kulik <kulikjak at gmail.com> added the comment:

Python 3.8+ encodings are always normalized and thus no output variations handling is necessary (the code is no longer necessary).

Python 3.7 (and possibly lower) can have variations in encodings - that should be fixed with codecs.lookup functions.

----------
title: Fix unexpected ASCII aliases in locale coercion tests. -> Improve encoding alias handling in locale coercion tests
versions: +Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:44:14 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 28 Jun 2019 14:44:14 +0000
Subject: [issue37335] Improve encoding alias handling in locale coercion tests
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561733054.66.0.97930539859.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
pull_requests: +14263
pull_request: https://github.com/python/cpython/pull/14447

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:44:25 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 14:44:25 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1561733065.07.0.713619419271.issue37440@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
dependencies: +SSLContext.post_handshake_auth implicitly enables cert validation

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:46:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 14:46:03 +0000
Subject: [issue37337] Add _PyObject_VectorcallMethod() function
In-Reply-To: <1560936931.61.0.893195452608.issue37337@roundup.psfhosted.org>
Message-ID: <1561733163.56.0.994871090156.issue37337@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
nosy:  -vstinner

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37337>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:47:04 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 28 Jun 2019 14:47:04 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561733224.34.0.74788207582.issue24214@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Since the latest fix (GH-14369) addresses a regression between 3.7.3 and 3.7.4rc1, I am going to cherry-pick it into 3.7.4 final.  (In retrospect, this regression should have been marked as a "release blocker".)

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:49:08 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 14:49:08 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1561733348.52.0.0687307505091.issue37440@roundup.psfhosted.org>


Change by Christian Heimes <lists at cheimes.de>:


----------
keywords: +patch
pull_requests: +14264
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14448

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:49:41 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 14:49:41 +0000
Subject: [issue20443] __code__. co_filename should always be an absolute path
In-Reply-To: <1391048115.83.0.412883752117.issue20443@psf.upfronthosting.co.za>
Message-ID: <1561733381.82.0.519644390448.issue20443@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 3029035ef34c9bae0c8d965290cd9b273c8de1ea by Victor Stinner in branch 'master':
bpo-20443: Fix calculate_program_full_path() warning (GH-14446)
https://github.com/python/cpython/commit/3029035ef34c9bae0c8d965290cd9b273c8de1ea


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue20443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:58:40 2019
From: report at bugs.python.org (Christian Heimes)
Date: Fri, 28 Jun 2019 14:58:40 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561733920.74.0.960449789207.issue37428@roundup.psfhosted.org>


Christian Heimes <lists at cheimes.de> added the comment:

There are currently two issues with TLS 1.3 in Python. The issue https://bugs.python.org/issue37440 can be worked around easily with a custom SSLContext. This issue is a bigger problem because there is no possible workaround.

The bug is going to break applications that verify clients with a certificate but accept untrusted server certificates. It's not a common scenario, but I just happen to run into this issue for a project at work.

I'm sorry for the mess. :( I noticed the bug a couple of days ago. It took me a while to understand the root cause.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Fri Jun 28 10:59:54 2019
From: report at bugs.python.org (Jakub Kulik)
Date: Fri, 28 Jun 2019 14:59:54 +0000
Subject: [issue37335] Improve encoding alias handling in locale coercion tests
In-Reply-To: <1560931050.81.0.0200959048394.issue37335@roundup.psfhosted.org>
Message-ID: <1561733994.13.0.928968238673.issue37335@roundup.psfhosted.org>


Change by Jakub Kulik <kulikjak at gmail.com>:


----------
pull_requests: +14265
pull_request: https://github.com/python/cpython/pull/14449

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37335>
_______________________________________

From report at bugs.python.org  Fri Jun 28 11:05:20 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Fri, 28 Jun 2019 15:05:20 +0000
Subject: [issue37439] Add random.binomialvariate()
In-Reply-To: <1561714089.16.0.904652961331.issue37439@roundup.psfhosted.org>
Message-ID: <1561734320.49.0.674213472072.issue37439@roundup.psfhosted.org>


Change by Raymond Hettinger <raymond.hettinger at gmail.com>:


----------
Removed message: https://bugs.python.org/msg346817

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37439>
_______________________________________

From report at bugs.python.org  Fri Jun 28 11:10:46 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 28 Jun 2019 15:10:46 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561734646.91.0.684180088799.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14266
pull_request: https://github.com/python/cpython/pull/14450

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:02:03 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:02:03 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561737723.35.0.0720449947107.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset ec3e20a2d1edddb0558f9d32e2b367904ccdde88 by Victor Stinner in branch 'master':
bpo-37412: Fix os.getcwd() for long path on Windows (GH-14424)
https://github.com/python/cpython/commit/ec3e20a2d1edddb0558f9d32e2b367904ccdde88


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:02:19 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 16:02:19 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561737739.41.0.903197964791.issue37412@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14267
pull_request: https://github.com/python/cpython/pull/14451

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:05:09 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:05:09 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561737908.99.0.881917103804.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 64580da33122a10aef75c76aa3ff87c0ee11e3d7 by Victor Stinner in branch 'master':
bpo-37412: pythoninfo: add Windows long paths (GH-14434)
https://github.com/python/cpython/commit/64580da33122a10aef75c76aa3ff87c0ee11e3d7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:12:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:12:20 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561738340.85.0.00551999304534.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 042821ae3cf537e01963c9ec85d1a454d921e826 by Victor Stinner (Ruslan Kuprieiev) in branch 'master':
bpo-37380: subprocess: don't use _active on win (GH-14360)
https://github.com/python/cpython/commit/042821ae3cf537e01963c9ec85d1a454d921e826


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:13:20 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:13:20 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561738400.11.0.509026271887.issue37380@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I merged PR 14360 into master. Are Python 2.7, 3.7 and 3.8 impacted by the bug as well? Should we backport the change, or would it be too dangerous?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:13:36 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:13:36 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
In-Reply-To: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>
Message-ID: <1561738416.5.0.706927047592.issue37329@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 065aff3c518a641e7a734a5b93f9ebed1b405c49 by Victor Stinner in branch '2.7':
[2.7] bpo-37329: valgrind: ignore _PyWarnings_Init false alarms (GH-14202)
https://github.com/python/cpython/commit/065aff3c518a641e7a734a5b93f9ebed1b405c49


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:16:40 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:16:40 +0000
Subject: [issue37329] [2.7] valgrind python2 -m test.regrtest test___all__:
 definitely lost: 324 bytes in 2 blocks
In-Reply-To: <1560863121.22.0.720622336463.issue37329@roundup.psfhosted.org>
Message-ID: <1561738600.52.0.110029133848.issue37329@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I confirm that my fix works with this manual test. I get "definitely lost: 0 bytes in 0 blocks" as expected:

$ valgrind --suppressions=Misc/valgrind-python.supp ./python -m test.regrtest test___all__
(...)
==23782== LEAK SUMMARY:
==23782==    definitely lost: 0 bytes in 0 blocks
==23782==    indirectly lost: 0 bytes in 0 blocks
==23782==      possibly lost: 17,945,740 bytes in 85,380 blocks
==23782==    still reachable: 283,821 bytes in 475 blocks
==23782==         suppressed: 2,605 bytes in 20 blocks
==23782== Reachable blocks (those to which a pointer was found) are not shown.

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37329>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:19:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:19:24 +0000
Subject: [issue30345] test_gdb fails on Python 3.6 when built with LTO+PGO
In-Reply-To: <1494519392.85.0.668925519236.issue30345@psf.upfronthosting.co.za>
Message-ID: <1561738764.82.0.606245094687.issue30345@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

I'm fine with relying on buildbots for test_gdb on Python 3.7 and older. Thanks for the fixes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30345>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:23:10 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:23:10 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561738990.43.0.95847348123.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 68c1c398f3534af16309a86ab815b61d2487e6db by Victor Stinner (Miss Islington (bot)) in branch '3.8':
bpo-37412: Fix os.getcwd() for long path on Windows (GH-14424) (GH-14451)
https://github.com/python/cpython/commit/68c1c398f3534af16309a86ab815b61d2487e6db


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:24:04 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:24:04 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561739044.32.0.213104688109.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Ok, the regression should now be fixed and test_os now also tests os.getcwd() with a "long path" :-) Thank a lot Eryk Sun for your great advices on reviews!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:26:27 2019
From: report at bugs.python.org (F. Raab)
Date: Fri, 28 Jun 2019 16:26:27 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
In-Reply-To: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>
Message-ID: <1561739187.38.0.942498262074.issue37208@roundup.psfhosted.org>


Change by F. Raab <fab at raab.link>:


----------
nosy: +raabf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:30:50 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:30:50 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561739450.25.0.995624106094.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Oh. Now the test fails on macOS:

https://buildbot.python.org/all/#/builders/145/builds/2021
======================================================================
FAIL: test_getcwd_long_path (test.test_os.MiscTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/buildbot/buildarea/3.x.billenstein-sierra/build/Lib/test/test_os.py", line 115, in test_getcwd_long_path
    self.assertEqual(cwd, expected)
AssertionError: '/private/var/folders/sy/9hwmqyx14s11577cvgzwf2v40000gt/T/tmpchlt91ay' != '/var/folders/sy/9hwmqyx14s11577cvgzwf2v40000gt/T/tmpchlt91ay'
- /private/var/folders/sy/9hwmqyx14s11577cvgzwf2v40000gt/T/tmpchlt91ay
? --------
+ /var/folders/sy/9hwmqyx14s11577cvgzwf2v40000gt/T/tmpchlt91ay

----------
resolution: fixed -> 
status: closed -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:30:58 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:30:58 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561739458.65.0.860145489225.issue37412@roundup.psfhosted.org>


Change by STINNER Victor <vstinner at redhat.com>:


----------
pull_requests: +14268
stage: resolved -> patch review
pull_request: https://github.com/python/cpython/pull/14452

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:32:24 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 16:32:24 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561739544.67.0.92163274759.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:

Fail on FreeBSD as well:

https://buildbot.python.org/all/#/builders/168/builds/1222

======================================================================
FAIL: test_getcwd_long_path (test.test_os.MiscTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd-current/build/Lib/test/test_os.py", line 115, in test_getcwd_long_path
    self.assertEqual(cwd, expected)
AssertionError: '/var/tmp/tmpq45z_od3' != '/tmp/tmpq45z_od3'
- /var/tmp/tmpq45z_od3
? ----
+ /tmp/tmpq45z_od3

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 12:32:36 2019
From: report at bugs.python.org (Fabian Raab)
Date: Fri, 28 Jun 2019 16:32:36 +0000
Subject: [issue37287] picke cannot dump Exception subclasses with different
 super() args
In-Reply-To: <1560555045.5.0.822054090592.issue37287@roundup.psfhosted.org>
Message-ID: <1561739556.66.0.548208469141.issue37287@roundup.psfhosted.org>


Change by Fabian Raab <fabian at raab.link>:


----------
nosy: +raabf

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37287>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:00:06 2019
From: report at bugs.python.org (hai shi)
Date: Fri, 28 Jun 2019 17:00:06 +0000
Subject: [issue37441] Fix a param error in exceptions.rst
Message-ID: <1561741206.31.0.47580103034.issue37441@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

Due to https://github.com/python/cpython/blob/master/Python/errors.c#L845-L846,
`PyObject* PyErr_SetImportErrorSubclass(PyObject *msg, PyObject *name, PyObject *path)` should be  `PyObject* PyErr_SetImportErrorSubclass(PyObject *exception, PyObject *msg, PyObject *name, PyObject *path)`

----------
assignee: docs at python
components: Documentation
messages: 346836
nosy: docs at python, shihai1991
priority: normal
severity: normal
status: open
title: Fix a param error in exceptions.rst
type: behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37441>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:02:09 2019
From: report at bugs.python.org (hai shi)
Date: Fri, 28 Jun 2019 17:02:09 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561741329.65.0.284640568309.issue37411@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
pull_requests: +14269
pull_request: https://github.com/python/cpython/pull/14453

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:02:18 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 28 Jun 2019 17:02:18 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561741338.42.0.345659900356.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset db4d7ddb012ef8f087a8eb2a5b8a672d04a48e1a by Steve Dower in branch '3.7':
bpo-37369: Fixes path for sys.executable when running from the Microsoft Store (GH-14450)
https://github.com/python/cpython/commit/db4d7ddb012ef8f087a8eb2a5b8a672d04a48e1a


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:04:57 2019
From: report at bugs.python.org (hai shi)
Date: Fri, 28 Jun 2019 17:04:57 +0000
Subject: [issue37441] Fix a param error in exceptions.rst
In-Reply-To: <1561741206.31.0.47580103034.issue37441@roundup.psfhosted.org>
Message-ID: <1561741497.11.0.374904136831.issue37441@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +14270
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14453

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37441>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:08:58 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 28 Jun 2019 17:08:58 +0000
Subject: [issue37411] testEnviron (test.test_wsgiref.HandlerTests) fails when
 environment variable X is set
In-Reply-To: <1561550751.62.0.0941955504485.issue37411@roundup.psfhosted.org>
Message-ID: <1561741738.03.0.398053420076.issue37411@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests:  -14269

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37411>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:18:44 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 28 Jun 2019 17:18:44 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561742324.33.0.167994647511.issue24214@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks Ned, is there a general policy on regressions to be marked as release blocker, like if a regression that was made in 3.7.3 then it acts as a release blocker for 3.7.4 or is it based on severity? ?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:31:13 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 28 Jun 2019 17:31:13 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561743073.64.0.519334226047.issue24214@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

"The only changes allowed to occur in a maintenance branch without debate are bug fixes. Also, a general rule for maintenance branches is that compatibility must not be broken at any point between sibling minor releases (3.5.1, 3.5.2, etc.). For both rules, only rare exceptions are accepted and must be discussed first."

https://devguide.python.org/devcycle/#maintenance-branches

The principle here is that we "promise" users that they can upgrade from any version of 3.n.x to the latest version of 3.n without needing to make any changes except in very rare cases when there is an overriding concern and which must be well-documented in the release materials.  We're human so we sometimes slip up and inadvertently break that promise but that's the goal. And it's because of that promise that we can take the approach of immediately obsoleting previous older micro releases when a new micro release occurs, i.e. we don't provide fixes for 3.7.2 once 3.7.3 is released.

So, from my perspective, pretty much *any* regression between micro releases is a release blocker but especially in a case like this where it can be addressed before a final release.  That's basically why we do release candidates :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:33:33 2019
From: report at bugs.python.org (Michael Bejda)
Date: Fri, 28 Jun 2019 17:33:33 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1561743213.45.0.76206957137.issue37166@roundup.psfhosted.org>


Michael Bejda <mbejda at gmail.com> added the comment:

I do not believe it is specific to the way we package things:

$ cat a.py:
import inspect








def foo(): pass

inspect.getsource(foo)
$ python3 -m compileall -b a.py
$ black a.py  # to remove the empty lines
$ python3 a.pyc  # Index error
Traceback (most recent call last):
  File "a.py", line 12, in <module>
  File "/usr/local/fbcode/gcc-5-glibc-2.23/lib/python3.6/inspect.py", line 968, in getsource
    lines, lnum = getsourcelines(object)
  File "/usr/local/fbcode/gcc-5-glibc-2.23/lib/python3.6/inspect.py", line 955, in getsourcelines
    lines, lnum = findsource(object)
  File "/usr/local/fbcode/gcc-5-glibc-2.23/lib/python3.6/inspect.py", line 828, in findsource
    if pat.match(lines[lnum]): break
IndexError: list index out of range


You are correct, the heuristic may not return the correct function. However, if we are, for any reason, unable to detect the source mismatch, it would be better to return 0 line (for the beginning of the module) or raise a SystemError instead of an IndexError (which the user does not expect).

----------
nosy: +mib

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:35:32 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 17:35:32 +0000
Subject: [issue23014] Don't have importlib.abc.Loader.create_module() be
 optional
In-Reply-To: <1418055538.78.0.471721917483.issue23014@psf.upfronthosting.co.za>
Message-ID: <1561743332.16.0.0945722924194.issue23014@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Do realize the person who created and closed this issue is the one suggesting you open a new issue. ;) We can re-evaluate decisions and this one is 5 years old. Now I'm not making any promises that we will definitely change anything, but I'm not going to swoop in and immediately close it either.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue23014>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:38:33 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Fri, 28 Jun 2019 17:38:33 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561743513.93.0.867669229187.issue24214@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

Thanks Ned for the details, in future reports I will also try to add the respective release manager to the issue in case of regressions.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:39:51 2019
From: report at bugs.python.org (STINNER Victor)
Date: Fri, 28 Jun 2019 17:39:51 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561743591.97.0.00860095846648.issue37412@roundup.psfhosted.org>


STINNER Victor <vstinner at redhat.com> added the comment:


New changeset 29f609ed07aa7856741ff8b8b8b050369d0faf81 by Victor Stinner in branch 'master':
bpo-37412: Fix test_os.test_getcwd_long_path() on macOS (GH-14452)
https://github.com/python/cpython/commit/29f609ed07aa7856741ff8b8b8b050369d0faf81


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:45:53 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 28 Jun 2019 17:45:53 +0000
Subject: [issue24214] UTF-8 incremental decoder doesn't support surrogatepass
 correctly
In-Reply-To: <1431816994.33.0.797161516902.issue24214@psf.upfronthosting.co.za>
Message-ID: <1561743953.85.0.601060847348.issue24214@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

@xtreak, If you set the priority to "release blocker", the appropriate release managers will be nosied automatically.  I'd rather see too many potential "release blocker"s than too few.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue24214>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:46:00 2019
From: report at bugs.python.org (Michael Bejda)
Date: Fri, 28 Jun 2019 17:46:00 +0000
Subject: [issue37166] inspect.findsource doesn't handle shortened files
 gracefully
In-Reply-To: <1559763986.42.0.903204336475.issue37166@roundup.psfhosted.org>
Message-ID: <1561743960.91.0.197129604807.issue37166@roundup.psfhosted.org>


Michael Bejda <mbejda at gmail.com> added the comment:

I don't think linecache.checkcache helps here. In your example, it would detect the modification, but I don't see how it could persist data if the compilation and execution are different processes.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37166>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:47:50 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 17:47:50 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561744070.08.0.995994287122.issue37412@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14271
pull_request: https://github.com/python/cpython/pull/14454

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:57:20 2019
From: report at bugs.python.org (Mitar)
Date: Fri, 28 Jun 2019 17:57:20 +0000
Subject: [issue17239] XML vulnerabilities in Python
In-Reply-To: <1361288141.97.0.791394359972.issue17239@psf.upfronthosting.co.za>
Message-ID: <1561744640.53.0.731972118183.issue17239@roundup.psfhosted.org>


Change by Mitar <mmitar at gmail.com>:


----------
nosy: +mitar

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue17239>
_______________________________________

From report at bugs.python.org  Fri Jun 28 13:59:26 2019
From: report at bugs.python.org (Prateek Nayak)
Date: Fri, 28 Jun 2019 17:59:26 +0000
Subject: [issue37438] ConfigParser.set() docs should mention allow_no_value
In-Reply-To: <1561713800.79.0.286500391609.issue37438@roundup.psfhosted.org>
Message-ID: <1561744766.22.0.397039276263.issue37438@roundup.psfhosted.org>


Change by Prateek Nayak <lelouch.cpp at gmail.com>:


----------
keywords: +patch
pull_requests: +14272
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14455

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37438>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:00:17 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 28 Jun 2019 18:00:17 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561744817.4.0.588352239868.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14273
pull_request: https://github.com/python/cpython/pull/14456

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:01:56 2019
From: report at bugs.python.org (Akshay Takkar)
Date: Fri, 28 Jun 2019 18:01:56 +0000
Subject: [issue37404] asyncio sock_recv blocks on ssl sockets.
In-Reply-To: <1561491381.97.0.0488150062245.issue37404@roundup.psfhosted.org>
Message-ID: <1561744916.29.0.944676258825.issue37404@roundup.psfhosted.org>


Change by Akshay Takkar <akshay.takkar101 at gmail.com>:


----------
keywords: +patch
pull_requests: +14274
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14457

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37404>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:04:51 2019
From: report at bugs.python.org (Mitar)
Date: Fri, 28 Jun 2019 18:04:51 +0000
Subject: [issue37442] Minidom should not pretty-print inside text elements
Message-ID: <1561745091.45.0.280040726581.issue37442@roundup.psfhosted.org>


New submission from Mitar <mmitar at gmail.com>:

Inside text elements both in HTML and SVG white-space is significant and introduces differences in how things are rendered. By default in general all white-space is collapsed into one space and then this is rendered, adding additional text content.

I observed this while working with SVG which can have content like:

<text><tspan>foo</tspan><tspan>bar</tspan></text>

After pretty-printing it with minidom, and white-space collapsing, the following is what is input to SVG rendering:

<text> <tspan>foo</tspan> <tspan>bar</tspan> </text>

And space between "foo" and "bar" is now visible and while before it was one word to the user, now it is shown as two.

Related issue: https://github.com/mozman/svgwrite/issues/58

I think pretty-printing not add whitespace inside text elements.

----------
components: XML
messages: 346846
nosy: mitar
priority: normal
severity: normal
status: open
title: Minidom should not pretty-print inside text elements
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37442>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:07:15 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 18:07:15 +0000
Subject: [issue37412] os.getcwdb() doesn't implement PEP 528 (UTF-8) on Windows
In-Reply-To: <1561559287.43.0.39764403862.issue37412@roundup.psfhosted.org>
Message-ID: <1561745235.87.0.599265107978.issue37412@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e3761ca91cda86462206d60244078f05c636dd13 by Miss Islington (bot) in branch '3.8':
bpo-37412: Fix test_os.test_getcwd_long_path() on macOS (GH-14452)
https://github.com/python/cpython/commit/e3761ca91cda86462206d60244078f05c636dd13


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37412>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:12:53 2019
From: report at bugs.python.org (Ned Deily)
Date: Fri, 28 Jun 2019 18:12:53 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561745573.2.0.167135404745.issue37437@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

The expat update introduces unsightly build warnings:

gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -Wstrict-prototypes -Werror=implicit-function-declaration -I./Include/internal -DHAVE_EXPAT_CONFIG_H=1 -DXML_POOR_ENTROPY=1 -DUSE_PYEXPAT_CAPI -I/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat -I./Include -I. -I/Users/nad/Projects/PyDev/active/dev/3x/source/Include -I/Users/nad/Projects/PyDev/active/dev/3x/source -c /Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.c -o build/temp.macosx-10.14-x86_64-3.9/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.o -Wno-implicit-fallthrough
/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.c:3027:11: warning: code will never be executed
      [-Wunreachable-code]
          parser->m_characterDataHandler(parser->m_handlerArg, parser->m_dataBuf, 0);
          ^~~~~~
/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.c:3026:18: note: silence by adding parentheses to
      mark code as explicitly dead
        else if (0 && parser->m_characterDataHandler)
                 ^
                 /* DISABLES CODE */ ( )
/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.c:3728:9: warning: code will never be executed
      [-Wunreachable-code]
        parser->m_characterDataHandler(parser->m_handlerArg, parser->m_dataBuf, 0);
        ^~~~~~
/Users/nad/Projects/PyDev/active/dev/3x/source/Modules/expat/xmlparse.c:3727:16: note: silence by adding parentheses to
      mark code as explicitly dead
      else if (0 && parser->m_characterDataHandler)
               ^
               /* DISABLES CODE */ ( )
2 warnings generated.

----------
nosy: +ned.deily

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:30:41 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 28 Jun 2019 18:30:41 +0000
Subject: [issue37208] Weird exception behaviour in ProcessPoolExecutor
In-Reply-To: <1560078240.39.0.310143322777.issue37208@roundup.psfhosted.org>
Message-ID: <1561746641.28.0.207262565716.issue37208@roundup.psfhosted.org>


Change by Brian Quinlan <brian at sweetapp.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37208>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:41:59 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 28 Jun 2019 18:41:59 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561747319.63.0.871516288878.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset ed4657bd28432ace671a9e6ae38a3d485c69213d by Steve Dower in branch '3.7':
bpo-37369: Fix venv and test symlinking (GH-14456)
https://github.com/python/cpython/commit/ed4657bd28432ace671a9e6ae38a3d485c69213d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:50:54 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 28 Jun 2019 18:50:54 +0000
Subject: [issue37294] concurrent.futures.ProcessPoolExecutor and
 multiprocessing.pool.Pool fail with super
In-Reply-To: <1560620998.84.0.271411330169.issue37294@roundup.psfhosted.org>
Message-ID: <1561747854.55.0.231294466304.issue37294@roundup.psfhosted.org>


Change by Brian Quinlan <brian at sweetapp.com>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> function changed when pickle bound method object

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37294>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:54:58 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 28 Jun 2019 18:54:58 +0000
Subject: [issue31783] Race condition in ThreadPoolExecutor when scheduling new
 jobs while the interpreter shuts down
In-Reply-To: <1507930035.71.0.213398074469.issue31783@psf.upfronthosting.co.za>
Message-ID: <1561748098.92.0.384488189197.issue31783@roundup.psfhosted.org>


Brian Quinlan <brian at sweetapp.com> added the comment:


New changeset 242c26f53edb965e9808dd918089e664c0223407 by Brian Quinlan in branch 'master':
bpo-31783: Fix a race condition creating workers during shutdown (#13171)
https://github.com/python/cpython/commit/242c26f53edb965e9808dd918089e664c0223407


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31783>
_______________________________________

From report at bugs.python.org  Fri Jun 28 14:56:03 2019
From: report at bugs.python.org (Brian Quinlan)
Date: Fri, 28 Jun 2019 18:56:03 +0000
Subject: [issue31783] Race condition in ThreadPoolExecutor when scheduling new
 jobs while the interpreter shuts down
In-Reply-To: <1507930035.71.0.213398074469.issue31783@psf.upfronthosting.co.za>
Message-ID: <1561748163.47.0.542872080483.issue31783@roundup.psfhosted.org>


Change by Brian Quinlan <brian at sweetapp.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue31783>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:04:12 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:04:12 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
In-Reply-To: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>
Message-ID: <1561748652.97.0.464456590625.issue37403@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
keywords: +patch
pull_requests: +14275
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14458

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:08:30 2019
From: report at bugs.python.org (exploiterv)
Date: Fri, 28 Jun 2019 19:08:30 +0000
Subject: [issue37443] Python Returns NoneType when convert a string to a list
 and using sort() method
Message-ID: <1561748910.27.0.580168863817.issue37443@roundup.psfhosted.org>


New submission from exploiterv <exploiterv at gmail.com>:

Python Returns NoneType when convert a string to a list and using sort() method

# Example Code :

>>> string = "python"
>>> new_list = list(string.splitlines())                          >>> new_list
['python']
>>> type(new_list)
<class 'list'>
>>> print(type(new_list.sort()))
<class 'NoneType'>
>>> new_list
['python']
>>> new = new_list.sort()
>>> new
>>> type(new)
<class 'NoneType'>
>>>

----------
assignee: terry.reedy
components: IDLE, Interpreter Core
messages: 346851
nosy: exploiterv, terry.reedy
priority: normal
severity: normal
status: open
title: Python Returns NoneType when convert a string to a list and using sort() method
type: compile error
versions: Python 3.5, Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:14:34 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:14:34 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
In-Reply-To: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>
Message-ID: <1561749274.5.0.301883039044.issue37403@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:


New changeset f9f8e3ce709ceb15c8db8c8dde940daf1febf13d by Brett Cannon in branch 'master':
bpo-37403: Touch up venv docs (GH-14458)
https://github.com/python/cpython/commit/f9f8e3ce709ceb15c8db8c8dde940daf1febf13d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:14:48 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 19:14:48 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
In-Reply-To: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>
Message-ID: <1561749288.22.0.563345776127.issue37403@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14276
pull_request: https://github.com/python/cpython/pull/14459

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:17:56 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 28 Jun 2019 19:17:56 +0000
Subject: [issue37443] Python Returns NoneType when convert a string to a list
 and using sort() method
In-Reply-To: <1561748910.27.0.580168863817.issue37443@roundup.psfhosted.org>
Message-ID: <1561749476.04.0.19568079911.issue37443@roundup.psfhosted.org>


SilentGhost <ghost.adh at runbox.com> added the comment:

Yes, as documented .sort method mutates object in place and returns None.

----------
assignee: terry.reedy -> 
components:  -IDLE
nosy: +SilentGhost -terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:19:01 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:19:01 +0000
Subject: [issue37409] relative import without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561749541.01.0.0298364592737.issue37409@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
versions: +Python 3.8, Python 3.9 -Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:19:05 2019
From: report at bugs.python.org (Isaul Vargas)
Date: Fri, 28 Jun 2019 19:19:05 +0000
Subject: [issue37443] Python Returns NoneType when convert a string to a list
 and using sort() method
In-Reply-To: <1561748910.27.0.580168863817.issue37443@roundup.psfhosted.org>
Message-ID: <1561749545.53.0.763311009841.issue37443@roundup.psfhosted.org>


Isaul Vargas <isaulv at gmail.com> added the comment:

There is no bug.
It's a bit confusing that the method sort on a list object returns None, but it is doing an in-place, (in memory) sort of the list, thus modifying the list. 

The function sorted however, will return a new list object.

The following interpreter session will show this:
>>> l = [3, 2, 1]
>>> type(l.sort())
<class 'NoneType'>
>>> print(l)
[1, 2, 3]
>>> new_list = [7, 5, 4]
>>> sorted(new_list)
[4, 5, 7]
>>> new_list
[7, 5, 4]

----------
assignee:  -> terry.reedy
components: +IDLE
nosy: +Dude-X, terry.reedy -SilentGhost
type: behavior -> compile error

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:19:50 2019
From: report at bugs.python.org (SilentGhost)
Date: Fri, 28 Jun 2019 19:19:50 +0000
Subject: [issue37443] Python Returns NoneType when convert a string to a list
 and using sort() method
In-Reply-To: <1561748910.27.0.580168863817.issue37443@roundup.psfhosted.org>
Message-ID: <1561749590.44.0.719457066451.issue37443@roundup.psfhosted.org>


Change by SilentGhost <ghost.adh at runbox.com>:


----------
assignee: terry.reedy -> 
components:  -IDLE
nosy: +SilentGhost -terry.reedy
type: compile error -> behavior

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37443>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:22:13 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:22:13 +0000
Subject: [issue37444] Differing exception between builtins and importlib when
 importing beyond top-level package
Message-ID: <1561749733.32.0.955430999512.issue37444@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

builtins.__import__() raises ValueError (as it did in Python 2.7) while importlib.__import__() raises ImportError (which makes more sense to me).

Found by Ben Lewis.

----------
components: Interpreter Core, Library (Lib)
messages: 346855
nosy: Ben Lewis2, brett.cannon, eric.snow, ncoghlan
priority: normal
severity: normal
status: open
title: Differing exception between builtins and importlib when importing beyond top-level package
versions: Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37444>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:22:37 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:22:37 +0000
Subject: [issue37409] relative import without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561749757.84.0.640808840655.issue37409@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

I opened bpo-37444 for the relative import beyond top-level package issue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:25:37 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:25:37 +0000
Subject: [issue37409] relative import without parent
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561749937.39.0.741276966272.issue37409@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

The code doing the sanity check for importlib can be found at https://github.com/python/cpython/blob/f9f8e3ce709ceb15c8db8c8dde940daf1febf13d/Lib/importlib/_bootstrap.py#L943-L948 .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:26:11 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:26:11 +0000
Subject: [issue37444] Differing exception between builtins and importlib when
 importing beyond top-level package
In-Reply-To: <1561749733.32.0.955430999512.issue37444@roundup.psfhosted.org>
Message-ID: <1561749971.47.0.619921556967.issue37444@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Importllib code raising the exception is https://github.com/python/cpython/blob/f9f8e3ce709ceb15c8db8c8dde940daf1febf13d/Lib/importlib/_bootstrap.py#L874-L876 .

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37444>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:26:57 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:26:57 +0000
Subject: [issue37444] Differing exception between builtins and importlib when
 importing beyond top-level package
In-Reply-To: <1561749733.32.0.955430999512.issue37444@roundup.psfhosted.org>
Message-ID: <1561750017.2.0.642453987711.issue37444@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

I think this should be an ImportError and so that means builtins.__import__() is wrong. Anyone want to argue for the other side?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37444>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:28:02 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:28:02 +0000
Subject: [issue37444] Differing exception between builtins and importlib when
 importing beyond top-level package
In-Reply-To: <1561749733.32.0.955430999512.issue37444@roundup.psfhosted.org>
Message-ID: <1561750082.99.0.956931080439.issue37444@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

import.c code raising the exception: https://github.com/python/cpython/blob/f9f8e3ce709ceb15c8db8c8dde940daf1febf13d/Python/import.c#L1675-L1677

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37444>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:28:23 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:28:23 +0000
Subject: [issue37409] relative import without parent succeeds with
 builtins.__import__
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561750103.1.0.0457445478831.issue37409@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
title: relative import without parent -> relative import without parent succeeds with builtins.__import__

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:33:51 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 28 Jun 2019 19:33:51 +0000
Subject: [issue37409] relative import without parent succeeds with
 builtins.__import__
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561750431.21.0.476242306453.issue37409@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:34:38 2019
From: report at bugs.python.org (Serhiy Storchaka)
Date: Fri, 28 Jun 2019 19:34:38 +0000
Subject: [issue37444] Differing exception between builtins and importlib when
 importing beyond top-level package
In-Reply-To: <1561749733.32.0.955430999512.issue37444@roundup.psfhosted.org>
Message-ID: <1561750478.82.0.443636460091.issue37444@roundup.psfhosted.org>


Change by Serhiy Storchaka <storchaka+cpython at gmail.com>:


----------
nosy: +serhiy.storchaka

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37444>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:34:59 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:34:59 +0000
Subject: [issue37409] relative import without parent succeeds with
 builtins.__import__
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561750499.23.0.270390006821.issue37409@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

If you run with `-Xdev`/warnings turned on you get an idea of what's happening:

>>> builtins.__import__('', globals(), locals(), ('foo',), 1)
<stdin>:1: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__
<module '__main__' (built-in)>

The check is being done in resolve_name() in import.c (https://github.com/python/cpython/blob/f9f8e3ce709ceb15c8db8c8dde940daf1febf13d/Python/import.c#L1543). My guess is there's an off-by-one error in the sanity check logic for attempting a relative import beyond the top-level package.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:36:14 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 19:36:14 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
In-Reply-To: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>
Message-ID: <1561750574.58.0.0204061857288.issue37403@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 0cba121029bae0a891b02c493cb77633620701be by Miss Islington (bot) in branch '3.8':
bpo-37403: Touch up venv docs (GH-14458)
https://github.com/python/cpython/commit/0cba121029bae0a891b02c493cb77633620701be


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:36:31 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:36:31 +0000
Subject: [issue37403] Recommend .venv for virtual environment names
In-Reply-To: <1561489912.98.0.436599112257.issue37403@roundup.psfhosted.org>
Message-ID: <1561750591.02.0.6997382941.issue37403@roundup.psfhosted.org>


Change by Brett Cannon <brett at python.org>:


----------
resolution:  -> fixed
stage: patch review -> needs patch
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37403>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:37:14 2019
From: report at bugs.python.org (miss-islington)
Date: Fri, 28 Jun 2019 19:37:14 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561750634.63.0.655023911271.issue19696@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 80097e089ba22a42d804e65fbbcf35e5e49eed00 by Miss Islington (bot) (Kyle Stanley) in branch 'master':
bpo-19696: Moved "test_pkgimport.py" to dir "test_importlib" (GH-14303)
https://github.com/python/cpython/commit/80097e089ba22a42d804e65fbbcf35e5e49eed00


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 28 15:38:41 2019
From: report at bugs.python.org (Brett Cannon)
Date: Fri, 28 Jun 2019 19:38:41 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561750721.47.0.0888849792143.issue19696@roundup.psfhosted.org>


Brett Cannon <brett at python.org> added the comment:

Thanks for the PR, aeros167! BTW, if you want to open a new issue and modernize the tests to use importlib directly that would be great!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:04:31 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 21:04:31 +0000
Subject: [issue37367] octal escapes applied inconsistently throughout the
 interpreter and lib
In-Reply-To: <1561146368.97.0.686299796922.issue37367@roundup.psfhosted.org>
Message-ID: <1561755871.27.0.419671095779.issue37367@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

https://docs.python.org/3/reference/lexical_analysis.html#string-and-bytes-literals
says, for \ooo, "In a bytes literal, hexadecimal and octal escapes denote the byte with the given value. In a string literal, these escapes denote a Unicode character with the given value."

I agree that sometimes truncating an invalid integer instead of always raising ValueError is strange.

>>> ord(b'\407')
7
>>> bytes((0o407,))
...
ValueError: bytes must be in range(0, 256)

I don't know is there was an intentional back-compatibility reason for this.

Without an example of re raising, I don't understand the re complaint.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37367>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:12:20 2019
From: report at bugs.python.org (Ben Lewis)
Date: Fri, 28 Jun 2019 21:12:20 +0000
Subject: [issue37409] relative import without parent succeeds with
 builtins.__import__
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561756340.74.0.994116983804.issue37409@roundup.psfhosted.org>


Ben Lewis <benjamin.r.lewis at gmail.com> added the comment:

I'll look into this further and open a PR initially for the regression tests.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:17:23 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 21:17:23 +0000
Subject: [issue37422] Documentation on the change of __path__ in Python 3
In-Reply-To: <1561592764.17.0.159166057812.issue37422@roundup.psfhosted.org>
Message-ID: <1561756643.55.0.85391064344.issue37422@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
versions: +Python 3.8, Python 3.9 -Python 3.5, Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37422>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:19:47 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 21:19:47 +0000
Subject: [issue37426] getpass.getpass not working with on windows when ctrl+v
 is used to enter the string
In-Reply-To: <1561628977.4.0.232389584594.issue37426@roundup.psfhosted.org>
Message-ID: <1561756787.34.0.146610864237.issue37426@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

If anything, this seems to be a getpass doc issue.

----------
assignee:  -> docs at python
components: +Documentation -Library (Lib), Windows
nosy: +docs at python, terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37426>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:38:46 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 28 Jun 2019 21:38:46 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561757926.14.0.0947753088103.issue37434@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:

Could also be a bug in however protobuf handles exceptions on module initialization.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Fri Jun 28 17:38:58 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Fri, 28 Jun 2019 21:38:58 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561757938.51.0.600576477632.issue37434@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
status:  -> open

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:04:26 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 22:04:26 +0000
Subject: [issue37427] sorted,
 list.sort reject non-boolean objects with __bool__() as `reverse`
 parameter
In-Reply-To: <1561629105.71.0.460566565999.issue37427@roundup.psfhosted.org>
Message-ID: <1561759466.24.0.981110074164.issue37427@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Not a bug.  Both function docs say "reverse is a boolean value."
https://docs.python.org/3/library/stdtypes.html#boolean-values
says "Boolean values are the two constant objects False and True."  These should be used in new code.

For compatibility with old code, CPython generally allows 0 and 1.  In this case, it allows any 'integral value', but I would not necessarily expect this of other implementations.

[In general, the *Python language* docs do not document extra latitude allowed by the *CPython implementation*.  So the lack thereof here is also not a bug.]

All objects without fancy trickery have a __bool__ method, either inherited from *object* or overridden.  This in no way makes all such objects, including Xs, into boolean values.

----------
nosy: +terry.reedy
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed
title: sorted() and list.sort() don't accept non-boolean objects with __bool__() as `reverse` parameter -> sorted, list.sort reject non-boolean objects with __bool__() as `reverse` parameter

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37427>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:11:50 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 22:11:50 +0000
Subject: [issue32912] Raise non-silent warning for invalid escape sequences
In-Reply-To: <1519324497.82.0.467229070634.issue32912@psf.upfronthosting.co.za>
Message-ID: <1561759910.5.0.155066602718.issue32912@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

The 'filled my terminal with spaces' bug mentioned in msg344764 was independently reported in #37433, with a PR.

----------
nosy: +terry.reedy

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32912>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:26:15 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Fri, 28 Jun 2019 22:26:15 +0000
Subject: [issue26468] shutil.copy2 raises OSError if filesystem doesn't
 support chmod
In-Reply-To: <1456910519.95.0.44073308632.issue26468@psf.upfronthosting.co.za>
Message-ID: <1561760775.29.0.360533390948.issue26468@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy:  -Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26468>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:29:12 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 22:29:12 +0000
Subject: [issue37433] syntax error in multiline f-string produces ~40k spaces
 output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561760952.39.0.912464158753.issue37433@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

On Windows 10 with current 3.8 I see correct output, so the bug seems OS specific, even though the simple fix (see PR) is not.

C:\Users\Terry>py f:/python/a/tem4.py
  File "f:/python/a/tem4.py", line 1
    f'''{}
    ^
SyntaxError: f-string: empty expression not allowed

----------
nosy: +terry.reedy
title: syntax error in f-string in multiline string produces ~40k spaces of output -> syntax error in multiline f-string produces ~40k spaces output

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:31:52 2019
From: report at bugs.python.org (Anthony Sottile)
Date: Fri, 28 Jun 2019 22:31:52 +0000
Subject: [issue37433] syntax error in multiline f-string produces ~40k spaces
 output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561761112.0.0.928589018259.issue37433@roundup.psfhosted.org>


Anthony Sottile <asottile at umich.edu> added the comment:

just an f-string doesn't trigger this, there needs to be tokens before it

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Fri Jun 28 18:41:18 2019
From: report at bugs.python.org (Paul Monson)
Date: Fri, 28 Jun 2019 22:41:18 +0000
Subject: [issue36511] Add Windows ARM32 buildbot
In-Reply-To: <1554232161.58.0.393661272603.issue36511@roundup.psfhosted.org>
Message-ID: <1561761678.82.0.354501360195.issue36511@roundup.psfhosted.org>


Change by Paul Monson <paulmons at gmail.com>:


----------
pull_requests: +14277
pull_request: https://github.com/python/cpython/pull/14460

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36511>
_______________________________________

From report at bugs.python.org  Fri Jun 28 19:22:20 2019
From: report at bugs.python.org (Steve Dower)
Date: Fri, 28 Jun 2019 23:22:20 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561764140.63.0.119311247714.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14278
pull_request: https://github.com/python/cpython/pull/14461

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Fri Jun 28 19:47:37 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 23:47:37 +0000
Subject: [issue37433] syntax error in multiline f-string produces ~40k spaces
 output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561765657.0.0.297603366602.issue37433@roundup.psfhosted.org>


Change by Terry J. Reedy <tjreedy at udel.edu>:


----------
Removed message: https://bugs.python.org/msg346872

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Fri Jun 28 19:48:01 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 23:48:01 +0000
Subject: [issue37433] syntax error in multiline f-string produces ~40k spaces
 output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561760952.39.0.912464158753.issue37433@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

On Windows 10 with current 3.8 I see correct output, so the bug seems OS specific, even though the simple fix (see PR) is not.

C:\Users\Terry>py f:/python/a/tem4.py
  File "f:/python/a/tem4.py", line 1
    f'''{}
    ^
SyntaxError: f-string: empty expression not allowed

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Fri Jun 28 19:51:32 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Fri, 28 Jun 2019 23:51:32 +0000
Subject: [issue37433] syntax error in multiline f-string produces ~40k spaces
 output
In-Reply-To: <1561659761.86.0.416757939602.issue37433@roundup.psfhosted.org>
Message-ID: <1561765892.64.0.197146047139.issue37433@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

OK, very obnoxious.  Fix restores behavior above.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37433>
_______________________________________

From report at bugs.python.org  Fri Jun 28 19:58:58 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Fri, 28 Jun 2019 23:58:58 +0000
Subject: [issue37445] Some FormatMessageW() calls use
 FORMAT_MESSAGE_FROM_SYSTEM without FORMAT_MESSAGE_IGNORE_INSERTS
Message-ID: <1561766338.66.0.394752973171.issue37445@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

As mentioned in bpo-26493, some FormatMessageW() calls use the FORMAT_MESSAGE_FROM_SYSTEM flag without FORMAT_MESSAGE_IGNORE_INSERTS. This will cause FormatMessageW() to fail if there are insert sequences in the message definition.

I will create a PR for this issue.

----------
components: Extension Modules, Windows
messages: 346875
nosy: ZackerySpytz, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Some FormatMessageW() calls use FORMAT_MESSAGE_FROM_SYSTEM without FORMAT_MESSAGE_IGNORE_INSERTS
versions: Python 2.7, Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37445>
_______________________________________

From report at bugs.python.org  Fri Jun 28 20:13:15 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 29 Jun 2019 00:13:15 +0000
Subject: [issue37445] Some FormatMessageW() calls use
 FORMAT_MESSAGE_FROM_SYSTEM without FORMAT_MESSAGE_IGNORE_INSERTS
In-Reply-To: <1561766338.66.0.394752973171.issue37445@roundup.psfhosted.org>
Message-ID: <1561767195.83.0.732633332967.issue37445@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +14279
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14462

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37445>
_______________________________________

From report at bugs.python.org  Fri Jun 28 20:58:10 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sat, 29 Jun 2019 00:58:10 +0000
Subject: [issue37446] Undefined behavior in Python/hamt.c
Message-ID: <1561769890.8.0.709429549859.issue37446@roundup.psfhosted.org>


New submission from Zackery Spytz <zspytz at gmail.com>:

./python -m unittest test.test_context.HamtTest.test_hamt_stress
Python/hamt.c:1867:29: runtime error: left shift of 1 by 31 places cannot be represented in type 'int'
.
----------------------------------------------------------------------
Ran 1 test in 12.702s

OK

----------
components: Interpreter Core
messages: 346876
nosy: ZackerySpytz, yselivanov
priority: normal
severity: normal
status: open
title: Undefined behavior in Python/hamt.c
type: behavior
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37446>
_______________________________________

From report at bugs.python.org  Fri Jun 28 21:05:28 2019
From: report at bugs.python.org (Jeffrey Kintscher)
Date: Sat, 29 Jun 2019 01:05:28 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561770328.08.0.41044630589.issue37399@roundup.psfhosted.org>


Change by Jeffrey Kintscher <websurfer at surf2c.net>:


----------
nosy: +Jeffrey.Kintscher

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Sat Jun 29 00:30:56 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 04:30:56 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561782656.14.0.872433862491.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset db4eb2c57dbfca402a539184c966c449cb1aa8e3 by Steve Dower in branch '3.7':
bpo-37369: Fix path handling when python.exe is used as a symlink (GH-14461)
https://github.com/python/cpython/commit/db4eb2c57dbfca402a539184c966c449cb1aa8e3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 06:02:52 2019
From: report at bugs.python.org (Eric V. Smith)
Date: Sat, 29 Jun 2019 10:02:52 +0000
Subject: [issue37357] mbox From line wrongly detected
In-Reply-To: <1561106690.17.0.233145774515.issue37357@roundup.psfhosted.org>
Message-ID: <1561802572.24.0.79133563016.issue37357@roundup.psfhosted.org>


Change by Eric V. Smith <eric at trueblade.com>:


----------
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37357>
_______________________________________

From report at bugs.python.org  Sat Jun 29 07:57:21 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Sat, 29 Jun 2019 11:57:21 +0000
Subject: [issue36422] tempfile.TemporaryDirectory() removes entire directory
 tree even if it's a mount-point
In-Reply-To: <1553512605.72.0.860422023516.issue36422@roundup.psfhosted.org>
Message-ID: <1561809441.1.0.660823135731.issue36422@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

> in case a filesystem has been mounted on the temporary directory, this can lead to the entire filesystem being removed

-1

That is expected behavior and the use case looks pretty unusual. Such a new parameter wouldn't even be supported by other "batteries" since there's no portable/standard way to either mount or unmount a directory (in fact you had to use a subprocess in your unit-tests).

A `delete=bool` parameter would be a more reasonable proposal in principle but:
1) if you want to keep the directory around then you can just use tempfile.mkdtemp() (see "there should preferably be only one way to do it")
2) it would conflict with the context manager usage which is expected to delete the dir on ctx manager exit

In summary, I think this would over-complicate the API for no good reason. 
I'm closing this out as rejected.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9 -Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36422>
_______________________________________

From report at bugs.python.org  Sat Jun 29 08:00:11 2019
From: report at bugs.python.org (Giampaolo Rodola')
Date: Sat, 29 Jun 2019 12:00:11 +0000
Subject: [issue37366] Add an "onitem" callback parameter to shutil.rmtree()
In-Reply-To: <1561145152.44.0.980248626511.issue37366@roundup.psfhosted.org>
Message-ID: <1561809611.88.0.0143004992968.issue37366@roundup.psfhosted.org>


Giampaolo Rodola' <g.rodola at gmail.com> added the comment:

I'm gonna reject this one, sorry Jeffrey. Reasons given in https://bugs.python.org/issue36422#msg346878 also apply here.

----------
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37366>
_______________________________________

From report at bugs.python.org  Sat Jun 29 08:59:02 2019
From: report at bugs.python.org (Ned Deily)
Date: Sat, 29 Jun 2019 12:59:02 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561813142.73.0.637536846374.issue37428@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Christian, do you have an estimate for when these issues will be resolved?  We are holding 3.7.4 right now.

----------
nosy: +benjamin.peterson, lukasz.langa
priority: deferred blocker -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Sat Jun 29 09:43:58 2019
From: report at bugs.python.org (Roundup Robot)
Date: Sat, 29 Jun 2019 13:43:58 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1561815838.74.0.798915216837.issue36656@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14280
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14464

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Sat Jun 29 09:53:53 2019
From: report at bugs.python.org (Tom Hale)
Date: Sat, 29 Jun 2019 13:53:53 +0000
Subject: [issue36656] Please add race-free os.link and os.symlink wrapper /
 helper
In-Reply-To: <1555577087.92.0.769196427693.issue36656@roundup.psfhosted.org>
Message-ID: <1561816433.75.0.576449419692.issue36656@roundup.psfhosted.org>


Tom Hale <tomnott at gmail.com> added the comment:

I've created a PR here:

https://github.com/python/cpython/pull/14464

Only shutil.symlink is currently implemented.

Feedback sought from Windows users.

@Michael.Felt please note that `overwrite=False` is the default.

@taleinat I hope that the new implementation addresses the infinite loop concern.

Please be both thorough and gentle - this is my first PR.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36656>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:27:20 2019
From: report at bugs.python.org (aeros167)
Date: Sat, 29 Jun 2019 15:27:20 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561822040.18.0.289827128834.issue19696@roundup.psfhosted.org>


aeros167 <aeros167 at gmail.com> added the comment:

> Thanks for the PR, aeros167! BTW, if you want to open a new issue and modernize the tests to use importlib directly that would be great!

Sounds good, I'll definitely look into doing that after finishing up this issue. Was waiting the previous PR to be merged before replacing the deprecated method "random.choose" with "random.choice" in "test_pkg_import.py" and then also moving the other two into test_importlib. 

Thank you very much for the timely feedback. This has been a great experience for learning to contribute to larger open source projects. It's been an aspiration of mine to give back to Python, as it was my first serious programming language 5 years ago. This may be an incredibly minor contribution in the grand scheme of things, but my goal is for it to be the first of many (:

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:31:31 2019
From: report at bugs.python.org (Pradnyan)
Date: Sat, 29 Jun 2019 15:31:31 +0000
Subject: [issue37447] Nested For Loop in Python not working as Expected after
 cnt=2136
Message-ID: <1561822291.08.0.367719243593.issue37447@roundup.psfhosted.org>


New submission from Pradnyan <paraakash at gmail.com>:

I have come across very strange Python bug in nested for loops:
See below nested for loop with range function and its not working as expected.

It worked fine until cnt=2136 and start giving unexpected output after that. 

As per logic y value should get incremented for every x value but after cnt=2136 the y value remains 0 and x gets incremented and also
code did not stop for cnt>2137 and it halts only at 5352.

I have attached actual python code and its output. This code is executed on latest python build 3.7.3

Erroneous output 
================================================================
cnt=2134 y=2133 x=0
cnt=2135 y=2134 x=0
cnt=2136 y=2135 x=0
cnt=2137 y=0 x=1
cnt=2138 y=1 x=1
cnt=2139 y=0 x=2
cnt=2140 y=0 x=3
cnt=2141 y=0 x=4

==================================================================
==================================================================
Python code:
==================================================================
 cnt=0
    for x in range(3216):
        for y in range(2136):
            cnt = cnt + 1
            #print("y="+str(y)+" x="+str(x)+" pixel="+str(im_ary[y,x]))
            print("cnt="+str(cnt)+" y=" + str(y) + " x=" + str(x) )
            if cnt>2137 :
                break

=================================================================

----------
components: Build
files: Pyton_For_Loop_issue.zip
messages: 346884
nosy: anthonybaxter, barry, benjamin.peterson, eric.araujo, ezio.melotti, georg.brandl, gvanrossum, lemburg, mdk, ned.deily, pradnyan, tarek
priority: normal
severity: normal
status: open
title: Nested For Loop in Python not working as Expected after cnt=2136
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48444/Pyton_For_Loop_issue.zip

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37447>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:33:54 2019
From: report at bugs.python.org (Michele Angrisano)
Date: Sat, 29 Jun 2019 15:33:54 +0000
Subject: [issue37446] Undefined behavior in Python/hamt.c
In-Reply-To: <1561769890.8.0.709429549859.issue37446@roundup.psfhosted.org>
Message-ID: <1561822434.5.0.895572066042.issue37446@roundup.psfhosted.org>


Michele Angrisano <michele.angrisano at gmail.com> added the comment:

I don't get that output on 3.8.0a4+. I'm on OSX.
Anyway, I think that 1 should be cast with unsigned.

What do you think?

----------
nosy: +mangrisano

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37446>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:47:58 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sat, 29 Jun 2019 15:47:58 +0000
Subject: [issue37447] Nested For Loop in Python not working as Expected after
 cnt=2136
In-Reply-To: <1561822291.08.0.367719243593.issue37447@roundup.psfhosted.org>
Message-ID: <1561823278.89.0.929410878762.issue37447@roundup.psfhosted.org>


Karthikeyan Singaravelan <tir.karthi at gmail.com> added the comment:

@pradnyan The break statement [0] only exits the for loop where it's present in this the one where y is involved so the outer loop involving x will continue to execute. So after every attempt where y = 0 the cnt value succeeds and breaks out of the loop. I think this is a problem with the logic that you want to refactor and not a problem with CPython.

def test():
    cnt=0
    for x in range(3216):
        for y in range(2136):
            cnt = cnt + 1
            print("cnt="+str(cnt)+" y=" + str(y) + " x=" + str(x) )
            if cnt > 2137 : 
                break # Break only out of "for y in in range(2136)"

In future reports please also don't add many people to the nosy list.

[0] https://docs.python.org/3/tutorial/controlflow.html#break-and-continue-statements-and-else-clauses-on-loops

----------
nosy: +xtreak
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37447>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:49:49 2019
From: report at bugs.python.org (Ben Lewis)
Date: Sat, 29 Jun 2019 15:49:49 +0000
Subject: [issue37409] relative import without parent succeeds with
 builtins.__import__
In-Reply-To: <1561540286.77.0.471225789226.issue37409@roundup.psfhosted.org>
Message-ID: <1561823389.7.0.940250951502.issue37409@roundup.psfhosted.org>


Change by Ben Lewis <benjamin.r.lewis at gmail.com>:


----------
keywords: +patch
pull_requests: +14282
stage: test needed -> patch review
pull_request: https://github.com/python/cpython/pull/14465

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37409>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:56:46 2019
From: report at bugs.python.org (aeros167)
Date: Sat, 29 Jun 2019 15:56:46 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561823806.43.0.00522924750047.issue19696@roundup.psfhosted.org>


Change by aeros167 <aeros167 at gmail.com>:


----------
pull_requests: +14283
pull_request: https://github.com/python/cpython/pull/14466

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Sat Jun 29 11:59:20 2019
From: report at bugs.python.org (Terry J. Reedy)
Date: Sat, 29 Jun 2019 15:59:20 +0000
Subject: [issue37430] range is not a built-in function
In-Reply-To: <1561649972.91.0.461406342746.issue37430@roundup.psfhosted.org>
Message-ID: <1561823960.25.0.448472398991.issue37430@roundup.psfhosted.org>


Terry J. Reedy <tjreedy at udel.edu> added the comment:

Then it appears the indexing could also be improved.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37430>
_______________________________________

From report at bugs.python.org  Sat Jun 29 12:04:59 2019
From: report at bugs.python.org (aeros167)
Date: Sat, 29 Jun 2019 16:04:59 +0000
Subject: [issue19696] Merge all (non-syntactic) import-related tests into
 test_importlib
In-Reply-To: <1385136285.91.0.72176568785.issue19696@psf.upfronthosting.co.za>
Message-ID: <1561824299.84.0.508533475998.issue19696@roundup.psfhosted.org>


aeros167 <aeros167 at gmail.com> added the comment:

Created a new PR replacing the deprecated method "random.choose" with "random.choice" in "test_pkg_import.py" (https://github.com/python/cpython/pull/14466).

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue19696>
_______________________________________

From report at bugs.python.org  Sat Jun 29 13:11:18 2019
From: report at bugs.python.org (Ruslan Kuprieiev)
Date: Sat, 29 Jun 2019 17:11:18 +0000
Subject: [issue37380] subprocess.Popen._cleanup() "The handle is invalid"
 error when some old process is gone
In-Reply-To: <1561315344.64.0.509844893886.issue37380@roundup.psfhosted.org>
Message-ID: <1561828278.18.0.95329229277.issue37380@roundup.psfhosted.org>


Ruslan Kuprieiev <kupruser at gmail.com> added the comment:

The `_active` code is pretty old and has not changed since 2.7, so it makes sense to backport it for now(also, should be very trivial to do that). To me, it doesn't seem dangerous to backport that, but I would love to hear what Eryk and others think :)

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37380>
_______________________________________

From report at bugs.python.org  Sat Jun 29 13:34:19 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 17:34:19 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561829659.29.0.339887445818.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 9048c49322a5229ff99610aba35913ffa295ebb7 by Steve Dower in branch 'master':
bpo-37369: Fix initialization of sys members when launched via an app container (GH-14428)
https://github.com/python/cpython/commit/9048c49322a5229ff99610aba35913ffa295ebb7


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 13:36:26 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 17:36:26 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561829786.82.0.95786930993.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14284
pull_request: https://github.com/python/cpython/pull/14467

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 13:50:20 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sat, 29 Jun 2019 17:50:20 +0000
Subject: [issue7202] "python setup.py cmd --verbose" does not set verbosity
In-Reply-To: <1256481428.97.0.691214379627.issue7202@psf.upfronthosting.co.za>
Message-ID: <1561830620.76.0.863489345936.issue7202@roundup.psfhosted.org>


Avinash Sajjanshetty <avinashsajjan at gmail.com> added the comment:

I would like to take this up task and propose a patch. However, I am not able to reproduce this issue on my machine (3.7.1). Does the issue seem to be fixed?

Here is what I tried: 

1. 

python setup.py --verbose build

I got the verbose build, as expected. 

2. 

python setup.py build --verbose 

In this case, it seems to have ignored the verbose option, as I got a normal (non-verbose) output. 

3. since the issue is with `verbose`, I tried quiet. 

python setup.py --quiet build

I got a quiet build. 

4. 

python setup.py build --quiet 


it ignored the quiet option, as I got a normal output.


5. I also tried a non-existent option. In the following both cases, I got an error saying 

error: option --qqqp not recognized


for 


python setup.py --qqqp build


and 


python setup.py build --qqqp

----------
nosy: +avi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue7202>
_______________________________________

From report at bugs.python.org  Sat Jun 29 13:59:19 2019
From: report at bugs.python.org (Mitar)
Date: Sat, 29 Jun 2019 17:59:19 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561831159.22.0.491096744948.issue37374@roundup.psfhosted.org>


Mitar <mmitar at gmail.com> added the comment:

Sure, but is old behavior useful in any use case? Every bugfix changes old behavior in an irreversible way.

So in which use case you want the old behavior? Can you elaborate here?

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 29 14:08:16 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sat, 29 Jun 2019 18:08:16 +0000
Subject: [issue18108] shutil.chown should support dir_fd and follow_symlinks
 keyword arguments
In-Reply-To: <1370005797.04.0.715885093574.issue18108@psf.upfronthosting.co.za>
Message-ID: <1561831696.89.0.60703998637.issue18108@roundup.psfhosted.org>


Avinash Sajjanshetty <hi at avi.im> added the comment:

I was looking for an easy patch to submit. I can take an attempt at this?

----------
nosy: +avi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue18108>
_______________________________________

From report at bugs.python.org  Sat Jun 29 14:19:08 2019
From: report at bugs.python.org (Daniel Hilst Selli)
Date: Sat, 29 Jun 2019 18:19:08 +0000
Subject: [issue37374] Minidom does not have to escape quote inside text
 segments
In-Reply-To: <1561235660.5.0.339736322709.issue37374@roundup.psfhosted.org>
Message-ID: <1561832348.94.0.177763635604.issue37374@roundup.psfhosted.org>


Daniel Hilst Selli <danielhilst at gmail.com> added the comment:

Not really, I don't have a use case here. I'm just warning that this would break user code that relies on old behavior.

Anyway is possible to add new behavior without changing the old one. A parameter would make this possible, for example.

This is only my opinion, let's other argue too

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37374>
_______________________________________

From report at bugs.python.org  Sat Jun 29 15:33:34 2019
From: report at bugs.python.org (Ned Deily)
Date: Sat, 29 Jun 2019 19:33:34 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1561836814.09.0.560675728737.issue37440@roundup.psfhosted.org>


Change by Ned Deily <nad at python.org>:


----------
nosy: +benjamin.peterson, lukasz.langa
priority: deferred blocker -> release blocker

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Sat Jun 29 15:34:56 2019
From: report at bugs.python.org (Ned Deily)
Date: Sat, 29 Jun 2019 19:34:56 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1561836896.02.0.987128141708.issue37440@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:

Blocking 3.7.4 final pending resolution

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Sat Jun 29 16:08:36 2019
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 29 Jun 2019 20:08:36 +0000
Subject: [issue36168] DOC: Fix capitalization in string.rst
In-Reply-To: <1551529262.87.0.31703753151.issue36168@roundup.psfhosted.org>
Message-ID: <1561838916.97.0.72102039666.issue36168@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Mariatta noted at https://mail.python.org/archives/list/core-mentorship at python.org/message/KFIGNAGJKWQXCXG72VGIGGA3OCKUHOFC/ that these issues are not reserved and are now available for first-time contributors.

----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36168>
_______________________________________

From report at bugs.python.org  Sat Jun 29 16:09:16 2019
From: report at bugs.python.org (Lysandros Nikolaou)
Date: Sat, 29 Jun 2019 20:09:16 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561838956.45.0.664609145692.issue36167@roundup.psfhosted.org>


Lysandros Nikolaou <lisandrosnik at gmail.com> added the comment:

Mariatta noted at https://mail.python.org/archives/list/core-mentorship at python.org/message/KFIGNAGJKWQXCXG72VGIGGA3OCKUHOFC/ that these issues are not reserved and are now available for first-time contributors.

----------
nosy: +lys.nikolaou

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Sat Jun 29 16:26:42 2019
From: report at bugs.python.org (Readul Hasan Chayan)
Date: Sat, 29 Jun 2019 20:26:42 +0000
Subject: [issue36168] DOC: Fix capitalization in string.rst
In-Reply-To: <1551529262.87.0.31703753151.issue36168@roundup.psfhosted.org>
Message-ID: <1561840002.9.0.622505982802.issue36168@roundup.psfhosted.org>


Readul Hasan Chayan <heemayl at gmail.com> added the comment:

If no one has any problem I would like to work on this. This will be my first contribution if it happens.

----------
nosy: +Readul Hasan Chayan

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36168>
_______________________________________

From report at bugs.python.org  Sat Jun 29 16:53:15 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 20:53:15 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561841595.19.0.562392143164.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
pull_requests: +14285
pull_request: https://github.com/python/cpython/pull/14468

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 17:28:46 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 21:28:46 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561843726.89.0.92289372583.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset ac14632c756fec561e4b868b8793334bd7b22241 by Steve Dower in branch 'master':
bpo-37369: Fixes crash when reporting fatal error (GH-14468)
https://github.com/python/cpython/commit/ac14632c756fec561e4b868b8793334bd7b22241


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 17:29:02 2019
From: report at bugs.python.org (Steve Dower)
Date: Sat, 29 Jun 2019 21:29:02 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561843742.33.0.334128980283.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:


New changeset 323e743d4879f1cd861d0b252775797fb7938755 by Steve Dower in branch '3.8':
bpo-37369: Fix initialization of sys members when launched via an app container (GH-14467)
https://github.com/python/cpython/commit/323e743d4879f1cd861d0b252775797fb7938755


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sat Jun 29 17:54:38 2019
From: report at bugs.python.org (Vinay Sajip)
Date: Sat, 29 Jun 2019 21:54:38 +0000
Subject: [issue34556] Add --upgrade-deps to venv module
In-Reply-To: <1535729151.14.0.56676864532.issue34556@psf.upfronthosting.co.za>
Message-ID: <1561845278.92.0.107660665503.issue34556@roundup.psfhosted.org>


Vinay Sajip <vinay_sajip at yahoo.co.uk> added the comment:

> Is there any way other than discussing with the release manager to have this considered?

I don't believe so.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34556>
_______________________________________

From report at bugs.python.org  Sat Jun 29 18:18:45 2019
From: report at bugs.python.org (sushma)
Date: Sat, 29 Jun 2019 22:18:45 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561846725.15.0.717779344883.issue30754@roundup.psfhosted.org>


Change by sushma <sushma.y at gmail.com>:


----------
keywords: +patch
pull_requests: +14286
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14469

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sat Jun 29 18:44:54 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 29 Jun 2019 22:44:54 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561848294.38.0.942429739424.issue37437@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
pull_requests: +14287
pull_request: https://github.com/python/cpython/pull/14470

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:00:28 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 29 Jun 2019 23:00:28 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561849228.93.0.0121471113612.issue37437@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 95da310078a9364bae9ab3f2ad9c71e34306a70c by Benjamin Peterson in branch 'master':
bpo-37437: Pass -Wno-unreachable-code when compiling expat. (GH-14470)
https://github.com/python/cpython/commit/95da310078a9364bae9ab3f2ad9c71e34306a70c


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:00:41 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 29 Jun 2019 23:00:41 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561849241.94.0.135061707932.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14288
pull_request: https://github.com/python/cpython/pull/14471

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:00:55 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 29 Jun 2019 23:00:55 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561849255.7.0.46591979107.issue37437@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14289
pull_request: https://github.com/python/cpython/pull/14472

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:02:22 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 29 Jun 2019 23:02:22 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561849342.66.0.45256773726.issue37437@roundup.psfhosted.org>


Change by Benjamin Peterson <benjamin at python.org>:


----------
pull_requests: +14290
pull_request: https://github.com/python/cpython/pull/14473

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:08:22 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 29 Jun 2019 23:08:22 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
Message-ID: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>


New submission from Neil Schemenauer <nas-python at arctrix.com>:

This patch implements an alternative version of obmalloc's address_in_range().  It uses a radix tree to map the areas of memory covered by obmalloc arenas.  pymalloc_free() uses address_in_range() to determine if a block of memory is controlled by obmalloc or has been allocated by the system allocator.  The address_in_range() function must be fast.

The current version of address_in_range() uses a slightly memory unsanitary scheme.  I.e. it reads memory that has possibly not been initialized.  In theory that is not allowed and could cause a crash.  In practice, it has worked reliability for many years.  There is some ugly logic in obmalloc.c to disable sanity checking (e.g. ASN, TSAN, MSAN).  One advantage of this radix tree approach is that it doesn't have this unsanitary behavior.

Another small advantage of the radix tree approach is that it is independent from the OS page size.  With the current address_in_range() scheme, the size of obmalloc pools are limited to the size of the OS page size.  If larger, a segmentation fault could occur.  Bug #37211 (obmalloc: eliminate limit on pool size) allows for larger pools but at the cost of some additional code complexity and some additional memory overhead.

This patch has been discussed quite a bit on the python-dev list.  Thread subjects are:
    obmalloc (was Have a big machine and spare time? Here's a possible Python bug.)
    radix tree arena map for obmalloc

That discussion focuses quite a bit on the value of increasing the obmalloc arena and pool sizes.  This proposed patch keeps the sizes the same.  We can evaluate changing the sizes as a different issue.

I have run the pyperformance benchmark suite to compare performance of the radix tree with the status quo.  I think there is no significant difference for the programs that are part of the suite.  The pyperformance comparision report is attached.

If we do decide to go with larger pool and arena sizes, the radix tree approach actually uses less memory than the "big pools PR" (Bug #37211).  Attached is Tim's program to compare memory overheads of the different approaches.

I think it is worth considering using the radix tree by default on 64-bit platforms.  It seems to be not any slower than the status quo, does not have the memory unsanitary behavior and gives us the ability to easily increase pool sizes if we decide we want to.

----------
components: Interpreter Core
messages: 346903
nosy: nascheme
priority: normal
severity: normal
stage: patch review
status: open
title: obmalloc: radix tree for tracking arena address ranges
type: enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:12:21 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 29 Jun 2019 23:12:21 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
In-Reply-To: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>
Message-ID: <1561849941.35.0.662608606606.issue37448@roundup.psfhosted.org>


Change by Neil Schemenauer <nas-python at arctrix.com>:


Added file: https://bugs.python.org/file48445/pyperf_radix_compare.txt

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:12:46 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 29 Jun 2019 23:12:46 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
In-Reply-To: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>
Message-ID: <1561849966.42.0.704995548008.issue37448@roundup.psfhosted.org>


Change by Neil Schemenauer <nas-python at arctrix.com>:


Added file: https://bugs.python.org/file48446/obmalloc_overhead.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:13:56 2019
From: report at bugs.python.org (Neil Schemenauer)
Date: Sat, 29 Jun 2019 23:13:56 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
In-Reply-To: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>
Message-ID: <1561850036.23.0.0664785266226.issue37448@roundup.psfhosted.org>


Change by Neil Schemenauer <nas-python at arctrix.com>:


----------
keywords: +patch
pull_requests: +14291
pull_request: https://github.com/python/cpython/pull/14474

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:16:49 2019
From: report at bugs.python.org (miss-islington)
Date: Sat, 29 Jun 2019 23:16:49 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561850209.25.0.597506564038.issue37437@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ffa419ad004de96395a655f6b8d1a58b7c73372e by Miss Islington (bot) in branch '3.7':
bpo-37437: Pass -Wno-unreachable-code when compiling expat. (GH-14470)
https://github.com/python/cpython/commit/ffa419ad004de96395a655f6b8d1a58b7c73372e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 19:52:04 2019
From: report at bugs.python.org (Benjamin Peterson)
Date: Sat, 29 Jun 2019 23:52:04 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561852324.35.0.788767665493.issue37437@roundup.psfhosted.org>


Benjamin Peterson <benjamin at python.org> added the comment:


New changeset 66c42f8bbcf5fa261a0d944ce8fbca9220abd11d by Benjamin Peterson in branch '3.8':
[3.8] bpo-37437: Pass -Wno-unreachable-code when compiling expat. (GH-14473)
https://github.com/python/cpython/commit/66c42f8bbcf5fa261a0d944ce8fbca9220abd11d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 20:36:34 2019
From: report at bugs.python.org (Ned Deily)
Date: Sun, 30 Jun 2019 00:36:34 +0000
Subject: [issue37437] update vendorized expat to 2.2.7
In-Reply-To: <1561692545.23.0.0954968127572.issue37437@roundup.psfhosted.org>
Message-ID: <1561854994.0.0.0411477492923.issue37437@roundup.psfhosted.org>


Ned Deily <nad at python.org> added the comment:


New changeset a1093e4dee9dd05cf3a844349c94fed52c4ebd89 by Ned Deily (Miss Islington (bot)) in branch '3.6':
bpo-37437: Pass -Wno-unreachable-code when compiling expat. (GH-14470) (GH-14472)
https://github.com/python/cpython/commit/a1093e4dee9dd05cf3a844349c94fed52c4ebd89


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37437>
_______________________________________

From report at bugs.python.org  Sat Jun 29 22:12:52 2019
From: report at bugs.python.org (Brett Cannon)
Date: Sun, 30 Jun 2019 02:12:52 +0000
Subject: [issue37449] Move ensurepip off of pkgutil and to importlib.resources
Message-ID: <1561860772.49.0.185483718697.issue37449@roundup.psfhosted.org>


New submission from Brett Cannon <brett at python.org>:

ensurepip is using pkgutil.get_data() which isn't as clean as importlib.resources for reading data from within a package.

----------
components: Library (Lib)
messages: 346907
nosy: brett.cannon
priority: normal
severity: normal
stage: needs patch
status: open
title: Move ensurepip off of pkgutil and to importlib.resources
type: enhancement
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37449>
_______________________________________

From report at bugs.python.org  Sat Jun 29 22:27:26 2019
From: report at bugs.python.org (Tim Peters)
Date: Sun, 30 Jun 2019 02:27:26 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
In-Reply-To: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>
Message-ID: <1561861646.76.0.273653502127.issue37448@roundup.psfhosted.org>


Change by Tim Peters <tim at python.org>:


----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 22:58:30 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 30 Jun 2019 02:58:30 +0000
Subject: [issue37448] obmalloc: radix tree for tracking arena address ranges
In-Reply-To: <1561849702.35.0.724599328196.issue37448@roundup.psfhosted.org>
Message-ID: <1561863510.54.0.104378266794.issue37448@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +inada.naoki

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37448>
_______________________________________

From report at bugs.python.org  Sat Jun 29 23:27:51 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sun, 30 Jun 2019 03:27:51 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561865271.45.0.104705782746.issue36167@roundup.psfhosted.org>


Avinash Sajjanshetty <hi at avi.im> added the comment:

I would like to send a PR for this

----------
nosy: +avi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:20:21 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:20:21 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561868421.18.0.90606692816.issue30754@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14292
pull_request: https://github.com/python/cpython/pull/14475

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:20:24 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 30 Jun 2019 04:20:24 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561868424.47.0.684838821305.issue30754@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset eb97b9211e7c99841d6cae8c63893b3525d5a401 by Gregory P. Smith (tmblweed) in branch 'master':
bpo-30754: Document textwrap.dedent blank line behavior. (GH-14469)
https://github.com/python/cpython/commit/eb97b9211e7c99841d6cae8c63893b3525d5a401


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:21:17 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:21:17 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561868477.19.0.195839056913.issue30754@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14293
pull_request: https://github.com/python/cpython/pull/14476

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:21:24 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:21:24 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561868484.33.0.423720171965.issue30754@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14294
pull_request: https://github.com/python/cpython/pull/14477

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:27:50 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 30 Jun 2019 04:27:50 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561868870.19.0.150136984667.issue30754@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:30:45 2019
From: report at bugs.python.org (Timothy Lusk)
Date: Sun, 30 Jun 2019 04:30:45 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561869045.68.0.995772913294.issue37434@roundup.psfhosted.org>


Timothy Lusk <darkcube at gmail.com> added the comment:

I'll admit I don't know enough about Python c extensions to make that call, but the fact that it wasn't crashing in the protobuf extension itself during the import but instead during the next garbage collection made me believe it was a Python bug. Maybe that's not a correct assumption though.

----------
nosy: +Timothy Lusk2

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:38:14 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:38:14 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561869494.9.0.3881688151.issue30754@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset e2e41cd114ae761fbfee4e7c6539f5df5c8c7116 by Miss Islington (bot) in branch '3.7':
bpo-30754: Document textwrap.dedent blank line behavior. (GH-14469)
https://github.com/python/cpython/commit/e2e41cd114ae761fbfee4e7c6539f5df5c8c7116


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:40:44 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:40:44 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561869644.19.0.523379215193.issue30754@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset 3e133c401a51f08404b68f11d921f0b406283741 by Miss Islington (bot) in branch '3.8':
bpo-30754: Document textwrap.dedent blank line behavior. (GH-14469)
https://github.com/python/cpython/commit/3e133c401a51f08404b68f11d921f0b406283741


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:41:58 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 04:41:58 +0000
Subject: [issue30754] textwrap.dedent mishandles empty lines
In-Reply-To: <1498404324.65.0.525714137023.issue30754@psf.upfronthosting.co.za>
Message-ID: <1561869718.33.0.563410358674.issue30754@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bc60c47169d1cb33f6fbe1ed64c09a536e82e1c3 by Miss Islington (bot) in branch '2.7':
[2.7] bpo-30754: Document textwrap.dedent blank line behavior. (GH-14469) (GH-14475)
https://github.com/python/cpython/commit/bc60c47169d1cb33f6fbe1ed64c09a536e82e1c3


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30754>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:49:04 2019
From: report at bugs.python.org (Steve Dower)
Date: Sun, 30 Jun 2019 04:49:04 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561870144.14.0.370889392718.issue37369@roundup.psfhosted.org>


Change by Steve Dower <steve.dower at python.org>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sun Jun 30 00:54:58 2019
From: report at bugs.python.org (Tim Peters)
Date: Sun, 30 Jun 2019 04:54:58 +0000
Subject: [issue37434] Segfault in typeobject.c at _PyObject_GC_UNTRACK(type)
In-Reply-To: <1561660257.77.0.368654180349.issue37434@roundup.psfhosted.org>
Message-ID: <1561870498.95.0.715605390744.issue37434@roundup.psfhosted.org>


Tim Peters <tim at python.org> added the comment:

I haven't used protobuf, but it's _generally_ true that crashes that occur for the first time in the presence of C or C++ extension modules are due to subtle (or not so subtle) mistakes in using the sometimes-delicate Python C API.  So it's too soon to play "pin the blame on the donkey here" ;-)  But resolving it really needs someone who knows what protobuf is doing.

----------
nosy: +tim.peters

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37434>
_______________________________________

From report at bugs.python.org  Sun Jun 30 01:01:42 2019
From: report at bugs.python.org (Steve Dower)
Date: Sun, 30 Jun 2019 05:01:42 +0000
Subject: [issue37369] Issue with pip in venv on Powershell in Windows
In-Reply-To: <1561161256.11.0.32935812019.issue37369@roundup.psfhosted.org>
Message-ID: <1561870902.08.0.198479790467.issue37369@roundup.psfhosted.org>


Steve Dower <steve.dower at python.org> added the comment:

> I'm not sure of the purpose of sys._base_executable. Maybe open a separated issue to make the attribute public? I'm not sure if multiprocessing (for example) should use it, or if sys.executble should be used.

Yeah, it's a bit more complex. Sometimes it's needed and often not, depending on platform. For multiprocessing we need it on Windows because of the handle inheritance that's used, which only goes one subprocess deep,and we use special knowledge to make it work even in a venv.

But at least having it there means we can use it when needed without having to define its semantics for 100% of cases. Venvs make things really hard the way they're currently done...

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37369>
_______________________________________

From report at bugs.python.org  Sun Jun 30 01:54:46 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 30 Jun 2019 05:54:46 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1561874086.5.0.965925689906.issue29505@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:


New changeset 5cbbbd73a6acb6f96f5d6646aa7498d3dfb1706d by Gregory P. Smith (Ammar Askar) in branch 'master':
bpo-29505: Add more fuzzing for re.compile, re.load and csv.reader (GH-14255)
https://github.com/python/cpython/commit/5cbbbd73a6acb6f96f5d6646aa7498d3dfb1706d


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sun Jun 30 01:54:54 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 05:54:54 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1561874094.33.0.118506356463.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14295
pull_request: https://github.com/python/cpython/pull/14478

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sun Jun 30 01:55:00 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 05:55:00 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1561874100.72.0.82565658009.issue29505@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14296
pull_request: https://github.com/python/cpython/pull/14479

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sun Jun 30 01:58:34 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 30 Jun 2019 05:58:34 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561874314.55.0.782217066065.issue37199@roundup.psfhosted.org>


Change by Zackery Spytz <zspytz at gmail.com>:


----------
keywords: +patch
pull_requests: +14297
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14480

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:03:47 2019
From: report at bugs.python.org (Prateek Nayak)
Date: Sun, 30 Jun 2019 06:03:47 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561874627.7.0.317284253738.issue36167@roundup.psfhosted.org>


Change by Prateek Nayak <lelouch.cpp at gmail.com>:


----------
keywords: +patch
pull_requests: +14298
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14481

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:08:26 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sun, 30 Jun 2019 06:08:26 +0000
Subject: [issue36167] DOC: Incorrect capitalization in Programming FAQ
In-Reply-To: <1551529099.5.0.835675772758.issue36167@roundup.psfhosted.org>
Message-ID: <1561874906.68.0.0557662857511.issue36167@roundup.psfhosted.org>


Change by Avinash Sajjanshetty <hi at avi.im>:


----------
pull_requests: +14299
pull_request: https://github.com/python/cpython/pull/14482

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36167>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:12:22 2019
From: report at bugs.python.org (Zackery Spytz)
Date: Sun, 30 Jun 2019 06:12:22 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561875142.74.0.498593369446.issue37199@roundup.psfhosted.org>


Zackery Spytz <zspytz at gmail.com> added the comment:

I've created a PR for this issue.

----------
components: +Tests
nosy: +ZackerySpytz

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:13:22 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 06:13:22 +0000
Subject: [issue29505] Submit the re, json, & csv modules to oss-fuzz testing
In-Reply-To: <1486587261.97.0.342323514088.issue29505@psf.upfronthosting.co.za>
Message-ID: <1561875202.72.0.663651337942.issue29505@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset ffcc161c753a72e7c4237c1e3c433d47b020978e by Miss Islington (bot) in branch '3.8':
bpo-29505: Add more fuzzing for re.compile, re.load and csv.reader (GH-14255)
https://github.com/python/cpython/commit/ffcc161c753a72e7c4237c1e3c433d47b020978e


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue29505>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:42:16 2019
From: report at bugs.python.org (Rafael Villca Poggian)
Date: Sun, 30 Jun 2019 06:42:16 +0000
Subject: [issue37450] Generalize Euclidean distance function in the math
 module to Minkowski distance
Message-ID: <1561876936.33.0.5720685617.issue37450@roundup.psfhosted.org>


New submission from Rafael Villca Poggian <rafael.rvp98 at gmail.com>:

Given that Euclidean distance function was added into the Math module, I think it would be better to have the generalized version of the function as an implementation of the Minkowski distance with p=2 by default, thus maintaining the use as Euclidean distance, providing the extra uses of Minkowski distance.

----------
components: Library (Lib)
messages: 346919
nosy: nubol23
priority: normal
severity: normal
status: open
title: Generalize Euclidean distance function in the math module to Minkowski distance
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37450>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:45:00 2019
From: report at bugs.python.org (Rafael Villca Poggian)
Date: Sun, 30 Jun 2019 06:45:00 +0000
Subject: [issue37450] Generalize Euclidean distance function in the math
 module to Minkowski distance
In-Reply-To: <1561876936.33.0.5720685617.issue37450@roundup.psfhosted.org>
Message-ID: <1561877100.53.0.37504440681.issue37450@roundup.psfhosted.org>


Change by Rafael Villca Poggian <rafael.rvp98 at gmail.com>:


----------
type:  -> enhancement

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37450>
_______________________________________

From report at bugs.python.org  Sun Jun 30 02:45:50 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 30 Jun 2019 06:45:50 +0000
Subject: [issue37450] Generalize Euclidean distance function in the math
 module to Minkowski distance
In-Reply-To: <1561876936.33.0.5720685617.issue37450@roundup.psfhosted.org>
Message-ID: <1561877150.92.0.372997783418.issue37450@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +mark.dickinson, rhettinger, stutzbach

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37450>
_______________________________________

From report at bugs.python.org  Sun Jun 30 03:45:10 2019
From: report at bugs.python.org (Stefan Behnel)
Date: Sun, 30 Jun 2019 07:45:10 +0000
Subject: [issue37399] XML text behaviour change if there are comments
In-Reply-To: <1561452502.97.0.0666051157633.issue37399@roundup.psfhosted.org>
Message-ID: <1561880710.07.0.73298188019.issue37399@roundup.psfhosted.org>


Stefan Behnel <stefan_ml at behnel.de> added the comment:

I'm working on a patch. It's not entirely trivial, so it might take a couple of days.

----------
assignee:  -> scoder

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37399>
_______________________________________

From report at bugs.python.org  Sun Jun 30 04:09:11 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sun, 30 Jun 2019 08:09:11 +0000
Subject: [issue36689] docs: os.path.commonpath raises ValueError for different
 drives
In-Reply-To: <1555837758.83.0.507858438764.issue36689@roundup.psfhosted.org>
Message-ID: <1561882151.59.0.734045535109.issue36689@roundup.psfhosted.org>


Avinash Sajjanshetty <hi at avi.im> added the comment:

status of issue should be closed? cos the related PR is already merged

----------
nosy: +avi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36689>
_______________________________________

From report at bugs.python.org  Sun Jun 30 04:34:42 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 30 Jun 2019 08:34:42 +0000
Subject: [issue36689] docs: os.path.commonpath raises ValueError for different
 drives
In-Reply-To: <1555837758.83.0.507858438764.issue36689@roundup.psfhosted.org>
Message-ID: <1561883682.1.0.956012974554.issue36689@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Yes, sure

----------
nosy: +asvetlov
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36689>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:12:25 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 30 Jun 2019 09:12:25 +0000
Subject: [issue37451] Remove redudant test code in _testcapimodule.c
Message-ID: <1561885945.76.0.438111061422.issue37451@roundup.psfhosted.org>


New submission from hai shi <shihai1991 at 126.com>:

the code in https://github.com/python/cpython/blob/master/Objects/unicodeobject.c#L3163-L3165 looks redundant, due to https://github.com/python/cpython/blob/master/Objects/unicodeobject.c#L3163-L3165

----------
messages: 346923
nosy: shihai1991
priority: normal
severity: normal
status: open
title: Remove redudant test code in _testcapimodule.c

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37451>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:14:43 2019
From: report at bugs.python.org (hai shi)
Date: Sun, 30 Jun 2019 09:14:43 +0000
Subject: [issue37451] Remove redudant test code in _testcapimodule.c
In-Reply-To: <1561885945.76.0.438111061422.issue37451@roundup.psfhosted.org>
Message-ID: <1561886083.12.0.58315781233.issue37451@roundup.psfhosted.org>


Change by hai shi <shihai1991 at 126.com>:


----------
keywords: +patch
pull_requests: +14300
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/14483

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37451>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:53:47 2019
From: report at bugs.python.org (Florian Bruhin)
Date: Sun, 30 Jun 2019 09:53:47 +0000
Subject: [issue37428] SSLContext.post_handshake_auth implicitly enables cert
 validation
In-Reply-To: <1561631609.42.0.922673247425.issue37428@roundup.psfhosted.org>
Message-ID: <1561888427.68.0.808431824032.issue37428@roundup.psfhosted.org>


Change by Florian Bruhin <python.org at the-compiler.org>:


----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37428>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:53:53 2019
From: report at bugs.python.org (Florian Bruhin)
Date: Sun, 30 Jun 2019 09:53:53 +0000
Subject: [issue37440] httplib should enable post-handshake authentication for
 TLS 1.3
In-Reply-To: <1561732145.9.0.0353203933987.issue37440@roundup.psfhosted.org>
Message-ID: <1561888433.98.0.947105116276.issue37440@roundup.psfhosted.org>


Change by Florian Bruhin <python.org at the-compiler.org>:


----------
nosy: +The Compiler

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37440>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:55:07 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 30 Jun 2019 09:55:07 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1561888507.68.0.88476359724.issue35621@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset 0d671c04c39b52e44597491b893eb0b6c86b3d45 by Andrew Svetlov in branch 'master':
bpo-35621: Support running subprocesses in asyncio when loop is executed in non-main thread  (GH-14344)
https://github.com/python/cpython/commit/0d671c04c39b52e44597491b893eb0b6c86b3d45


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:55:15 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 09:55:15 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1561888515.87.0.492078905503.issue35621@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14301
pull_request: https://github.com/python/cpython/pull/14484

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun 30 05:56:09 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 30 Jun 2019 09:56:09 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1561888569.89.0.365187821738.issue35621@roundup.psfhosted.org>


Change by Andrew Svetlov <andrew.svetlov at gmail.com>:


----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.9 -Python 3.6, Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun 30 06:22:38 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 10:22:38 +0000
Subject: [issue35621] asyncio.create_subprocess_exec() only works with main
 event loop
In-Reply-To: <1546210778.19.0.43686311162.issue35621@roundup.psfhosted.org>
Message-ID: <1561890158.33.0.113826614746.issue35621@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset bf8cb31803558f1105efb15b0ee4bd184f3218c8 by Miss Islington (bot) in branch '3.8':
bpo-35621: Support running subprocesses in asyncio when loop is executed in non-main thread  (GH-14344)
https://github.com/python/cpython/commit/bf8cb31803558f1105efb15b0ee4bd184f3218c8


----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35621>
_______________________________________

From report at bugs.python.org  Sun Jun 30 08:23:03 2019
From: report at bugs.python.org (Avinash Sajjanshetty)
Date: Sun, 30 Jun 2019 12:23:03 +0000
Subject: [issue36497] Undocumented behavior in csv.Sniffer (preferred
 delimiters)
In-Reply-To: <1554126856.48.0.397677994988.issue36497@roundup.psfhosted.org>
Message-ID: <1561897383.12.0.170254543605.issue36497@roundup.psfhosted.org>


Avinash Sajjanshetty <hi at avi.im> added the comment:

can I take up this issue?

----------
nosy: +avi

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36497>
_______________________________________

From report at bugs.python.org  Sun Jun 30 08:52:19 2019
From: report at bugs.python.org (Roundup Robot)
Date: Sun, 30 Jun 2019 12:52:19 +0000
Subject: [issue36168] DOC: Fix capitalization in string.rst
In-Reply-To: <1551529262.87.0.31703753151.issue36168@roundup.psfhosted.org>
Message-ID: <1561899139.2.0.476832269023.issue36168@roundup.psfhosted.org>


Change by Roundup Robot <devnull at psf.upfronthosting.co.za>:


----------
keywords: +patch
pull_requests: +14302
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14485

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36168>
_______________________________________

From report at bugs.python.org  Sun Jun 30 08:57:04 2019
From: report at bugs.python.org (Krishna Oza)
Date: Sun, 30 Jun 2019 12:57:04 +0000
Subject: [issue36168] DOC: Fix capitalization in string.rst
In-Reply-To: <1551529262.87.0.31703753151.issue36168@roundup.psfhosted.org>
Message-ID: <1561899424.94.0.37132233028.issue36168@roundup.psfhosted.org>


Krishna Oza <krishoza15sep at gmail.com> added the comment:

I am getting the error "GitHub PR already added to issue" when submitting my Github PR for this issue.

----------
nosy: +Krishna Oza

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36168>
_______________________________________

From report at bugs.python.org  Sun Jun 30 10:14:14 2019
From: report at bugs.python.org (Maayan Keshet)
Date: Sun, 30 Jun 2019 14:14:14 +0000
Subject: [issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque
 Index Out Of Range
In-Reply-To: <1560242699.55.0.804750809475.issue37226@roundup.psfhosted.org>
Message-ID: <1561904054.81.0.506857581522.issue37226@roundup.psfhosted.org>


Maayan Keshet <maayan at maayank.com> added the comment:

Any updates on this issue? We're also encountering it as part of our websocket clients.

----------
nosy: +maayank

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37226>
_______________________________________

From report at bugs.python.org  Sun Jun 30 11:04:49 2019
From: report at bugs.python.org (Fredrik Mellbin)
Date: Sun, 30 Jun 2019 15:04:49 +0000
Subject: [issue37452] Microsoft store package has an invalid ExecutablePath
 registry entry
Message-ID: <1561907089.3.0.284531317846.issue37452@roundup.psfhosted.org>


New submission from Fredrik Mellbin <fredrik.mellbin at gmail.com>:

The Microsoft store release doesn't seem to populate the the "ExecutablePath" registry entry properly. Instead it has a the path to something that isn't an executable which can be seen in the attached screenshot.

The expected behavior would be to have it point to "%LOCALAPPDATA%\Microsoft\WindowsApps\Python37.exe" (or something else that's reasonable) since PEP514 requires it to be an actual executable.

----------
components: Windows
files: vs_installershell_2019-06-27_23-32-05.png
messages: 346931
nosy: Fredrik Mellbin, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Microsoft store package has an invalid ExecutablePath registry entry
type: behavior
versions: Python 3.7
Added file: https://bugs.python.org/file48447/vs_installershell_2019-06-27_23-32-05.png

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37452>
_______________________________________

From report at bugs.python.org  Sun Jun 30 11:24:50 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 30 Jun 2019 15:24:50 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561908290.7.0.198557120525.issue37199@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:


New changeset c2cda638d63b98f5cf9a8ef13e15aace2b7e3f0b by Andrew Svetlov (Zackery Spytz) in branch 'master':
bpo-37199: Fix test failures when IPv6 is unavailable or disabled (#14480)
https://github.com/python/cpython/commit/c2cda638d63b98f5cf9a8ef13e15aace2b7e3f0b


----------
nosy: +asvetlov

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 11:24:56 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 15:24:56 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561908296.21.0.131901729089.issue37199@roundup.psfhosted.org>


Change by miss-islington <mariatta.wijaya+miss-islington at gmail.com>:


----------
pull_requests: +14305
pull_request: https://github.com/python/cpython/pull/14486

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 11:42:26 2019
From: report at bugs.python.org (miss-islington)
Date: Sun, 30 Jun 2019 15:42:26 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561909346.68.0.972005147861.issue37199@roundup.psfhosted.org>


miss-islington <mariatta.wijaya+miss-islington at gmail.com> added the comment:


New changeset c2684c6d62978e9ce8256c3c7744d0332a2abe4c by Miss Islington (bot) in branch '3.8':
bpo-37199: Fix test failures when IPv6 is unavailable or disabled (GH-14480)
https://github.com/python/cpython/commit/c2684c6d62978e9ce8256c3c7744d0332a2abe4c


----------
nosy: +miss-islington

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 11:53:48 2019
From: report at bugs.python.org (Andrew Svetlov)
Date: Sun, 30 Jun 2019 15:53:48 +0000
Subject: [issue37199] Test suite fails when Ipv6 is unavailable
In-Reply-To: <1559926830.72.0.215725323123.issue37199@roundup.psfhosted.org>
Message-ID: <1561910028.72.0.958305916326.issue37199@roundup.psfhosted.org>


Andrew Svetlov <andrew.svetlov at gmail.com> added the comment:

Thanks!

----------
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37199>
_______________________________________

From report at bugs.python.org  Sun Jun 30 13:36:22 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Sun, 30 Jun 2019 17:36:22 +0000
Subject: [issue36889] Merge StreamWriter and StreamReader into just
 asyncio.Stream
In-Reply-To: <1557598514.53.0.379470651864.issue36889@roundup.psfhosted.org>
Message-ID: <1561916182.69.0.65616760114.issue36889@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
pull_requests: +14306
pull_request: https://github.com/python/cpython/pull/14488

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36889>
_______________________________________

From report at bugs.python.org  Sun Jun 30 15:49:18 2019
From: report at bugs.python.org (Barry A. Warsaw)
Date: Sun, 30 Jun 2019 19:49:18 +0000
Subject: [issue37449] Move ensurepip off of pkgutil and to importlib.resources
In-Reply-To: <1561860772.49.0.185483718697.issue37449@roundup.psfhosted.org>
Message-ID: <1561924158.52.0.414186470715.issue37449@roundup.psfhosted.org>


Change by Barry A. Warsaw <barry at python.org>:


----------
nosy: +barry

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37449>
_______________________________________

From report at bugs.python.org  Sun Jun 30 15:52:50 2019
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 30 Jun 2019 19:52:50 +0000
Subject: [issue37453] Symlink creation on Windows should work without
 privilege escalation
Message-ID: <1561924370.82.0.794455360615.issue37453@roundup.psfhosted.org>


New submission from Jason R. Coombs <jaraco at jaraco.com>:

A few years ago, Windows [announced more lenient support for creating symbolic links](). This more lenient support requires the caller to pass a flag in the API. Neither the blog post nor the API docs give any indication of why one would not ever pass that flag, and passing it will enable symlink to work in more cases that work in Unix, so I believe Python should set the SYMBOLIC_LINK_FLAG_ALLOW_UNPRIVILEGED_CREATE flag.

----------
messages: 346935
nosy: jaraco, steve.dower
priority: normal
severity: normal
status: open
title: Symlink creation on Windows should work without privilege escalation
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37453>
_______________________________________

From report at bugs.python.org  Sun Jun 30 15:53:17 2019
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 30 Jun 2019 19:53:17 +0000
Subject: [issue37453] Symlink creation on Windows should work without
 privilege escalation
In-Reply-To: <1561924370.82.0.794455360615.issue37453@roundup.psfhosted.org>
Message-ID: <1561924397.37.0.229364842162.issue37453@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

The missing reference above should be https://blogs.windows.com/windowsdeveloper/2016/12/02/symlinks-windows-10/#iqm9GJhlyWhcM78e.97

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37453>
_______________________________________

From report at bugs.python.org  Sun Jun 30 15:53:23 2019
From: report at bugs.python.org (Tal Einat)
Date: Sun, 30 Jun 2019 19:53:23 +0000
Subject: [issue36390] IDLE: Refactor formatting methods from editor
In-Reply-To: <1553171660.93.0.476861789874.issue36390@roundup.psfhosted.org>
Message-ID: <1561924403.89.0.265122394537.issue36390@roundup.psfhosted.org>


Tal Einat <taleinat at gmail.com> added the comment:

> 1.  The name `formatregion` could probably be improved.

FormatRegion is good enough, and is consistent with FormatParagraph.

> 2.  The `classifyws` method is a module level method in editor.  It's needed in `formatregion` also, so I made a copy (bad!).  I would have liked to create a `utils.py` for this, but maybe there's a better place for it?  It doesn't just operate on text widgets as it is just a string function.  I'm sure there's an obvious choice that I'm missing.  See also #4 below.

As you're just trying to refactor with minimal changes, this can just stay as-is IMO. 

My optimal end solution would be:
1. remove classifyws()
2. create get_line_indent(line) function which returns re.match(r'[ \t]*', line).end()
3. use len(indent) and/or len(indent.expandtabs(tabwidth)) as needed.
4. get_line_indent(line) is so simple that having it duplicated would be fine IMHO.

> 3.  `tabwidth` and `indentwidth` in `formatregion` are getting the values from the editor window.  I thought about adding those to the init for FormatRegion, but then they would need to be updated if config changed.  Not sure which way would be better.

I say, leave this the way it is.

> 4.  Other methods in editor might be candidates for moving, such as the auto-indent methods (search on `### begin autoindent code ###` in editor) and specifically `smart_indent_event`.  Moving more of the indent code to a separate module helps with #2 and #3 above, but I wasn't sure how much of the text formatting should be moved.  I thought it best to start with the minimal change.

I wouldn't move event handlers. I will say that the code in some of those functions could use a bit of cleanup and standardization WRT indentation handling, e.g. using get_line_indent() as described above in a few places where it is naively re-implemented with a loop.

----------
nosy: +taleinat

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue36390>
_______________________________________

From report at bugs.python.org  Sun Jun 30 15:59:41 2019
From: report at bugs.python.org (Jason R. Coombs)
Date: Sun, 30 Jun 2019 19:59:41 +0000
Subject: [issue37453] Symlink creation on Windows should work without
 privilege escalation
In-Reply-To: <1561924370.82.0.794455360615.issue37453@roundup.psfhosted.org>
Message-ID: <1561924781.52.0.466192257141.issue37453@roundup.psfhosted.org>


Jason R. Coombs <jaraco at jaraco.com> added the comment:

I see looking at the code and docs now that this work was done for Python 3.8.

----------
resolution:  -> works for me
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37453>
_______________________________________

From report at bugs.python.org  Sun Jun 30 16:08:08 2019
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 30 Jun 2019 20:08:08 +0000
Subject: [issue37452] Microsoft store package has an invalid ExecutablePath
 registry entry
In-Reply-To: <1561907089.3.0.284531317846.issue37452@roundup.psfhosted.org>
Message-ID: <1561925288.32.0.474419941668.issue37452@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

> The expected behavior would be to have it point to 
> "%LOCALAPPDATA%\Microsoft\WindowsApps\Python37.exe" (or something 
> else that's reasonable) since PEP514 requires it to be an actual 
> executable.
 
This appears to be a duplicate of issue 36649. But I think this has to be looked at again. In Windows 10 1903 (build 10.0.18362.*), CreateProcess can directly run the real executable that's installed under "%ProgramFiles%\WindowsApps" by getting the package information it needs from the user's corresponding app-exec link in "%LocalAppData%\Microsoft\WindowsApps". Apparently the latest skip-ahead preview releases no longer implement this, in which case shouldn't the installer set the ExecutablePath and WindowedExecutablePath values to the user's "python.exe" and "pythonw.exe" app-exec links in "%LocalAppData%\Microsoft\WindowsApps"?

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37452>
_______________________________________

From report at bugs.python.org  Sun Jun 30 16:22:54 2019
From: report at bugs.python.org (Eryk Sun)
Date: Sun, 30 Jun 2019 20:22:54 +0000
Subject: [issue37453] Symlink creation on Windows should work without
 privilege escalation
In-Reply-To: <1561924370.82.0.794455360615.issue37453@roundup.psfhosted.org>
Message-ID: <1561926174.25.0.807331564598.issue37453@roundup.psfhosted.org>


Eryk Sun <eryksun at gmail.com> added the comment:

FYI, this only works when the system is in developer mode. If you want authenticated users and non-elevated administrators to have symlink rights in applications that haven't been updated to use this flag, or without enabling developer mode, grant the right to create symbolic links to the "Authenticated Users" (S-1-5-11) well-known group.

----------
nosy: +eryksun

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37453>
_______________________________________

From report at bugs.python.org  Sun Jun 30 18:07:44 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 30 Jun 2019 22:07:44 +0000
Subject: [issue37450] Generalize Euclidean distance function in the math
 module to Minkowski distance
In-Reply-To: <1561876936.33.0.5720685617.issue37450@roundup.psfhosted.org>
Message-ID: <1561932464.68.0.423742606134.issue37450@roundup.psfhosted.org>


Raymond Hettinger <raymond.hettinger at gmail.com> added the comment:

I would like to decline this for now.  We're being reserved about what goes into the math module, deferring many needs to third-party packages.

----------
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37450>
_______________________________________

From report at bugs.python.org  Sun Jun 30 18:19:38 2019
From: report at bugs.python.org (Raymond Hettinger)
Date: Sun, 30 Jun 2019 22:19:38 +0000
Subject: [issue37454] Clarify docs for math.log1p()
Message-ID: <1561933178.32.0.315765765879.issue37454@roundup.psfhosted.org>


New submission from Raymond Hettinger <raymond.hettinger at gmail.com>:

Currently the docs say, "The result is calculated in a way which is accurate for x near zero."

That is somewhat vague.  Some quick tests show that it is often more accurate than log() for the whole range of 0.0 < x < 1.0; however, for x < 0.0 it is always worse.

Since the function is just a pass-through to the C library, we probably can't make any guarantees.  On the other hand, it is hard to know when this function is preferred without some guidance.

----------
assignee: docs at python
components: Documentation
files: study_log1p.py
messages: 346942
nosy: docs at python, mark.dickinson, rhettinger, tim.peters
priority: low
severity: normal
status: open
title: Clarify docs for math.log1p()
versions: Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48448/study_log1p.py

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37454>
_______________________________________

From report at bugs.python.org  Sun Jun 30 18:55:07 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Sun, 30 Jun 2019 22:55:07 +0000
Subject: [issue5115] Extend subprocess.kill to be able to kill process groups
In-Reply-To: <1233370260.58.0.70597374825.issue5115@psf.upfronthosting.co.za>
Message-ID: <1561935307.99.0.43619263419.issue5115@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
pull_requests:  -7893

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5115>
_______________________________________

From report at bugs.python.org  Sun Jun 30 19:53:08 2019
From: report at bugs.python.org (Sam Frances)
Date: Sun, 30 Jun 2019 23:53:08 +0000
Subject: [issue37455] asyncio.run() error related to finalizing async
 generators
Message-ID: <1561938788.3.0.655729732728.issue37455@roundup.psfhosted.org>


New submission from Sam Frances <sam at samfrances.uk>:

The documentation for `asyncio.run()` states:

"This function runs the passed coroutine, taking care of managing the asyncio event loop and finalizing asynchronous generators."

However, the following example seems to indicate that async generators are not being cleared up correctly.

```
import asyncio


async def count():
    try:
        i = 0
        while True:
            yield i
            i += 1
    finally:
        print("count() cleanup")


async def double(source):
    try:
        async for n in source:
            yield n * 2
    finally:
        print("double() cleanup")


async def anext(aiter):
    return await aiter.__anext__()


async def main():
    async for i in double(count()):
        if i > 10:
            return
        print(i)

asyncio.run(main())

```

The result is:

```
$ python example.py 
0
2
4
6
8
10
unhandled exception during asyncio.run() shutdown
task: <Task finished name='Task-2' coro=<<async_generator_athrow without __name__>()> exception=RuntimeError("can't send non-None value to a just-started coroutine")>
RuntimeError: can't send non-None value to a just-started coroutine
count() cleanup

```

The above error is from Python 3.8.0b1+, but the exact same error occurs in Python 3.7.

I'm not sure if this is a bug or if I am misunderstanding the intended behaviour of `asyncio.run()`, but the behaviour was certainly surprising to me.

----------
components: asyncio
messages: 346943
nosy: asvetlov, samfrances, yselivanov
priority: normal
severity: normal
status: open
title: asyncio.run() error related to finalizing async generators
type: behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37455>
_______________________________________

From report at bugs.python.org  Sun Jun 30 19:55:50 2019
From: report at bugs.python.org (Sam Frances)
Date: Sun, 30 Jun 2019 23:55:50 +0000
Subject: [issue37455] asyncio.run() error related to finalizing async
 generators
In-Reply-To: <1561938788.3.0.655729732728.issue37455@roundup.psfhosted.org>
Message-ID: <1561938950.71.0.697852992185.issue37455@roundup.psfhosted.org>


Sam Frances <sam at samfrances.uk> added the comment:

Apologies for the stray unused function in the example. It should have read:

```
import asyncio


async def count():
    try:
        i = 0
        while True:
            yield i
            i += 1
    finally:
        print("count() cleanup")


async def double(source):
    try:
        async for n in source:
            yield n * 2
    finally:
        print("double() cleanup")


async def main():
    async for i in double(count()):
        if i > 10:
            return
        print(i)

asyncio.run(main())
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37455>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:03:26 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:03:26 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
In-Reply-To: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>
Message-ID: <1561939406.58.0.430419965924.issue37424@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
pull_requests: +14307
pull_request: https://github.com/python/cpython/pull/14490

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:04:26 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:04:26 +0000
Subject: [issue5115] Extend subprocess.kill to be able to kill process groups
In-Reply-To: <1233370260.58.0.70597374825.issue5115@psf.upfronthosting.co.za>
Message-ID: <1561939466.49.0.588400322026.issue5115@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> duplicate
superseder:  -> subprocess.run timeout does not function if shell=True and capture_output=True

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5115>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:06:10 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:06:10 +0000
Subject: [issue5115] Extend subprocess.kill to be able to kill process groups
In-Reply-To: <1233370260.58.0.70597374825.issue5115@psf.upfronthosting.co.za>
Message-ID: <1561939570.27.0.919060122594.issue5115@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

this is part of a chain of other related issues.  the interesting thing in the patch in here is the potential feature to have send_signal/terminate/kill be able to optionally kill a process group.

the logic as is in the patch in this issue is dangerous as often the calling process _is_ the pgrp leader and would be killed.  we _never_ want the subprocess signaling methods to kill the current process as that would be surprising to users.

----------
nosy: +gregory.p.smith
stage: patch review -> resolved
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue5115>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:06:43 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:06:43 +0000
Subject: [issue26534] subprocess.check_output with shell=True ignores the
 timeout
In-Reply-To: <1457653531.44.0.556796452495.issue26534@psf.upfronthosting.co.za>
Message-ID: <1561939603.33.0.72626888298.issue26534@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> subprocess.run timeout does not function if shell=True and capture_output=True

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue26534>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:06:54 2019
From: report at bugs.python.org (Sam Frances)
Date: Mon, 01 Jul 2019 00:06:54 +0000
Subject: [issue37455] asyncio.run() error related to finalizing async
 generators
In-Reply-To: <1561938788.3.0.655729732728.issue37455@roundup.psfhosted.org>
Message-ID: <1561939614.55.0.629918595196.issue37455@roundup.psfhosted.org>


Sam Frances <sam at samfrances.uk> added the comment:

One final note: changing the `main()` function from the example to add a zero-sleep seems to fix it, but this seems like a rather ad-hoc solution.

```
async def main():
    async for i in double(count()):
        if i > 10:
            break
        print(i)
    await asyncio.sleep(0)
```

result:

```
$ python example.py 
0
2
4
6
8
10
double() cleanup
count() cleanup
```

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37455>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:07:00 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:07:00 +0000
Subject: [issue30154] subprocess.run with stderr connected to a pipe won't
 timeout when killing a never-ending shell commanad
In-Reply-To: <1493029874.23.0.365021685695.issue30154@psf.upfronthosting.co.za>
Message-ID: <1561939620.71.0.0488454474536.issue30154@roundup.psfhosted.org>


Change by Gregory P. Smith <greg at krypto.org>:


----------
resolution:  -> duplicate
stage:  -> resolved
status: open -> closed
superseder:  -> subprocess.run timeout does not function if shell=True and capture_output=True

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue30154>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:09:37 2019
From: report at bugs.python.org (SoniEx2)
Date: Mon, 01 Jul 2019 00:09:37 +0000
Subject: [issue37456] FAQ says positional arguments aren't a thing
Message-ID: <1561939777.04.0.384153036015.issue37456@roundup.psfhosted.org>


New submission from SoniEx2 <fakedme at gmail.com>:

https://docs.python.org/3.8/faq/programming.html#what-does-the-slash-in-the-parameter-list-of-a-function-mean

"Note that as of this writing this is only documentational and no valid syntax in Python, although there is PEP 570, which proposes a syntax for position-only parameters in Python."

>From what I understand, they are now a thing. Perhaps it's time to take that out?

----------
assignee: docs at python
components: Documentation
messages: 346947
nosy: SoniEx2, docs at python
priority: normal
severity: normal
status: open
title: FAQ says positional arguments aren't a thing
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37456>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:09:59 2019
From: report at bugs.python.org (Gregory P. Smith)
Date: Mon, 01 Jul 2019 00:09:59 +0000
Subject: [issue37424] subprocess.run timeout does not function if shell=True
 and capture_output=True
In-Reply-To: <1561618790.88.0.611701645761.issue37424@roundup.psfhosted.org>
Message-ID: <1561939799.97.0.973764983348.issue37424@roundup.psfhosted.org>


Gregory P. Smith <greg at krypto.org> added the comment:

Issue 30154 that I've marked as a duplicate demonstrates this problem without using shell=True.  The solution I proposed handles that via the additional small timeout on the cleanup side, but still has the caveat that the grandchild processes keep running unless the caller used start_new_session=True.

See the PR.

We cannot reasonably determine when start_new_session=True should be a default behavior.  And I worry that doing it when it should not be will cause unexpected new problems with existing code.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37424>
_______________________________________

From report at bugs.python.org  Sun Jun 30 20:45:28 2019
From: report at bugs.python.org (Cheryl Sabella)
Date: Mon, 01 Jul 2019 00:45:28 +0000
Subject: [issue32631] IDLE: revise zzdummy.py
In-Reply-To: <1516690644.63.0.467229070634.issue32631@psf.upfronthosting.co.za>
Message-ID: <1561941928.99.0.877813623249.issue32631@roundup.psfhosted.org>


Change by Cheryl Sabella <cheryl.sabella at gmail.com>:


----------
keywords: +patch
pull_requests: +14308
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/14491

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue32631>
_______________________________________

From report at bugs.python.org  Sun Jun 30 21:09:12 2019
From: report at bugs.python.org (Dami Jeong)
Date: Mon, 01 Jul 2019 01:09:12 +0000
Subject: [issue37457] python3.7 re.split() module bug
Message-ID: <1561943352.7.0.22084826449.issue37457@roundup.psfhosted.org>


New submission from Dami Jeong <kate.jeong at nitmus.com>:

text = "Some File Num10 example.txt"
re.split("\s*", text)

The result of the regular expression in version 3.7 changed from the version 3.6 result

python3.6 version result :
['Some', 'File', 'Num10', 'example.txt']

python3.7 version result :
['', 'S', 'o', 'm', 'e', '', 'F', 'i', 'l', 'e', '', 'N', 'u', 'm', '1', '0', '', 'e', 'x', 'a', 'm', 'p', 'l', 'e', '.', 't', 'x', 't', '']

----------
components: Regular Expressions
messages: 346949
nosy: ezio.melotti, kate, mrabarnett
priority: normal
severity: normal
status: open
title: python3.7 re.split() module bug
type: performance
versions: Python 3.7

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37457>
_______________________________________

From report at bugs.python.org  Sun Jun 30 22:10:41 2019
From: report at bugs.python.org (Weijar Z)
Date: Mon, 01 Jul 2019 02:10:41 +0000
Subject: [issue37458] ast: Different FormattedValue expressions have same
 col_offset information
Message-ID: <1561947041.86.0.747696740213.issue37458@roundup.psfhosted.org>


New submission from Weijar Z <weijarz at gmail.com>:

This express 

  f"{x}{x}{y}"

will produce ast tree:

{
    "$node": "Module",
    "body": [
        {
            "$node": "Expr",
            "value": {
                "$node": "JoinedStr",
                "values": [
                    {
                        "$node": "FormattedValue",
                        "value": {
                            "$node": "Name",
                            "id": "x",
                            "ctx": {
                                "$node": "Load"
                            },
                            "lineno": 1,
                            "col_offset": 3
                        },
                        "conversion": -1,
                        "format_spec": null,
                        "lineno": 1,
                        "col_offset": 0
                    },
                    {
                        "$node": "FormattedValue",
                        "value": {
                            "$node": "Name",
                            "id": "x",
                            "ctx": {
                                "$node": "Load"
                            },
                            "lineno": 1,
                            "col_offset": 3
                        },
                        "conversion": -1,
                        "format_spec": null,
                        "lineno": 1,
                        "col_offset": 0
                    },
                    {
                        "$node": "FormattedValue",
                        "value": {
                            "$node": "Name",
                            "id": "y",
                            "ctx": {
                                "$node": "Load"
                            },
                            "lineno": 1,
                            "col_offset": 9
                        },
                        "conversion": -1,
                        "format_spec": null,
                        "lineno": 1,
                        "col_offset": 0
                    }
                ],
                "lineno": 1,
                "col_offset": 0
            },
            "lineno": 1,
            "col_offset": 0
        }
    ]
}

These two variable 'x' has same col_offset '3', is it wrong?

----------
components: Library (Lib)
messages: 346950
nosy: Weijar Z
priority: normal
severity: normal
status: open
title: ast: Different FormattedValue expressions have same col_offset information
type: behavior
versions: Python 3.7, Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37458>
_______________________________________

From report at bugs.python.org  Sun Jun 30 22:28:06 2019
From: report at bugs.python.org (Gregory Szorc)
Date: Mon, 01 Jul 2019 02:28:06 +0000
Subject: [issue37459] importlib docs improperly reference get_resource_loader()
Message-ID: <1561948086.26.0.674606380672.issue37459@roundup.psfhosted.org>


New submission from Gregory Szorc <gregory.szorc at gmail.com>:

The documentation in importlib.rst says that a loader should implement `get_resource_loader(fullname)`. This is the only occurrence of `get_resource_loader` in the CPython source tree. It should be changed to `get_resource_reader()`.

----------
components: Library (Lib)
messages: 346951
nosy: indygreg
priority: normal
severity: normal
status: open
title: importlib docs improperly reference get_resource_loader()
versions: Python 3.7, Python 3.8, Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37459>
_______________________________________

From report at bugs.python.org  Sun Jun 30 22:51:49 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 01 Jul 2019 02:51:49 +0000
Subject: [issue37456] FAQ says positional arguments aren't a thing
In-Reply-To: <1561939777.04.0.384153036015.issue37456@roundup.psfhosted.org>
Message-ID: <1561949509.32.0.474750251477.issue37456@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +pablogsal

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37456>
_______________________________________

From report at bugs.python.org  Sun Jun 30 23:15:50 2019
From: report at bugs.python.org (Yoong Hor Meng)
Date: Mon, 01 Jul 2019 03:15:50 +0000
Subject: [issue37460] importlib.import_module("test.test_curses") could not
 import by libregrtest
Message-ID: <1561950950.76.0.931039385859.issue37460@roundup.psfhosted.org>


New submission from Yoong Hor Meng <yoonghm at gmail.com>:

test_curses.py was skipped during unit test.  I manually ran the test via debugger:

python3 -m pdb /home/s/lib/python3.8/test/regrtest.py test_curses 

It showed error at 

../lib/python3.8/test/libregrtest/runtest.py(215)_runtest_inner2():

210         abstest = get_abs_module(ns, test_name)                                                                                      211                                                                                                                                      212         # remove the module from sys.module to reload it if it was already imported                                                  213         support.unload(abstest)                                                                                                      214                                                                                                                                      215  ->     the_module = importlib.import_module(abstest)                                                                                216                                                                                                                                      217         # If the test has a test_main, that will run the appropriate                                                                 218         # tests.  If not, use normal unittest test loading.                                                                          219         test_runner = getattr(the_module, "test_main", None)                                                                         220         if test_runner is None:            

test.support.ResourceDenied: Use of the 'curses' resource not enabled 

However, it was possible to load the module

import importlib
the_module = importlib.import_module('test.test_curses')
print(the_module)

----------
components: Library (Lib)
messages: 346952
nosy: yoonghm
priority: normal
severity: normal
status: open
title: importlib.import_module("test.test_curses") could not import by libregrtest
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37460>
_______________________________________

From report at bugs.python.org  Sun Jun 30 23:21:13 2019
From: report at bugs.python.org (Guido Vranken)
Date: Mon, 01 Jul 2019 03:21:13 +0000
Subject: [issue37461] email.parser.Parser hang
Message-ID: <1561951273.26.0.821144691276.issue37461@roundup.psfhosted.org>


New submission from Guido Vranken <guidovranken at gmail.com>:

The following will hang, and consume a large amount of memory:

from email.parser import BytesParser, Parser
from email.policy import default
payload = "".join(chr(c) for c in [0x43, 0x6f, 0x6e, 0x74, 0x65, 0x6e, 0x74, 0x2d, 0x54, 0x79, 0x70, 0x65, 0x3a, 0x78, 0x3b, 0x61, 0x72, 0x1b, 0x2a, 0x3d, 0x22, 0x73, 0x4f, 0x27, 0x23, 0x61, 0xff, 0xff, 0x27, 0x5c, 0x22])
Parser(policy=default).parsestr(payload)

----------
components: email
messages: 346953
nosy: Guido, barry, r.david.murray
priority: normal
severity: normal
status: open
title: email.parser.Parser hang
type: crash
versions: Python 3.9

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37461>
_______________________________________

From report at bugs.python.org  Sun Jun 30 23:30:13 2019
From: report at bugs.python.org (Yoong Hor Meng)
Date: Mon, 01 Jul 2019 03:30:13 +0000
Subject: [issue37460] importlib.import_module("test.test_curses") could not
 import by libregrtest
In-Reply-To: <1561950950.76.0.931039385859.issue37460@roundup.psfhosted.org>
Message-ID: <1561951813.08.0.314219320921.issue37460@roundup.psfhosted.org>


Yoong Hor Meng <yoonghm at gmail.com> added the comment:

https://bugs.python.org/issue5356 mentioned that one has to pass 

-ucurses to regrtest.py

It works.  However the Makefile does not pass the information to regrtest.py when calling test_curses.py

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37460>
_______________________________________

From report at bugs.python.org  Sun Jun 30 23:32:43 2019
From: report at bugs.python.org (Karthikeyan Singaravelan)
Date: Mon, 01 Jul 2019 03:32:43 +0000
Subject: [issue37461] email.parser.Parser hang
In-Reply-To: <1561951273.26.0.821144691276.issue37461@roundup.psfhosted.org>
Message-ID: <1561951963.42.0.756280940581.issue37461@roundup.psfhosted.org>


Change by Karthikeyan Singaravelan <tir.karthi at gmail.com>:


----------
nosy: +maxking

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37461>
_______________________________________

From report at bugs.python.org  Sun Jun 30 23:58:58 2019
From: report at bugs.python.org (Ma Lin)
Date: Mon, 01 Jul 2019 03:58:58 +0000
Subject: [issue37457] python3.7 re.split() module bug
In-Reply-To: <1561943352.7.0.22084826449.issue37457@roundup.psfhosted.org>
Message-ID: <1561953538.83.0.0480572040942.issue37457@roundup.psfhosted.org>


Ma Lin <malincns at 163.com> added the comment:

Try this pattern:

>>> re.split(r"\s+", text)
['Some', 'File', 'Num10', 'example.txt']

IMO 3.7 behaivor is more reasonable, it fixes a bug (issue25054).

----------
nosy: +Ma Lin

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue37457>
_______________________________________